zfs_threaded_io
2 x Intel Xeon E5-2690 v4 testing with a Supermicro X10DRC-LN4+ v1.02 (3.1 BIOS) and ASPEED on Ubuntu 18.04 via the Phoronix Test Suite.


23052019: 

	Processor: 2 x Intel Xeon E5-2690 v4 @ 3.50GHz (28 Cores / 56 Threads), Motherboard: Supermicro X10DRC-LN4+ v1.02 (3.1 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 8 x 16384 MB DDR4-1866MT/s Kingston, Disk: 6 x 6001GB HUS726060AL5210 + 2 x 1600GB INTEL SSDSC2BB01 + 120GB INTEL SSDSC2BB12, Graphics: ASPEED, Network: 4 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

	OS: Ubuntu 18.04, Kernel: 4.15.0-45-generic (x86_64), Compiler: GCC 7.4.0, File-System: ext4, Screen Resolution: 1024x768


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 32MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 7749.62 |===========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 32MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 13992.06 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 64MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 8881.36 |===========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 64MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 15892.29 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 128MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 9653.87 |===========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 128MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 15850.58 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 256MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 10238.78 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 256MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 15987.41 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 32MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 16483.87 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 32MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 26736.01 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 64MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 18211.78 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 64MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 25242.06 |==========================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 32MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 1.88 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 32MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 3.75 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 64MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 1.88 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 64MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 3.73 |==============================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 128MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 17887.20 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 128MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 25485.88 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 256MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 15781.84 |==========================================================


Threaded I/O Tester 20170503
Test: Read - Size Per Thread: 256MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 23273.50 |==========================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 128MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 1.87 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 128MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 3.72 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 256MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 1.87 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 256MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 3.71 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 32MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 7.46 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 32MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 14.54 |=============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 64MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 7.36 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 64MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 14.18 |=============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 128MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 7.17 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 128MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 13.83 |=============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 256MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 7.26 |==============================================================


Threaded I/O Tester 20170503
Test: Write - Size Per Thread: 256MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 13.49 |=============================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 32MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 37798.10 |==========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 32MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 67414.91 |==========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 64MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 74111.88 |==========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 64MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 141077.53 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 128MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 144831.82 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 128MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 265440.69 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 256MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 284300.08 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 256MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 539794.30 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 32MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 98988.79 |==========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 32MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 136787.44 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 64MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 174534.42 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 64MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 260763.55 |=========================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 32MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 15.52 |=============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 32MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 31.99 |=============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 64MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 31.02 |=============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 64MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 62.46 |=============================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 128MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 294001.11 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 128MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 537670.06 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 256MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 724421.78 |=========================================================


Threaded I/O Tester 20170503
Test: Random Read - Size Per Thread: 256MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 996585.30 |=========================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 128MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 62.54 |=============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 128MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 124.76 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 256MB - Thread Count: 4
MB/s > Higher Is Better
23052019 . 124.27 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 256MB - Thread Count: 8
MB/s > Higher Is Better
23052019 . 251.43 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 32MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 61.31 |=============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 32MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 122.91 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 64MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 123.53 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 64MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 245.11 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 128MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 245.27 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 128MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 494.17 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 256MB - Thread Count: 16
MB/s > Higher Is Better
23052019 . 489.82 |============================================================


Threaded I/O Tester 20170503
Test: Random Write - Size Per Thread: 256MB - Thread Count: 32
MB/s > Higher Is Better
23052019 . 982.67 |============================================================