m610-vs-m915-memory After changing a few things, making sure we can come back to the optimal setting M610 2x5687 96GB, Kern=native: Processor: Intel Xeon X5687 @ 3.59GHz (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs M610 2x5687 96GB, Kern=native NoPowerD but epp running: Processor: Intel Xeon X5687 @ 3.59GHz (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs M610 2x5687 96GB, Kern=native PowerD TurbosOnly: Processor: Intel Xeon X5687 @ 3.59GHz (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf: Processor: Intel Xeon X5687 (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM: Processor: Intel Xeon X5687 (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2: Processor: Intel Xeon X5687 (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs M610 SLIMFAST4: Processor: Intel Xeon X5687 (16 Cores), Motherboard: Dell PowerEdge M610x, Chipset: Intel 5500 I/O Hub ESI Port, Memory: 96GB, Disk: ATA OCZ VERTEX2 1.35 + DP BACKPLANE 1.07, Graphics: Matrox MGA G200eW WPCM450 OS: FreeBSD, Kernel: 13.1-RELEASE (x86_64), Compiler: Clang 13.0.0, File-System: zfs CacheBench Write Cache MB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 6862.70 |==== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 13329.51 |======== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 13739.50 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 14318.45 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 14311.74 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 14318.57 |========= M610 SLIMFAST4 ............................................ 14318.80 |========= CacheBench Read Cache MB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 4761.70 |===== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 9132.16 |========= M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 9407.28 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 9809.61 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 9765.83 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 9809.73 |========== M610 SLIMFAST4 ............................................ 9809.38 |========== MBW 2018-09-08 Test: Memory Copy, Fixed Block Size - Array Size: 1024 MiB MiB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 4533.92 |======== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 5113.85 |========= M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 4849.32 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 5386.16 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 5227.55 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 5398.45 |========== M610 SLIMFAST4 ............................................ 5216.27 |========== Stream 2013-01-17 Type: Copy MB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 27283.5 |========== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 28200.7 |========== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 28058.2 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 28183.7 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 27834.9 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 28084.4 |========== M610 SLIMFAST4 ............................................ 27815.4 |========== MBW 2018-09-08 Test: Memory Copy - Array Size: 1024 MiB MiB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 4443.33 |======== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 5468.25 |========== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 4824.19 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 5249.07 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 5072.93 |========= M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 5653.08 |========== M610 SLIMFAST4 ............................................ 5540.08 |========== t-test1 2017-01-13 Threads: 1 Seconds < Lower Is Better M610 2x5687 96GB, Kern=native ............................. 30.66 |============ M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 14.66 |====== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 14.65 |====== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 13.99 |===== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 30.66 |============ M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 13.99 |===== M610 SLIMFAST4 ............................................ 13.89 |===== t-test1 2017-01-13 Threads: 2 Seconds < Lower Is Better M610 2x5687 96GB, Kern=native ............................. 9.950 |============ M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 4.490 |===== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 4.478 |===== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 4.297 |===== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 9.950 |============ M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 4.287 |===== M610 SLIMFAST4 ............................................ 4.280 |===== Stream 2013-01-17 Type: Add MB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 27760.2 |========== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 29049.2 |========== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 28691.5 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 28890.4 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 28729.0 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 28841.3 |========== M610 SLIMFAST4 ............................................ 28227.9 |========== Stream 2013-01-17 Type: Triad MB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 28376.0 |========== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 29094.6 |========== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 28815.1 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 29001.3 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 29009.1 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 28998.5 |========== M610 SLIMFAST4 ............................................ 28397.7 |========== Stream 2013-01-17 Type: Scale MB/s > Higher Is Better M610 2x5687 96GB, Kern=native ............................. 25830.9 |========== M610 2x5687 96GB, Kern=native NoPowerD but epp running .... 26531.0 |========== M610 2x5687 96GB, Kern=native PowerD TurbosOnly ........... 26253.5 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf .... 26424.0 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSSystemDBPM . 26407.0 |========== M610 2x5687 96GB, Kern=native noPowerD DellBIOSMaxPerf2 ... 26405.4 |========== M610 SLIMFAST4 ............................................ 25821.1 |==========