MDS Mitigation Impact Four Systems

MDS / Zombie Load mitigation impact tests by Michael Larabel on a future article.

HTML result view exported from: https://openbenchmarking.org/result/1905208-HV-INTELMDS451&grw&sor.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionE3-1275 v62 x Xeon 6138 MDS Mitigated MDS Vulnerable MDS Mitigated MDS VulnerableIntel Xeon E3-1275 v6 @ 4.20GHz (4 Cores / 8 Threads)ASUS P10S-M WS (4401 BIOS)Intel Xeon E3-1200 v6/7th16384MBSamsung SSD 970 EVO Plus 500GBIntel HD P630 3GB (1150MHz)Realtek ALC1150LG Ultra HD2 x Intel I210Ubuntu 19.045.0.0-15-generic (x86_64)GNOME Shell 3.32.0X Server 1.20.4modesetting 1.20.44.5 Mesa 19.0.2GCC 8.3.0ext43840x21602 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.02.B20 BIOS)Intel Sky Lake-E DMI3 Registers96256MBSamsung SSD 970 EVO 250GBllvmpipe 93GBVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE + Mellanox MT264483.3 Mesa 19.0.2 (LLVM 8.0 256 bits)1920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- NONE / errors=remount-ro,relatime,rwProcessor Details- Scaling Governor: intel_pstate powersaveJava Details- OpenJDK Runtime Environment (build 11.0.3+7-Ubuntu-1ubuntu219.04.1)Python Details- Python 2.7.16 + Python 3.7.3Security Details- E3-1275 v6: MDS Mitigated: KPTI + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - E3-1275 v6: MDS Vulnerable: KPTI + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Vulnerable; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - 2 x Xeon 6138: MDS Mitigated: KPTI + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling - 2 x Xeon 6138: MDS Vulnerable: KPTI + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Vulnerable; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling

compilebench: Initial Createt-test1: 2ctx-clock: Context Switch Timehackbench: 32 - Processstress-ng: Semaphoresstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: System V Message Passingsockperf: Throughputsockperf: Latency Ping Pongsockperf: Latency Under Loadglibc-bench: ffsglibc-bench: ffsllglibc-bench: pthread_oncegimp: resizegimp: rotategimp: auto-levelsgimp: unsharp-maskosbench: Create Filesosbench: Create Threadsosbench: Launch Programsosbench: Memory Allocationspostmark: Disk Transaction Performanceethr: TCP - Latency - 1ethr: TCP - Latency - 32build-llvm: Time To Compilebuild-linux-kernel: Time To Compilemcperf: Getmcperf: Setopenssl: RSA 4096-bit Performanceredis: SETpgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writebork: File Encryption TimeE3-1275 v62 x Xeon 6138 MDS Mitigated MDS Vulnerable MDS Mitigated MDS Vulnerable5336.52105020149827723824170646645653285464983.0817.921.831.831.839.0113.6315.3217.0913.6011.1248.8772.38625010.1410.16748131128736762891220209270311382344936.615656.1258816356572694867200944272296895966262.9315.551.711.711.718.8613.4414.9416.6712.9410.5945.5470.2966979.169.17749129142321788671221215852312016246706.385039.2658651.981779241185592285424153630473855304.6635.352.052.062.0613.2419.5426.5931.7416.2422.4456.0798.33490121.0420.6415531.74944275181678451648494543375134648.055349.2034246.341874997209582784496057324164161634.3236.151.931.941.9413.0919.3026.1930.8415.6821.6154.9395.81517319.8519.9415431.0499447509307803165497557013384408.00OpenBenchmarking.org

Compile Bench

Test: Initial Create

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateMDS VulnerableMDS Mitigated120240360480600SE +/- 9.09, N = 3SE +/- 3.42, N = 3SE +/- 5.06, N = 3SE +/- 2.22, N = 3565533534503

t-test1

Threads: 2

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgSeconds, Fewer Is Bettert-test1 2017-01-13Threads: 2MDS VulnerableMDS Mitigated3691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 36.126.529.209.261. (CC) gcc options: -pthread

ctx_clock

Context Switch Time

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeMDS VulnerableMDS Mitigated2004006008001000SE +/- 5.03, N = 33425865881050

Hackbench

Count: 32 - Type: Process

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgSeconds, Fewer Is BetterHackbenchCount: 32 - Type: ProcessMDS VulnerableMDS Mitigated4080120160200SE +/- 0.80, N = 12SE +/- 0.72, N = 15SE +/- 0.90, N = 3SE +/- 1.86, N = 346.3451.98163.00201.001. (CC) gcc options: -lpthread

Stress-NG

Test: Semaphores

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: SemaphoresMDS VulnerableMDS Mitigated1.2M2.4M3.6M4.8M6MSE +/- 27858.47, N = 3SE +/- 22369.03, N = 3SE +/- 22447.85, N = 15SE +/- 27975.58, N = 1556572694982772187499717792411. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Socket Activity

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Socket ActivityMDS VulnerableMDS Mitigated4K8K12K16K20KSE +/- 193.14, N = 12SE +/- 288.42, N = 3SE +/- 95.69, N = 15SE +/- 48.24, N = 32095818559486738241. (CC) gcc options: -O2 -std=gnu99 -lm -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: Context Switching

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: Context SwitchingMDS VulnerableMDS Mitigated6M12M18M24M30MSE +/- 900326.49, N = 15SE +/- 137846.16, N = 3SE +/- 19889.50, N = 3SE +/- 5690.93, N = 32784496022854241200944217064661. (CC) gcc options: -O2 -std=gnu99 -lm -lcrypt -lrt -lpthread -laio -lc

Stress-NG

Test: System V Message Passing

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.07.26Test: System V Message PassingMDS VulnerableMDS Mitigated1.5M3M4.5M6M7.5MSE +/- 97616.61, N = 3SE +/- 206175.33, N = 12SE +/- 78632.05, N = 3SE +/- 51841.16, N = 1572296894565328573241653630471. (CC) gcc options: -O2 -std=gnu99 -lm -lcrypt -lrt -lpthread -laio -lc

Sockperf

Test: Throughput

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: ThroughputMDS VulnerableMDS Mitigated130K260K390K520K650KSE +/- 5413.08, N = 25SE +/- 6082.67, N = 5SE +/- 1726.80, N = 5SE +/- 3753.87, N = 55966265464984161633855301. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Sockperf

Test: Latency Ping Pong

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping PongMDS VulnerableMDS Mitigated1.04852.0973.14554.1945.2425SE +/- 0.02, N = 5SE +/- 0.02, N = 5SE +/- 0.03, N = 5SE +/- 0.03, N = 252.933.084.324.661. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Sockperf

Test: Latency Under Load

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Under LoadMDS VulnerableMDS Mitigated816243240SE +/- 1.32, N = 20SE +/- 1.54, N = 20SE +/- 0.82, N = 20SE +/- 1.35, N = 2115.5517.9235.3536.151. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

glibc bench

Benchmark: ffs

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgnanoseconds, Fewer Is Betterglibc bench 1.0Benchmark: ffsMDS VulnerableMDS Mitigated0.46130.92261.38391.84522.3065SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.711.831.932.05

glibc bench

Benchmark: ffsll

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgnanoseconds, Fewer Is Betterglibc bench 1.0Benchmark: ffsllMDS VulnerableMDS Mitigated0.46350.9271.39051.8542.3175SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.711.831.942.06

glibc bench

Benchmark: pthread_once

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgnanoseconds, Fewer Is Betterglibc bench 1.0Benchmark: pthread_onceMDS VulnerableMDS Mitigated0.46350.9271.39051.8542.3175SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.711.831.942.06

GIMP

Test: resize

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.8Test: resizeMDS VulnerableMDS Mitigated3691215SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 38.869.0113.0913.24

GIMP

Test: rotate

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.8Test: rotateMDS VulnerableMDS Mitigated510152025SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 313.4413.6319.3019.54

GIMP

Test: auto-levels

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.8Test: auto-levelsMDS VulnerableMDS Mitigated612182430SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 314.9415.3226.1926.59

GIMP

Test: unsharp-mask

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgSeconds, Fewer Is BetterGIMP 2.10.8Test: unsharp-maskMDS VulnerableMDS Mitigated714212835SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 316.6717.0930.8431.74

OSBench

Test: Create Files

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesMDS VulnerableMDS Mitigated48121620SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 312.9413.6015.6816.241. (CC) gcc options: -lm

OSBench

Test: Create Threads

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create ThreadsMDS VulnerableMDS Mitigated510152025SE +/- 0.11, N = 15SE +/- 0.12, N = 7SE +/- 0.19, N = 3SE +/- 0.19, N = 310.5911.1221.6122.441. (CC) gcc options: -lm

OSBench

Test: Launch Programs

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Launch ProgramsMDS VulnerableMDS Mitigated1326395265SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.14, N = 3SE +/- 0.50, N = 345.5448.8754.9356.071. (CC) gcc options: -lm

OSBench

Test: Memory Allocations

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgNs Per Event, Fewer Is BetterOSBenchTest: Memory AllocationsMDS VulnerableMDS Mitigated20406080100SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 370.2972.3895.8198.331. (CC) gcc options: -lm

PostMark

Disk Transaction Performance

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceMDS VulnerableMDS Mitigated14002800420056007000SE +/- 59.33, N = 3SE +/- 35.33, N = 366976250517349011. (CC) gcc options: -O3

Ethr

Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 1

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgMicroseconds, Fewer Is BetterEthr 2019-01-02Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 1MDS VulnerableMDS Mitigated510152025SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 4SE +/- 0.22, N = 159.1610.1419.8521.04

Ethr

Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 32

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgMicroseconds, Fewer Is BetterEthr 2019-01-02Server Address: localhost - Protocol: TCP - Test: Latency - Threads: 32MDS VulnerableMDS Mitigated510152025SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.21, N = 39.1710.1619.9420.64

Timed LLVM Compilation

Time To Compile

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 6.0.1Time To CompileMDS VulnerableMDS Mitigated160320480640800154155748749

Timed Linux Kernel Compilation

Time To Compile

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.18Time To CompileMDS VulnerableMDS Mitigated306090120150SE +/- 0.33, N = 15SE +/- 0.27, N = 15SE +/- 0.62, N = 3SE +/- 0.82, N = 331.0431.74129.00131.00

Memcached mcperf

Method: Get

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: GetMDS VulnerableMDS Mitigated30K60K90K120K150KSE +/- 1267.41, N = 3SE +/- 336.19, N = 3SE +/- 507.49, N = 3SE +/- 209.51, N = 314232112873699447944271. (CC) gcc options: -O2 -lm -rdynamic

Memcached mcperf

Method: Set

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgOperations Per Second, More Is BetterMemcached mcperf 1.5.10Method: SetMDS VulnerableMDS Mitigated20K40K60K80K100KSE +/- 557.15, N = 3SE +/- 403.15, N = 3SE +/- 316.41, N = 3SE +/- 658.78, N = 3788677628951816509301. (CC) gcc options: -O2 -lm -rdynamic

OpenSSL

RSA 4096-bit Performance

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.1.1RSA 4096-bit PerformanceMDS MitigatedMDS Vulnerable2K4K6K8K10KSE +/- 21.29, N = 3SE +/- 62.86, N = 3SE +/- 2.29, N = 3SE +/- 1.55, N = 378457803122112201. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl

Redis

Test: SET

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 4.0.8Test: SETMDS VulnerableMDS Mitigated500K1000K1500K2000K2500KSE +/- 16368.00, N = 3SE +/- 23688.81, N = 6SE +/- 28419.85, N = 15SE +/- 24791.61, N = 1521585232092703165497516484941. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyMDS VulnerableMDS Mitigated120K240K360K480K600KSE +/- 3299.92, N = 3SE +/- 2892.47, N = 3SE +/- 209.97, N = 3SE +/- 254.97, N = 35701335433751201621138231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

2 x Xeon 6138E3-1275 v6OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteMDS MitigatedMDS Vulnerable3K6K9K12K15KSE +/- 24.44, N = 3SE +/- 811.59, N = 12SE +/- 18.33, N = 3SE +/- 60.22, N = 5134648440467044931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Bork File Encrypter

File Encryption Time

E3-1275 v62 x Xeon 6138OpenBenchmarking.orgSeconds, Fewer Is BetterBork File Encrypter 1.4File Encryption TimeMDS VulnerableMDS Mitigated246810SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 36.386.618.008.05

Phoronix Test Suite v10.8.4