Ubuntu 18.04 L1TF Foreshadow VM Testing Tests done from an Ubuntu 18.04 LTS x86_64 dual Xeon Gold 6138 Tyan server (the one frequently used in other Phoronix benchmarks). Host and VM using the Ubuntu packages including its patched 4.15 based kernel. Mitigation levels/tunables done after reboot each time from the bare metal system. VM was lone resource intensive process on the server and configured to access 80% of the host system's CPU resources, Tests by Michael Larabel for a future article. Unmitigated: Processor: 64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS), Chipset: Intel 440FX- 82441FX PMC, Memory: 47104MB, Disk: 162GB, Graphics: llvmpipe 46848MB, Audio: QEMU Generic, Network: Red Hat Virtio device OS: Ubuntu 18.04, Kernel: 4.15.0-29-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, Display Driver: modesetting 1.19.6, OpenGL: 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: KVM Default Mitigation: Processor: 64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS), Chipset: Intel 440FX- 82441FX PMC, Memory: 47104MB, Disk: 162GB, Graphics: llvmpipe 46848MB, Audio: QEMU Generic, Network: Red Hat Virtio device OS: Ubuntu 18.04, Kernel: 4.15.0-32-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, Display Driver: modesetting 1.19.6, OpenGL: 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: KVM Always Flushing: Processor: 64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS), Chipset: Intel 440FX- 82441FX PMC, Memory: 47104MB, Disk: 162GB, Graphics: llvmpipe 46848MB, Audio: QEMU Generic, Network: Red Hat Virtio device OS: Ubuntu 18.04, Kernel: 4.15.0-32-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, Display Driver: modesetting 1.19.6, OpenGL: 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: KVM Full Mitigation: Processor: 64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS), Chipset: Intel 440FX- 82441FX PMC, Memory: 47104MB, Disk: 162GB, Graphics: llvmpipe 46848MB, Audio: QEMU Generic, Network: Red Hat Virtio device OS: Ubuntu 18.04, Kernel: 4.15.0-32-generic (x86_64), Desktop: GNOME Shell 3.28.2, Display Server: X Server 1.19.6, Display Driver: modesetting 1.19.6, OpenGL: 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: KVM SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better Unmitigated ........ 61.99 |================================================== Default Mitigation . 63.28 |=================================================== Always Flushing .... 62.71 |=================================================== Full Mitigation .... 62.49 |================================================== Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Unmitigated ........ 1972 |================================================ Default Mitigation . 2153 |==================================================== Always Flushing .... 2132 |=================================================== Full Mitigation .... 2044 |================================================= Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Unmitigated ........ 1318 |=============================================== Default Mitigation . 1444 |==================================================== Always Flushing .... 1432 |==================================================== Full Mitigation .... 1219 |============================================ IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better Unmitigated ........ 309.22 |================================================= Default Mitigation . 311.44 |================================================= Always Flushing .... 314.77 |================================================== Full Mitigation .... 304.39 |================================================ Compile Bench 0.6 Test: Compile MB/s > Higher Is Better Unmitigated ........ 1402.16 |=============================================== Default Mitigation . 1450.63 |================================================= Always Flushing .... 1408.53 |================================================ Full Mitigation .... 1360.12 |============================================== Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Unmitigated ........ 462.67 |================================================== Default Mitigation . 444.94 |================================================ Always Flushing .... 451.08 |================================================= Full Mitigation .... 411.13 |============================================ Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better Unmitigated ........ 2234.53 |================================================= Default Mitigation . 2233.48 |================================================= Always Flushing .... 2237.12 |================================================= Full Mitigation .... 2178.71 |================================================ Sockperf 3.4 Test: Throughput Messages Per Second > Higher Is Better Unmitigated ........ 464697 |================================================ Default Mitigation . 489081 |================================================== Always Flushing .... 468362 |================================================ Full Mitigation .... 477577 |================================================= Sockperf 3.4 Test: Latency Ping Pong usec < Lower Is Better Unmitigated ........ 7.14 |=========================================== Default Mitigation . 7.80 |=============================================== Always Flushing .... 8.70 |==================================================== Full Mitigation .... 6.90 |========================================= Sockperf 3.4 Test: Latency Under Load usec < Lower Is Better Unmitigated ........ 45.94 |============================================ Default Mitigation . 46.84 |============================================= Always Flushing .... 49.14 |=============================================== Full Mitigation .... 53.28 |=================================================== TTSIOD 3D Renderer 2.3b Phong Rendering With Soft-Shadow Mapping FPS > Higher Is Better Unmitigated ........ 660.20 |================================================== Default Mitigation . 651.56 |================================================= Always Flushing .... 652.36 |================================================= Full Mitigation .... 206.30 |================ ebizzy 0.3 Records/s > Higher Is Better Unmitigated ........ 48618 |================================= Default Mitigation . 44835 |============================== Always Flushing .... 53068 |==================================== Full Mitigation .... 76020 |=================================================== Timed Linux Kernel Compilation 4.13 Time To Compile Seconds < Lower Is Better Unmitigated ........ 33.85 |============================================= Default Mitigation . 33.73 |============================================= Always Flushing .... 33.64 |============================================= Full Mitigation .... 38.00 |=================================================== Timed LLVM Compilation 6.0.1 Time To Compile Seconds < Lower Is Better Unmitigated ........ 195.49 |============================================= Default Mitigation . 203.77 |============================================== Always Flushing .... 199.40 |============================================== Full Mitigation .... 219.11 |================================================== Zstd Compression 1.3.4 Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 Seconds < Lower Is Better Unmitigated ........ 144.83 |================================================= Default Mitigation . 140.34 |=============================================== Always Flushing .... 145.58 |================================================= Full Mitigation .... 148.09 |================================================== Hackbench Count: 4 - Type: Thread Seconds < Lower Is Better Unmitigated ........ 9.42 |====================== Default Mitigation . 9.51 |====================== Always Flushing .... 10.58 |========================= Full Mitigation .... 21.72 |=================================================== Hackbench Count: 8 - Type: Thread Seconds < Lower Is Better Unmitigated ........ 18.87 |================================ Default Mitigation . 19.30 |================================ Always Flushing .... 21.76 |===================================== Full Mitigation .... 30.39 |=================================================== Hackbench Count: 16 - Type: Thread Seconds < Lower Is Better Unmitigated ........ 36.97 |=================================== Default Mitigation . 38.03 |==================================== Always Flushing .... 43.36 |========================================= Full Mitigation .... 54.12 |=================================================== Hackbench Count: 4 - Type: Process Seconds < Lower Is Better Unmitigated ........ 9.49 |====================== Default Mitigation . 9.59 |====================== Always Flushing .... 10.78 |========================= Full Mitigation .... 21.91 |=================================================== Hackbench Count: 8 - Type: Process Seconds < Lower Is Better Unmitigated ........ 20.11 |================================ Default Mitigation . 19.81 |================================ Always Flushing .... 24.19 |======================================= Full Mitigation .... 31.94 |=================================================== Hackbench Count: 16 - Type: Process Seconds < Lower Is Better Unmitigated ........ 37.04 |=============================== Default Mitigation . 36.59 |============================== Always Flushing .... 43.53 |==================================== Full Mitigation .... 61.49 |=================================================== OpenSSL 1.1.0f RSA 4096-bit Performance Signs Per Second > Higher Is Better Unmitigated ........ 7915.97 |================================================= Default Mitigation . 7879.13 |================================================= Always Flushing .... 7833.37 |================================================ Full Mitigation .... 7607.07 |=============================================== MariaDB 10.3.8 Clients: 8 Queries Per Second > Higher Is Better Unmitigated ........ 245 |===================================================== Default Mitigation . 244 |===================================================== Always Flushing .... 237 |=================================================== Full Mitigation .... 235 |=================================================== PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Only TPS > Higher Is Better Unmitigated ........ 394876.94 |=============================================== Default Mitigation . 387186.23 |============================================== Always Flushing .... 376404.54 |============================================= Full Mitigation .... 263895.66 |=============================== PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write TPS > Higher Is Better Unmitigated ........ 5152.08 |================================================= Default Mitigation . 5162.44 |================================================= Always Flushing .... 5126.91 |================================================= Full Mitigation .... 4859.91 |============================================== Redis 4.0.8 Test: LPOP Requests Per Second > Higher Is Better Unmitigated ........ 2068611.85 |============================================== Default Mitigation . 1840381.56 |========================================= Always Flushing .... 1443664.99 |================================ Full Mitigation .... 1397732.79 |=============================== Redis 4.0.8 Test: SADD Requests Per Second > Higher Is Better Unmitigated ........ 1878780.17 |============================================== Default Mitigation . 1746629.66 |=========================================== Always Flushing .... 1669834.00 |========================================= Full Mitigation .... 1625370.68 |======================================== Redis 4.0.8 Test: LPUSH Requests Per Second > Higher Is Better Unmitigated ........ 1297688.50 |========================================== Default Mitigation . 1431348.01 |============================================== Always Flushing .... 1418073.81 |============================================== Full Mitigation .... 1405706.45 |============================================= Redis 4.0.8 Test: GET Requests Per Second > Higher Is Better Unmitigated ........ 2026228.33 |============================================== Default Mitigation . 1824211.40 |========================================= Always Flushing .... 1762582.37 |======================================== Full Mitigation .... 1789732.77 |========================================= Redis 4.0.8 Test: SET Requests Per Second > Higher Is Better Unmitigated ........ 1463285.46 |============================================ Default Mitigation . 1531909.19 |============================================== Always Flushing .... 1421644.67 |=========================================== Full Mitigation .... 1501864.62 |============================================= Stress-NG 0.07.26 Test: Semaphores Bogo Ops/s > Higher Is Better Unmitigated ........ 557628.55 |===================================== Default Mitigation . 599437.06 |======================================== Always Flushing .... 581171.78 |======================================= Full Mitigation .... 700793.02 |=============================================== Stress-NG 0.07.26 Test: Matrix Math Bogo Ops/s > Higher Is Better Unmitigated ........ 168491.90 |============================================== Default Mitigation . 169670.38 |============================================== Always Flushing .... 171874.04 |=============================================== Full Mitigation .... 136088.10 |===================================== Stress-NG 0.07.26 Test: Vector Math Bogo Ops/s > Higher Is Better Unmitigated ........ 60351.43 |================================================ Default Mitigation . 60406.78 |================================================ Always Flushing .... 60504.84 |================================================ Full Mitigation .... 45524.09 |==================================== Stress-NG 0.07.26 Test: Socket Activity Bogo Ops/s > Higher Is Better Unmitigated ........ 13880.53 |================================================ Default Mitigation . 13163.12 |============================================== Always Flushing .... 12992.89 |============================================= Full Mitigation .... 12833.20 |============================================ Stress-NG 0.07.26 Test: Context Switching Bogo Ops/s > Higher Is Better Unmitigated ........ 12590168.74 |============================================= Default Mitigation . 12482470.05 |============================================= Always Flushing .... 12370237.98 |============================================ Full Mitigation .... 11050870.69 |======================================= Stress-NG 0.07.26 Test: System V Message Passing Bogo Ops/s > Higher Is Better Unmitigated ........ 12135778.98 |============================================ Default Mitigation . 12276978.98 |============================================= Always Flushing .... 12192475.24 |============================================= Full Mitigation .... 7914016.08 |============================= Sysbench 2018-07-28 Test: Memory Events Per Second > Higher Is Better Unmitigated ........ 10438083.96 |============================================= Default Mitigation . 10535022.39 |============================================= Always Flushing .... 10510051.38 |============================================= Full Mitigation .... 7267419.40 |=============================== Sysbench 2018-07-28 Test: CPU Events Per Second > Higher Is Better Unmitigated ........ 51572.28 |================================================ Default Mitigation . 51480.55 |================================================ Always Flushing .... 51558.10 |================================================ Full Mitigation .... 36587.25 |================================== NGINX Benchmark 1.9.9 Static Web Page Serving Requests Per Second > Higher Is Better Unmitigated ........ 27495.41 |================================================ Default Mitigation . 26983.21 |=============================================== Always Flushing .... 26388.08 |============================================== Full Mitigation .... 26712.57 |=============================================== Apache Benchmark 2.4.29 Static Web Page Serving Requests Per Second > Higher Is Better Unmitigated ........ 24525.21 |================================================ Default Mitigation . 24714.34 |================================================ Always Flushing .... 22456.19 |============================================ Full Mitigation .... 22023.62 |=========================================== Apache Siege 2.4.29 Concurrent Users: 50 Transactions Per Second > Higher Is Better Unmitigated ........ 14060.58 |================================================ Default Mitigation . 13700.33 |=============================================== Always Flushing .... 13502.71 |============================================== Full Mitigation .... 8015.48 |=========================== Git Time To Complete Common Git Commands Seconds < Lower Is Better Unmitigated ........ 7.35 |==================================================== Default Mitigation . 7.28 |==================================================== Always Flushing .... 7.27 |=================================================== Full Mitigation .... 7.30 |==================================================== Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better Unmitigated ........ 12100 |=================================================== Default Mitigation . 11311 |================================================ Always Flushing .... 10767 |============================================= Full Mitigation .... 10533 |============================================ Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better Unmitigated ........ 11367 |=================================================== Default Mitigation . 11400 |=================================================== Always Flushing .... 10333 |============================================== Full Mitigation .... 11033 |================================================= Flexible IO Tester 3.1 Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Unmitigated ........ 1095 |================================================ Default Mitigation . 1115 |================================================= Always Flushing .... 1191 |==================================================== Full Mitigation .... 1180 |==================================================== Flexible IO Tester 3.1 Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Unmitigated ........ 766 |================================================= Default Mitigation . 830 |===================================================== Always Flushing .... 788 |================================================== Full Mitigation .... 761 |================================================= Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Unmitigated ........ 1242 |=================================================== Default Mitigation . 1247 |==================================================== Always Flushing .... 1203 |================================================== Full Mitigation .... 1259 |==================================================== Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better Unmitigated ........ 712 |=================================================== Default Mitigation . 737 |===================================================== Always Flushing .... 726 |==================================================== Full Mitigation .... 740 |===================================================== GIMP 2.8.22 Test: unsharp-mask Seconds < Lower Is Better Unmitigated ........ 54.01 |================================================= Default Mitigation . 54.01 |================================================= Always Flushing .... 56.35 |=================================================== Full Mitigation .... 55.82 |=================================================== GIMP 2.8.22 Test: resize Seconds < Lower Is Better Unmitigated ........ 11.61 |================================================= Default Mitigation . 11.25 |=============================================== Always Flushing .... 11.83 |================================================== Full Mitigation .... 12.17 |=================================================== GIMP 2.8.22 Test: rotate Seconds < Lower Is Better Unmitigated ........ 24.11 |================================================= Default Mitigation . 24.20 |================================================= Always Flushing .... 24.77 |================================================== Full Mitigation .... 25.28 |=================================================== GIMP 2.8.22 Test: auto-levels Seconds < Lower Is Better Unmitigated ........ 25.12 |================================================= Default Mitigation . 24.61 |================================================ Always Flushing .... 25.32 |================================================= Full Mitigation .... 26.17 |===================================================