Ubuntu 18.04 L1TF Foreshadow VM Testing Tests done from an Ubuntu 18.04 LTS x86_64 dual Xeon Gold 6138 Tyan server (the one frequently used in other Phoronix benchmarks). Host and VM using the Ubuntu packages including its patched 4.15 based kernel. Mitigation levels/tunables done after reboot each time from the bare metal system. VM was lone resource intensive process on the server and configured to access 80% of the host system's CPU resources, Tests by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/1808177-RA-XEONGOLD746 .
Ubuntu 18.04 L1TF Foreshadow VM Testing Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution System Layer Unmitigated Default Mitigation Always Flushing Full Mitigation 64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores) QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS) Intel 440FX- 82441FX PMC 47104MB 162GB llvmpipe 46848MB QEMU Generic Red Hat Virtio device Ubuntu 18.04 4.15.0-29-generic (x86_64) GNOME Shell 3.28.2 X Server 1.19.6 modesetting 1.19.6 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits) GCC 7.3.0 ext4 1024x768 KVM 4.15.0-32-generic (x86_64) OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details - NONE / data=ordered,errors=remount-ro,relatime,rw Python Details - Python 2.7.15rc1 + Python 3.6.5 Security Details - Unmitigated: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW Protection - Default Mitigation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection - Always Flushing: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection - Full Mitigation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection
Ubuntu 18.04 L1TF Foreshadow VM Testing sqlite: Timed SQLite Insertions fio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directory iozone: 1MB - 4GB - Write Performance compilebench: Compile compilebench: Initial Create compilebench: Read Compiled Tree sockperf: Throughput sockperf: Latency Ping Pong sockperf: Latency Under Load ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping ebizzy: build-linux-kernel: Time To Compile build-llvm: Time To Compile compress-zstd: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 hackbench: 4 - Thread hackbench: 8 - Thread hackbench: 16 - Thread hackbench: 4 - Process hackbench: 8 - Process hackbench: 16 - Process openssl: RSA 4096-bit Performance mysqlslap: 8 pgbench: Buffer Test - Normal Load - Read Only pgbench: Buffer Test - Normal Load - Read Write redis: LPOP redis: SADD redis: LPUSH redis: GET redis: SET stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Vector Math stress-ng: Socket Activity stress-ng: Context Switching stress-ng: System V Message Passing sysbench: Memory sysbench: CPU nginx: Static Web Page Serving apache: Static Web Page Serving apache-siege: 50 git: Time To Complete Common Git Commands fio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directory fio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directory gimp: unsharp-mask gimp: resize gimp: rotate gimp: auto-levels Unmitigated Default Mitigation Always Flushing Full Mitigation 61.99 1972 1318 309.22 1402.16 462.67 2234.53 464697 7.14 45.94 660.20 48618 33.85 195.49 144.83 9.42 18.87 36.97 9.49 20.11 37.04 7915.97 245 394876.94 5152.08 2068611.85 1878780.17 1297688.50 2026228.33 1463285.46 557628.55 168491.90 60351.43 13880.53 12590168.74 12135778.98 10438083.96 51572.28 27495.41 24525.21 14060.58 7.35 12100 11367 1095 766 1242 712 54.01 11.61 24.11 25.12 63.28 2153 1444 311.44 1450.63 444.94 2233.48 489081 7.80 46.84 651.56 44835 33.73 203.77 140.34 9.51 19.30 38.03 9.59 19.81 36.59 7879.13 244 387186.23 5162.44 1840381.56 1746629.66 1431348.01 1824211.40 1531909.19 599437.06 169670.38 60406.78 13163.12 12482470.05 12276978.98 10535022.39 51480.55 26983.21 24714.34 13700.33 7.28 11311 11400 1115 830 1247 737 54.01 11.25 24.20 24.61 62.71 2132 1432 314.77 1408.53 451.08 2237.12 468362 8.70 49.14 652.36 53068 33.64 199.40 145.58 10.58 21.76 43.36 10.78 24.19 43.53 7833.37 237 376404.54 5126.91 1443664.99 1669834.00 1418073.81 1762582.37 1421644.67 581171.78 171874.04 60504.84 12992.89 12370237.98 12192475.24 10510051.38 51558.10 26388.08 22456.19 13502.71 7.27 10767 10333 1191 788 1203 726 56.35 11.83 24.77 25.32 62.49 2044 1219 304.39 1360.12 411.13 2178.71 477577 6.90 53.28 206.30 76020 38.00 219.11 148.09 21.72 30.39 54.12 21.91 31.94 61.49 7607.07 235 263895.66 4859.91 1397732.79 1625370.68 1405706.45 1789732.77 1501864.62 700793.02 136088.10 45524.09 12833.20 11050870.69 7914016.08 7267419.40 36587.25 26712.57 22023.62 8015.48 7.30 10533 11033 1180 761 1259 740 55.82 12.17 25.28 26.17 OpenBenchmarking.org
SQLite Timed SQLite Insertions OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.22 Timed SQLite Insertions Unmitigated Default Mitigation Always Flushing Full Mitigation 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.78, N = 3 SE +/- 1.01, N = 3 SE +/- 0.46, N = 3 61.99 63.28 62.71 62.49 1. (CC) gcc options: -O2 -lz -ldl -lpthread
Flexible IO Tester Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 500 1000 1500 2000 2500 SE +/- 38.30, N = 6 SE +/- 34.60, N = 9 SE +/- 31.73, N = 12 SE +/- 4.36, N = 3 1972 2153 2132 2044 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 300 600 900 1200 1500 SE +/- 53.63, N = 6 SE +/- 75.95, N = 9 SE +/- 57.61, N = 9 SE +/- 11.29, N = 3 1318 1444 1432 1219 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance Unmitigated Default Mitigation Always Flushing Full Mitigation 70 140 210 280 350 SE +/- 4.67, N = 3 SE +/- 1.19, N = 3 SE +/- 1.21, N = 3 SE +/- 4.45, N = 3 309.22 311.44 314.77 304.39 1. (CC) gcc options: -O3
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile Unmitigated Default Mitigation Always Flushing Full Mitigation 300 600 900 1200 1500 SE +/- 36.69, N = 6 SE +/- 23.36, N = 4 SE +/- 24.42, N = 3 SE +/- 26.60, N = 3 1402.16 1450.63 1408.53 1360.12
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create Unmitigated Default Mitigation Always Flushing Full Mitigation 100 200 300 400 500 SE +/- 5.89, N = 3 SE +/- 1.76, N = 3 SE +/- 10.50, N = 3 SE +/- 17.84, N = 3 462.67 444.94 451.08 411.13
Compile Bench Test: Read Compiled Tree OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Read Compiled Tree Unmitigated Default Mitigation Always Flushing Full Mitigation 500 1000 1500 2000 2500 SE +/- 8.33, N = 3 SE +/- 40.11, N = 3 SE +/- 21.33, N = 3 SE +/- 33.25, N = 3 2234.53 2233.48 2237.12 2178.71
Sockperf Test: Throughput OpenBenchmarking.org Messages Per Second, More Is Better Sockperf 3.4 Test: Throughput Unmitigated Default Mitigation Always Flushing Full Mitigation 100K 200K 300K 400K 500K SE +/- 22194.18, N = 10 SE +/- 10160.93, N = 20 SE +/- 15140.22, N = 15 SE +/- 15206.71, N = 20 464697 489081 468362 477577 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
Sockperf Test: Latency Ping Pong OpenBenchmarking.org usec, Fewer Is Better Sockperf 3.4 Test: Latency Ping Pong Unmitigated Default Mitigation Always Flushing Full Mitigation 2 4 6 8 10 SE +/- 0.59, N = 10 SE +/- 0.34, N = 15 SE +/- 0.37, N = 20 SE +/- 0.63, N = 15 7.14 7.80 8.70 6.90 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
Sockperf Test: Latency Under Load OpenBenchmarking.org usec, Fewer Is Better Sockperf 3.4 Test: Latency Under Load Unmitigated Default Mitigation Always Flushing Full Mitigation 12 24 36 48 60 SE +/- 3.40, N = 10 SE +/- 4.68, N = 15 SE +/- 4.00, N = 20 SE +/- 3.21, N = 16 45.94 46.84 49.14 53.28 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3b Phong Rendering With Soft-Shadow Mapping Unmitigated Default Mitigation Always Flushing Full Mitigation 140 280 420 560 700 SE +/- 6.92, N = 3 SE +/- 11.07, N = 4 SE +/- 10.57, N = 3 SE +/- 0.31, N = 3 660.20 651.56 652.36 206.30 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -fopenmp -fwhole-program -lstdc++
ebizzy OpenBenchmarking.org Records/s, More Is Better ebizzy 0.3 Unmitigated Default Mitigation Always Flushing Full Mitigation 16K 32K 48K 64K 80K SE +/- 429.33, N = 3 SE +/- 404.70, N = 3 SE +/- 1018.90, N = 3 SE +/- 1286.76, N = 4 48618 44835 53068 76020 1. (CC) gcc options: -pthread -lpthread -O3 -march=native
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile Unmitigated Default Mitigation Always Flushing Full Mitigation 9 18 27 36 45 SE +/- 0.81, N = 6 SE +/- 0.53, N = 9 SE +/- 0.37, N = 12 SE +/- 0.45, N = 12 33.85 33.73 33.64 38.00
Timed LLVM Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 6.0.1 Time To Compile Unmitigated Default Mitigation Always Flushing Full Mitigation 50 100 150 200 250 195.49 203.77 199.40 219.11
Zstd Compression Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 OpenBenchmarking.org Seconds, Fewer Is Better Zstd Compression 1.3.4 Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 Unmitigated Default Mitigation Always Flushing Full Mitigation 30 60 90 120 150 SE +/- 1.55, N = 3 SE +/- 1.05, N = 3 SE +/- 1.23, N = 3 SE +/- 0.47, N = 3 144.83 140.34 145.58 148.09 1. (CC) gcc options: -O3 -pthread -lz -llzma
Hackbench Count: 4 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 4 - Type: Thread Unmitigated Default Mitigation Always Flushing Full Mitigation 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.32, N = 3 9.42 9.51 10.58 21.72 1. (CC) gcc options: -lpthread
Hackbench Count: 8 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 8 - Type: Thread Unmitigated Default Mitigation Always Flushing Full Mitigation 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 18.87 19.30 21.76 30.39 1. (CC) gcc options: -lpthread
Hackbench Count: 16 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Thread Unmitigated Default Mitigation Always Flushing Full Mitigation 12 24 36 48 60 SE +/- 0.26, N = 3 SE +/- 0.25, N = 3 SE +/- 0.71, N = 3 SE +/- 0.78, N = 4 36.97 38.03 43.36 54.12 1. (CC) gcc options: -lpthread
Hackbench Count: 4 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 4 - Type: Process Unmitigated Default Mitigation Always Flushing Full Mitigation 5 10 15 20 25 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 9.49 9.59 10.78 21.91 1. (CC) gcc options: -lpthread
Hackbench Count: 8 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 8 - Type: Process Unmitigated Default Mitigation Always Flushing Full Mitigation 7 14 21 28 35 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.37, N = 4 SE +/- 0.22, N = 3 20.11 19.81 24.19 31.94 1. (CC) gcc options: -lpthread
Hackbench Count: 16 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Process Unmitigated Default Mitigation Always Flushing Full Mitigation 14 28 42 56 70 SE +/- 0.27, N = 3 SE +/- 0.12, N = 3 SE +/- 0.51, N = 3 SE +/- 1.05, N = 3 37.04 36.59 43.53 61.49 1. (CC) gcc options: -lpthread
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance Unmitigated Default Mitigation Always Flushing Full Mitigation 2K 4K 6K 8K 10K SE +/- 14.57, N = 3 SE +/- 32.73, N = 3 SE +/- 31.06, N = 3 SE +/- 79.42, N = 3 7915.97 7879.13 7833.37 7607.07 1. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
MariaDB Clients: 8 OpenBenchmarking.org Queries Per Second, More Is Better MariaDB 10.3.8 Clients: 8 Unmitigated Default Mitigation Always Flushing Full Mitigation 50 100 150 200 250 SE +/- 1.89, N = 3 SE +/- 5.43, N = 3 SE +/- 1.95, N = 3 SE +/- 0.82, N = 3 245 244 237 235 1. (CXX) g++ options: -pie -fPIC -fstack-protector -fno-rtti -O2 -lpthread -llzma -laio -lz -lm -lpcre -lcrypt -lssl -lcrypto -ldl
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Only Unmitigated Default Mitigation Always Flushing Full Mitigation 80K 160K 240K 320K 400K SE +/- 2565.21, N = 3 SE +/- 2783.33, N = 3 SE +/- 2604.84, N = 3 SE +/- 1013.98, N = 3 394876.94 387186.23 376404.54 263895.66 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write Unmitigated Default Mitigation Always Flushing Full Mitigation 1100 2200 3300 4400 5500 SE +/- 15.96, N = 3 SE +/- 32.52, N = 3 SE +/- 3.70, N = 3 SE +/- 70.66, N = 3 5152.08 5162.44 5126.91 4859.91 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Redis Test: LPOP OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: LPOP Unmitigated Default Mitigation Always Flushing Full Mitigation 400K 800K 1200K 1600K 2000K SE +/- 137342.99, N = 6 SE +/- 101684.52, N = 12 SE +/- 53543.04, N = 10 SE +/- 35832.53, N = 12 2068611.85 1840381.56 1443664.99 1397732.79 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: SADD OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: SADD Unmitigated Default Mitigation Always Flushing Full Mitigation 400K 800K 1200K 1600K 2000K SE +/- 85165.61, N = 6 SE +/- 69330.61, N = 9 SE +/- 61306.24, N = 12 SE +/- 49376.90, N = 12 1878780.17 1746629.66 1669834.00 1625370.68 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: LPUSH OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: LPUSH Unmitigated Default Mitigation Always Flushing Full Mitigation 300K 600K 900K 1200K 1500K SE +/- 20709.64, N = 3 SE +/- 39118.19, N = 9 SE +/- 53016.95, N = 12 SE +/- 41599.43, N = 12 1297688.50 1431348.01 1418073.81 1405706.45 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: GET OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: GET Unmitigated Default Mitigation Always Flushing Full Mitigation 400K 800K 1200K 1600K 2000K SE +/- 87966.15, N = 6 SE +/- 92589.67, N = 9 SE +/- 72106.90, N = 12 SE +/- 48565.17, N = 12 2026228.33 1824211.40 1762582.37 1789732.77 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: SET OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: SET Unmitigated Default Mitigation Always Flushing Full Mitigation 300K 600K 900K 1200K 1500K SE +/- 88955.87, N = 6 SE +/- 60083.85, N = 9 SE +/- 55957.00, N = 12 SE +/- 37254.96, N = 12 1463285.46 1531909.19 1421644.67 1501864.62 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Semaphores Unmitigated Default Mitigation Always Flushing Full Mitigation 150K 300K 450K 600K 750K SE +/- 11434.26, N = 6 SE +/- 6344.60, N = 3 SE +/- 584.43, N = 3 SE +/- 10838.51, N = 5 557628.55 599437.06 581171.78 700793.02 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Matrix Math Unmitigated Default Mitigation Always Flushing Full Mitigation 40K 80K 120K 160K 200K SE +/- 2677.89, N = 3 SE +/- 1660.13, N = 3 SE +/- 1078.42, N = 3 SE +/- 982.93, N = 3 168491.90 169670.38 171874.04 136088.10 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Vector Math Unmitigated Default Mitigation Always Flushing Full Mitigation 13K 26K 39K 52K 65K SE +/- 186.86, N = 3 SE +/- 298.54, N = 3 SE +/- 30.21, N = 3 SE +/- 137.57, N = 3 60351.43 60406.78 60504.84 45524.09 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Socket Activity Unmitigated Default Mitigation Always Flushing Full Mitigation 3K 6K 9K 12K 15K SE +/- 90.47, N = 3 SE +/- 47.46, N = 3 SE +/- 98.54, N = 3 SE +/- 40.44, N = 3 13880.53 13163.12 12992.89 12833.20 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Context Switching Unmitigated Default Mitigation Always Flushing Full Mitigation 3M 6M 9M 12M 15M SE +/- 177083.84, N = 3 SE +/- 12082.59, N = 3 SE +/- 141287.57, N = 3 SE +/- 155557.89, N = 3 12590168.74 12482470.05 12370237.98 11050870.69 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: System V Message Passing Unmitigated Default Mitigation Always Flushing Full Mitigation 3M 6M 9M 12M 15M SE +/- 188941.31, N = 3 SE +/- 95795.42, N = 3 SE +/- 113733.08, N = 3 SE +/- 86447.80, N = 3 12135778.98 12276978.98 12192475.24 7914016.08 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Sysbench Test: Memory OpenBenchmarking.org Events Per Second, More Is Better Sysbench 2018-07-28 Test: Memory Unmitigated Default Mitigation Always Flushing Full Mitigation 2M 4M 6M 8M 10M SE +/- 73702.36, N = 3 SE +/- 151324.74, N = 3 SE +/- 139686.71, N = 3 SE +/- 114162.45, N = 3 10438083.96 10535022.39 10510051.38 7267419.40 1. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm
Sysbench Test: CPU OpenBenchmarking.org Events Per Second, More Is Better Sysbench 2018-07-28 Test: CPU Unmitigated Default Mitigation Always Flushing Full Mitigation 11K 22K 33K 44K 55K SE +/- 52.27, N = 3 SE +/- 24.09, N = 3 SE +/- 36.69, N = 3 SE +/- 20.94, N = 3 51572.28 51480.55 51558.10 36587.25 1. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving Unmitigated Default Mitigation Always Flushing Full Mitigation 6K 12K 18K 24K 30K SE +/- 248.68, N = 3 SE +/- 200.40, N = 3 SE +/- 411.39, N = 5 SE +/- 90.18, N = 3 27495.41 26983.21 26388.08 26712.57 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.29 Static Web Page Serving Unmitigated Default Mitigation Always Flushing Full Mitigation 5K 10K 15K 20K 25K SE +/- 471.64, N = 3 SE +/- 361.69, N = 9 SE +/- 292.86, N = 7 SE +/- 349.24, N = 12 24525.21 24714.34 22456.19 22023.62 1. (CC) gcc options: -shared -fPIC -O2 -pthread
Apache Siege Concurrent Users: 50 OpenBenchmarking.org Transactions Per Second, More Is Better Apache Siege 2.4.29 Concurrent Users: 50 Unmitigated Default Mitigation Always Flushing Full Mitigation 3K 6K 9K 12K 15K 14060.58 13700.33 13502.71 8015.48 1. (CC) gcc options: -O2 -lpthread -ldl -lssl -lcrypto
Git Time To Complete Common Git Commands OpenBenchmarking.org Seconds, Fewer Is Better Git Time To Complete Common Git Commands Unmitigated Default Mitigation Always Flushing Full Mitigation 2 4 6 8 10 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 7.35 7.28 7.27 7.30 1. git version 2.17.1
Flexible IO Tester Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 3K 6K 9K 12K 15K SE +/- 272.03, N = 6 SE +/- 246.33, N = 9 SE +/- 33.33, N = 3 SE +/- 133.33, N = 3 12100 11311 10767 10533 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 2K 4K 6K 8K 10K SE +/- 176.38, N = 3 SE +/- 303.68, N = 9 SE +/- 145.30, N = 3 SE +/- 133.33, N = 3 11367 11400 10333 11033 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 300 600 900 1200 1500 SE +/- 8.37, N = 3 SE +/- 17.38, N = 3 SE +/- 5.55, N = 3 SE +/- 27.55, N = 12 1095 1115 1191 1180 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 200 400 600 800 1000 SE +/- 11.97, N = 6 SE +/- 8.08, N = 3 SE +/- 10.82, N = 3 SE +/- 9.93, N = 12 766 830 788 761 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 300 600 900 1200 1500 SE +/- 11.57, N = 3 SE +/- 35.68, N = 9 SE +/- 25.02, N = 12 SE +/- 19.30, N = 12 1242 1247 1203 1259 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 160 320 480 640 800 SE +/- 11.85, N = 3 SE +/- 20.23, N = 9 SE +/- 12.34, N = 3 SE +/- 8.57, N = 12 712 737 726 740 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
GIMP Test: unsharp-mask OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: unsharp-mask Unmitigated Default Mitigation Always Flushing Full Mitigation 13 26 39 52 65 SE +/- 0.35, N = 3 SE +/- 0.34, N = 3 SE +/- 0.28, N = 3 SE +/- 0.49, N = 3 54.01 54.01 56.35 55.82
GIMP Test: resize OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: resize Unmitigated Default Mitigation Always Flushing Full Mitigation 3 6 9 12 15 SE +/- 0.23, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 11.61 11.25 11.83 12.17
GIMP Test: rotate OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: rotate Unmitigated Default Mitigation Always Flushing Full Mitigation 6 12 18 24 30 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.34, N = 3 24.11 24.20 24.77 25.28
GIMP Test: auto-levels OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: auto-levels Unmitigated Default Mitigation Always Flushing Full Mitigation 6 12 18 24 30 SE +/- 0.24, N = 3 SE +/- 0.29, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 25.12 24.61 25.32 26.17
Phoronix Test Suite v10.8.4