Ubuntu 18.04 L1TF Foreshadow VM Testing Tests done from an Ubuntu 18.04 LTS x86_64 dual Xeon Gold 6138 Tyan server (the one frequently used in other Phoronix benchmarks). Host and VM using the Ubuntu packages including its patched 4.15 based kernel. Mitigation levels/tunables done after reboot each time from the bare metal system. VM was lone resource intensive process on the server and configured to access 80% of the host system's CPU resources, Tests by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/1808177-RA-XEONGOLD746&grs&sor .
Ubuntu 18.04 L1TF Foreshadow VM Testing Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution System Layer Unmitigated Default Mitigation Always Flushing Full Mitigation 64 x Intel Xeon (Skylake IBRS) @ 2.00GHz (64 Cores) QEMU Standard PC (i440FX + PIIX 1996) (1.10.2-1ubuntu1 BIOS) Intel 440FX- 82441FX PMC 47104MB 162GB llvmpipe 46848MB QEMU Generic Red Hat Virtio device Ubuntu 18.04 4.15.0-29-generic (x86_64) GNOME Shell 3.28.2 X Server 1.19.6 modesetting 1.19.6 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits) GCC 7.3.0 ext4 1024x768 KVM 4.15.0-32-generic (x86_64) OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-as=/usr/bin/x86_64-linux-gnu-as --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-ld=/usr/bin/x86_64-linux-gnu-ld --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details - NONE / data=ordered,errors=remount-ro,relatime,rw Python Details - Python 2.7.15rc1 + Python 3.6.5 Security Details - Unmitigated: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW Protection - Default Mitigation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection - Always Flushing: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection - Full Mitigation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + PTE Inversion Protection
Ubuntu 18.04 L1TF Foreshadow VM Testing ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping hackbench: 4 - Process hackbench: 4 - Thread apache-siege: 50 ebizzy: hackbench: 16 - Process hackbench: 8 - Process hackbench: 8 - Thread stress-ng: System V Message Passing pgbench: Buffer Test - Normal Load - Read Only hackbench: 16 - Thread sysbench: Memory sysbench: CPU stress-ng: Vector Math stress-ng: Matrix Math stress-ng: Semaphores stress-ng: Context Switching build-linux-kernel: Time To Compile apache: Static Web Page Serving build-llvm: Time To Compile fio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directory gimp: resize stress-ng: Socket Activity gimp: auto-levels pgbench: Buffer Test - Normal Load - Read Write compress-zstd: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 gimp: rotate gimp: unsharp-mask mysqlslap: 8 nginx: Static Web Page Serving openssl: RSA 4096-bit Performance iozone: 1MB - 4GB - Write Performance compilebench: Read Compiled Tree sqlite: Timed SQLite Insertions git: Time To Complete Common Git Commands fio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directory fio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directory fio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directory fio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directory fio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory redis: SET redis: GET redis: LPUSH redis: SADD redis: LPOP sockperf: Latency Under Load sockperf: Latency Ping Pong sockperf: Throughput compilebench: Initial Create compilebench: Compile fio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 660.20 9.49 9.42 14060.58 48618 37.04 20.11 18.87 12135778.98 394876.94 36.97 10438083.96 51572.28 60351.43 168491.90 557628.55 12590168.74 33.85 24525.21 195.49 1972 766 11.61 13880.53 25.12 5152.08 144.83 24.11 54.01 245 27495.41 7915.97 309.22 2234.53 61.99 7.35 712 1242 1095 11367 12100 1463285.46 2026228.33 1297688.50 1878780.17 2068611.85 45.94 7.14 464697 462.67 1402.16 1318 651.56 9.59 9.51 13700.33 44835 36.59 19.81 19.30 12276978.98 387186.23 38.03 10535022.39 51480.55 60406.78 169670.38 599437.06 12482470.05 33.73 24714.34 203.77 2153 830 11.25 13163.12 24.61 5162.44 140.34 24.20 54.01 244 26983.21 7879.13 311.44 2233.48 63.28 7.28 737 1247 1115 11400 11311 1531909.19 1824211.40 1431348.01 1746629.66 1840381.56 46.84 7.80 489081 444.94 1450.63 1444 652.36 10.78 10.58 13502.71 53068 43.53 24.19 21.76 12192475.24 376404.54 43.36 10510051.38 51558.10 60504.84 171874.04 581171.78 12370237.98 33.64 22456.19 199.40 2132 788 11.83 12992.89 25.32 5126.91 145.58 24.77 56.35 237 26388.08 7833.37 314.77 2237.12 62.71 7.27 726 1203 1191 10333 10767 1421644.67 1762582.37 1418073.81 1669834.00 1443664.99 49.14 8.70 468362 451.08 1408.53 1432 206.30 21.91 21.72 8015.48 76020 61.49 31.94 30.39 7914016.08 263895.66 54.12 7267419.40 36587.25 45524.09 136088.10 700793.02 11050870.69 38.00 22023.62 219.11 2044 761 12.17 12833.20 26.17 4859.91 148.09 25.28 55.82 235 26712.57 7607.07 304.39 2178.71 62.49 7.30 740 1259 1180 11033 10533 1501864.62 1789732.77 1405706.45 1625370.68 1397732.79 53.28 6.90 477577 411.13 1360.12 1219 OpenBenchmarking.org
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3b Phong Rendering With Soft-Shadow Mapping Unmitigated Always Flushing Default Mitigation Full Mitigation 140 280 420 560 700 SE +/- 6.92, N = 3 SE +/- 10.57, N = 3 SE +/- 11.07, N = 4 SE +/- 0.31, N = 3 660.20 652.36 651.56 206.30 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -fopenmp -fwhole-program -lstdc++
Hackbench Count: 4 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 4 - Type: Process Unmitigated Default Mitigation Always Flushing Full Mitigation 5 10 15 20 25 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 9.49 9.59 10.78 21.91 1. (CC) gcc options: -lpthread
Hackbench Count: 4 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 4 - Type: Thread Unmitigated Default Mitigation Always Flushing Full Mitigation 5 10 15 20 25 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.32, N = 3 9.42 9.51 10.58 21.72 1. (CC) gcc options: -lpthread
Apache Siege Concurrent Users: 50 OpenBenchmarking.org Transactions Per Second, More Is Better Apache Siege 2.4.29 Concurrent Users: 50 Unmitigated Default Mitigation Always Flushing Full Mitigation 3K 6K 9K 12K 15K 14060.58 13700.33 13502.71 8015.48 1. (CC) gcc options: -O2 -lpthread -ldl -lssl -lcrypto
ebizzy OpenBenchmarking.org Records/s, More Is Better ebizzy 0.3 Full Mitigation Always Flushing Unmitigated Default Mitigation 16K 32K 48K 64K 80K SE +/- 1286.76, N = 4 SE +/- 1018.90, N = 3 SE +/- 429.33, N = 3 SE +/- 404.70, N = 3 76020 53068 48618 44835 1. (CC) gcc options: -pthread -lpthread -O3 -march=native
Hackbench Count: 16 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Process Default Mitigation Unmitigated Always Flushing Full Mitigation 14 28 42 56 70 SE +/- 0.12, N = 3 SE +/- 0.27, N = 3 SE +/- 0.51, N = 3 SE +/- 1.05, N = 3 36.59 37.04 43.53 61.49 1. (CC) gcc options: -lpthread
Hackbench Count: 8 - Type: Process OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 8 - Type: Process Default Mitigation Unmitigated Always Flushing Full Mitigation 7 14 21 28 35 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.37, N = 4 SE +/- 0.22, N = 3 19.81 20.11 24.19 31.94 1. (CC) gcc options: -lpthread
Hackbench Count: 8 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 8 - Type: Thread Unmitigated Default Mitigation Always Flushing Full Mitigation 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 3 SE +/- 0.18, N = 3 18.87 19.30 21.76 30.39 1. (CC) gcc options: -lpthread
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: System V Message Passing Default Mitigation Always Flushing Unmitigated Full Mitigation 3M 6M 9M 12M 15M SE +/- 95795.42, N = 3 SE +/- 113733.08, N = 3 SE +/- 188941.31, N = 3 SE +/- 86447.80, N = 3 12276978.98 12192475.24 12135778.98 7914016.08 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Only Unmitigated Default Mitigation Always Flushing Full Mitigation 80K 160K 240K 320K 400K SE +/- 2565.21, N = 3 SE +/- 2783.33, N = 3 SE +/- 2604.84, N = 3 SE +/- 1013.98, N = 3 394876.94 387186.23 376404.54 263895.66 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Hackbench Count: 16 - Type: Thread OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Thread Unmitigated Default Mitigation Always Flushing Full Mitigation 12 24 36 48 60 SE +/- 0.26, N = 3 SE +/- 0.25, N = 3 SE +/- 0.71, N = 3 SE +/- 0.78, N = 4 36.97 38.03 43.36 54.12 1. (CC) gcc options: -lpthread
Sysbench Test: Memory OpenBenchmarking.org Events Per Second, More Is Better Sysbench 2018-07-28 Test: Memory Default Mitigation Always Flushing Unmitigated Full Mitigation 2M 4M 6M 8M 10M SE +/- 151324.74, N = 3 SE +/- 139686.71, N = 3 SE +/- 73702.36, N = 3 SE +/- 114162.45, N = 3 10535022.39 10510051.38 10438083.96 7267419.40 1. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm
Sysbench Test: CPU OpenBenchmarking.org Events Per Second, More Is Better Sysbench 2018-07-28 Test: CPU Unmitigated Always Flushing Default Mitigation Full Mitigation 11K 22K 33K 44K 55K SE +/- 52.27, N = 3 SE +/- 36.69, N = 3 SE +/- 24.09, N = 3 SE +/- 20.94, N = 3 51572.28 51558.10 51480.55 36587.25 1. (CC) gcc options: -pthread -O3 -funroll-loops -ggdb3 -march=core2 -rdynamic -ldl -laio -lm
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Vector Math Always Flushing Default Mitigation Unmitigated Full Mitigation 13K 26K 39K 52K 65K SE +/- 30.21, N = 3 SE +/- 298.54, N = 3 SE +/- 186.86, N = 3 SE +/- 137.57, N = 3 60504.84 60406.78 60351.43 45524.09 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Matrix Math Always Flushing Default Mitigation Unmitigated Full Mitigation 40K 80K 120K 160K 200K SE +/- 1078.42, N = 3 SE +/- 1660.13, N = 3 SE +/- 2677.89, N = 3 SE +/- 982.93, N = 3 171874.04 169670.38 168491.90 136088.10 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Semaphores Full Mitigation Default Mitigation Always Flushing Unmitigated 150K 300K 450K 600K 750K SE +/- 10838.51, N = 5 SE +/- 6344.60, N = 3 SE +/- 584.43, N = 3 SE +/- 11434.26, N = 6 700793.02 599437.06 581171.78 557628.55 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Context Switching Unmitigated Default Mitigation Always Flushing Full Mitigation 3M 6M 9M 12M 15M SE +/- 177083.84, N = 3 SE +/- 12082.59, N = 3 SE +/- 141287.57, N = 3 SE +/- 155557.89, N = 3 12590168.74 12482470.05 12370237.98 11050870.69 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile Always Flushing Default Mitigation Unmitigated Full Mitigation 9 18 27 36 45 SE +/- 0.37, N = 12 SE +/- 0.53, N = 9 SE +/- 0.81, N = 6 SE +/- 0.45, N = 12 33.64 33.73 33.85 38.00
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.29 Static Web Page Serving Default Mitigation Unmitigated Always Flushing Full Mitigation 5K 10K 15K 20K 25K SE +/- 361.69, N = 9 SE +/- 471.64, N = 3 SE +/- 292.86, N = 7 SE +/- 349.24, N = 12 24714.34 24525.21 22456.19 22023.62 1. (CC) gcc options: -shared -fPIC -O2 -pthread
Timed LLVM Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 6.0.1 Time To Compile Unmitigated Always Flushing Default Mitigation Full Mitigation 50 100 150 200 250 195.49 199.40 203.77 219.11
Flexible IO Tester Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Default Mitigation Always Flushing Full Mitigation Unmitigated 500 1000 1500 2000 2500 SE +/- 34.60, N = 9 SE +/- 31.73, N = 12 SE +/- 4.36, N = 3 SE +/- 38.30, N = 6 2153 2132 2044 1972 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Default Mitigation Always Flushing Unmitigated Full Mitigation 200 400 600 800 1000 SE +/- 8.08, N = 3 SE +/- 10.82, N = 3 SE +/- 11.97, N = 6 SE +/- 9.93, N = 12 830 788 766 761 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
GIMP Test: resize OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: resize Default Mitigation Unmitigated Always Flushing Full Mitigation 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 11.25 11.61 11.83 12.17
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.07.26 Test: Socket Activity Unmitigated Default Mitigation Always Flushing Full Mitigation 3K 6K 9K 12K 15K SE +/- 90.47, N = 3 SE +/- 47.46, N = 3 SE +/- 98.54, N = 3 SE +/- 40.44, N = 3 13880.53 13163.12 12992.89 12833.20 1. (CC) gcc options: -O2 -std=gnu99 -lm -lz -lcrypt -lrt -lpthread -laio -lc
GIMP Test: auto-levels OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: auto-levels Default Mitigation Unmitigated Always Flushing Full Mitigation 6 12 18 24 30 SE +/- 0.29, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 24.61 25.12 25.32 26.17
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 10.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write Default Mitigation Unmitigated Always Flushing Full Mitigation 1100 2200 3300 4400 5500 SE +/- 32.52, N = 3 SE +/- 15.96, N = 3 SE +/- 3.70, N = 3 SE +/- 70.66, N = 3 5162.44 5152.08 5126.91 4859.91 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Zstd Compression Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 OpenBenchmarking.org Seconds, Fewer Is Better Zstd Compression 1.3.4 Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19 Default Mitigation Unmitigated Always Flushing Full Mitigation 30 60 90 120 150 SE +/- 1.05, N = 3 SE +/- 1.55, N = 3 SE +/- 1.23, N = 3 SE +/- 0.47, N = 3 140.34 144.83 145.58 148.09 1. (CC) gcc options: -O3 -pthread -lz -llzma
GIMP Test: rotate OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: rotate Unmitigated Default Mitigation Always Flushing Full Mitigation 6 12 18 24 30 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.19, N = 3 SE +/- 0.34, N = 3 24.11 24.20 24.77 25.28
GIMP Test: unsharp-mask OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.8.22 Test: unsharp-mask Unmitigated Default Mitigation Full Mitigation Always Flushing 13 26 39 52 65 SE +/- 0.35, N = 3 SE +/- 0.34, N = 3 SE +/- 0.49, N = 3 SE +/- 0.28, N = 3 54.01 54.01 55.82 56.35
MariaDB Clients: 8 OpenBenchmarking.org Queries Per Second, More Is Better MariaDB 10.3.8 Clients: 8 Unmitigated Default Mitigation Always Flushing Full Mitigation 50 100 150 200 250 SE +/- 1.89, N = 3 SE +/- 5.43, N = 3 SE +/- 1.95, N = 3 SE +/- 0.82, N = 3 245 244 237 235 1. (CXX) g++ options: -pie -fPIC -fstack-protector -fno-rtti -O2 -lpthread -llzma -laio -lz -lm -lpcre -lcrypt -lssl -lcrypto -ldl
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving Unmitigated Default Mitigation Full Mitigation Always Flushing 6K 12K 18K 24K 30K SE +/- 248.68, N = 3 SE +/- 200.40, N = 3 SE +/- 90.18, N = 3 SE +/- 411.39, N = 5 27495.41 26983.21 26712.57 26388.08 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance Unmitigated Default Mitigation Always Flushing Full Mitigation 2K 4K 6K 8K 10K SE +/- 14.57, N = 3 SE +/- 32.73, N = 3 SE +/- 31.06, N = 3 SE +/- 79.42, N = 3 7915.97 7879.13 7833.37 7607.07 1. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance Always Flushing Default Mitigation Unmitigated Full Mitigation 70 140 210 280 350 SE +/- 1.21, N = 3 SE +/- 1.19, N = 3 SE +/- 4.67, N = 3 SE +/- 4.45, N = 3 314.77 311.44 309.22 304.39 1. (CC) gcc options: -O3
Compile Bench Test: Read Compiled Tree OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Read Compiled Tree Always Flushing Unmitigated Default Mitigation Full Mitigation 500 1000 1500 2000 2500 SE +/- 21.33, N = 3 SE +/- 8.33, N = 3 SE +/- 40.11, N = 3 SE +/- 33.25, N = 3 2237.12 2234.53 2233.48 2178.71
SQLite Timed SQLite Insertions OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.22 Timed SQLite Insertions Unmitigated Full Mitigation Always Flushing Default Mitigation 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.46, N = 3 SE +/- 1.01, N = 3 SE +/- 0.78, N = 3 61.99 62.49 62.71 63.28 1. (CC) gcc options: -O2 -lz -ldl -lpthread
Git Time To Complete Common Git Commands OpenBenchmarking.org Seconds, Fewer Is Better Git Time To Complete Common Git Commands Always Flushing Default Mitigation Full Mitigation Unmitigated 2 4 6 8 10 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 7.27 7.28 7.30 7.35 1. git version 2.17.1
Flexible IO Tester Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Full Mitigation Default Mitigation Always Flushing Unmitigated 160 320 480 640 800 SE +/- 8.57, N = 12 SE +/- 20.23, N = 9 SE +/- 12.34, N = 3 SE +/- 11.85, N = 3 740 737 726 712 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Full Mitigation Default Mitigation Unmitigated Always Flushing 300 600 900 1200 1500 SE +/- 19.30, N = 12 SE +/- 35.68, N = 9 SE +/- 11.57, N = 3 SE +/- 25.02, N = 12 1259 1247 1242 1203 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Always Flushing Full Mitigation Default Mitigation Unmitigated 300 600 900 1200 1500 SE +/- 5.55, N = 3 SE +/- 27.55, N = 12 SE +/- 17.38, N = 3 SE +/- 8.37, N = 3 1191 1180 1115 1095 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.1 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Default Mitigation Unmitigated Full Mitigation Always Flushing 2K 4K 6K 8K 10K SE +/- 303.68, N = 9 SE +/- 176.38, N = 3 SE +/- 133.33, N = 3 SE +/- 145.30, N = 3 11400 11367 11033 10333 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Flexible IO Tester Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.1 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Unmitigated Default Mitigation Always Flushing Full Mitigation 3K 6K 9K 12K 15K SE +/- 272.03, N = 6 SE +/- 246.33, N = 9 SE +/- 33.33, N = 3 SE +/- 133.33, N = 3 12100 11311 10767 10533 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Redis Test: SET OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: SET Default Mitigation Full Mitigation Unmitigated Always Flushing 300K 600K 900K 1200K 1500K SE +/- 60083.85, N = 9 SE +/- 37254.96, N = 12 SE +/- 88955.87, N = 6 SE +/- 55957.00, N = 12 1531909.19 1501864.62 1463285.46 1421644.67 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: GET OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: GET Unmitigated Default Mitigation Full Mitigation Always Flushing 400K 800K 1200K 1600K 2000K SE +/- 87966.15, N = 6 SE +/- 92589.67, N = 9 SE +/- 48565.17, N = 12 SE +/- 72106.90, N = 12 2026228.33 1824211.40 1789732.77 1762582.37 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: LPUSH OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: LPUSH Default Mitigation Always Flushing Full Mitigation Unmitigated 300K 600K 900K 1200K 1500K SE +/- 39118.19, N = 9 SE +/- 53016.95, N = 12 SE +/- 41599.43, N = 12 SE +/- 20709.64, N = 3 1431348.01 1418073.81 1405706.45 1297688.50 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: SADD OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: SADD Unmitigated Default Mitigation Always Flushing Full Mitigation 400K 800K 1200K 1600K 2000K SE +/- 85165.61, N = 6 SE +/- 69330.61, N = 9 SE +/- 61306.24, N = 12 SE +/- 49376.90, N = 12 1878780.17 1746629.66 1669834.00 1625370.68 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Redis Test: LPOP OpenBenchmarking.org Requests Per Second, More Is Better Redis 4.0.8 Test: LPOP Unmitigated Default Mitigation Always Flushing Full Mitigation 400K 800K 1200K 1600K 2000K SE +/- 137342.99, N = 6 SE +/- 101684.52, N = 12 SE +/- 53543.04, N = 10 SE +/- 35832.53, N = 12 2068611.85 1840381.56 1443664.99 1397732.79 1. (CC) gcc options: -ggdb -rdynamic -lm -ldl -pthread
Sockperf Test: Latency Under Load OpenBenchmarking.org usec, Fewer Is Better Sockperf 3.4 Test: Latency Under Load Unmitigated Default Mitigation Always Flushing Full Mitigation 12 24 36 48 60 SE +/- 3.40, N = 10 SE +/- 4.68, N = 15 SE +/- 4.00, N = 20 SE +/- 3.21, N = 16 45.94 46.84 49.14 53.28 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
Sockperf Test: Latency Ping Pong OpenBenchmarking.org usec, Fewer Is Better Sockperf 3.4 Test: Latency Ping Pong Full Mitigation Unmitigated Default Mitigation Always Flushing 2 4 6 8 10 SE +/- 0.63, N = 15 SE +/- 0.59, N = 10 SE +/- 0.34, N = 15 SE +/- 0.37, N = 20 6.90 7.14 7.80 8.70 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
Sockperf Test: Throughput OpenBenchmarking.org Messages Per Second, More Is Better Sockperf 3.4 Test: Throughput Default Mitigation Full Mitigation Always Flushing Unmitigated 100K 200K 300K 400K 500K SE +/- 10160.93, N = 20 SE +/- 15206.71, N = 20 SE +/- 15140.22, N = 15 SE +/- 22194.18, N = 10 489081 477577 468362 464697 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create Unmitigated Always Flushing Default Mitigation Full Mitigation 100 200 300 400 500 SE +/- 5.89, N = 3 SE +/- 10.50, N = 3 SE +/- 1.76, N = 3 SE +/- 17.84, N = 3 462.67 451.08 444.94 411.13
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile Default Mitigation Always Flushing Unmitigated Full Mitigation 300 600 900 1200 1500 SE +/- 23.36, N = 4 SE +/- 24.42, N = 3 SE +/- 36.69, N = 6 SE +/- 26.60, N = 3 1450.63 1408.53 1402.16 1360.12
Flexible IO Tester Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.1 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory Default Mitigation Always Flushing Unmitigated Full Mitigation 300 600 900 1200 1500 SE +/- 75.95, N = 9 SE +/- 57.61, N = 9 SE +/- 53.63, N = 6 SE +/- 11.29, N = 3 1444 1432 1318 1219 1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrt -laio -lz -lm -lpthread -ldl
Phoronix Test Suite v10.8.4