20180118-general-baseline

Benchmark after VM 11, Meltdown and Spectre upgrades.

HTML result view exported from: https://openbenchmarking.org/result/1801193-AL-MERGE216458&grr&sor.

20180118-general-baselineProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem LayerBaselineVM Version 11VM11 + MeltdownVM11 + Meltdown + SpectreMeltdown + SpectreMeltdown4 x Intel Xeon E5-2680 v2 @ 2.80GHz (4 Cores)Intel 440BXIntel 440BX/ZX/DX1 x 4096 MB DRAM107GB Virtual diskVMware SVGA IIVMware VMXNET3Ubuntu 16.044.4.0-31-generic (x86_64)GCC 5.4.0 20160609ext41176x885VMware4.4.0-109-generic (x86_64)4.4.0-111-generic (x86_64)4.4.0-109-generic (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- DEADLINE / data=ordered,errors=remount-ro,relatime,rw

20180118-general-baselineapache: Static Web Page Servingredis: SETredis: GETredis: LPOPpgbench: Buffer Test - Heavy Contention - Read Writepgbench: Buffer Test - Heavy Contention - Read Onlyc-ray: Total Timebuild-linux-kernel: Time To Compilebuild-apache: Time To Compileebizzy: john-the-ripper: Blowfishlzbench: Zstd 1 - Compressionrodinia: OpenMP LavaMDparboil: OpenMP CUTCPnetwork-loopback: Time To Transfer 10GB Via Loopbackfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test DirectoryBaselineVM Version 11VM11 + MeltdownVM11 + Meltdown + SpectreMeltdown + SpectreMeltdown14402.731164228.711508887.111645086.194295.7842755.3841.11215.8041.881001363295253388.4020.1016.07146.68280.29636.4114228.701178050.101536158.421727381.254521.7342384.1940.80211.8141.381001813297253388.5120.1514.11142.49285.13312.1411061.33983957.391184312.231249046.963822.9438186.3741.32242.0446.68999833290252388.9620.1032.38144.20288.89294.4110924.55951810.711175113.421282797.353612.8237104.9541.10243.4748.021001593295252388.9020.1233.87136.46278.24319.599846.94903377.791155302.411211754.633772.6938255.2241.15237.0646.38996913290252388.8620.1535.27132.86280.24300.4810884.74943310.981239681.251270135.103798.2338292.5541.25235.7645.98999663292252389.3720.1435.41171.68280.77293.97OpenBenchmarking.org

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingBaselineVM Version 11VM11 + MeltdownVM11 + Meltdown + SpectreMeltdownMeltdown + Spectre3K6K9K12K15KSE +/- 118.42, N = 3SE +/- 352.64, N = 6SE +/- 265.34, N = 6SE +/- 151.06, N = 5SE +/- 228.93, N = 6SE +/- 158.42, N = 614402.7314228.7011061.3310924.5510884.749846.941. (CC) gcc options: -shared -fPIC -O2 -pthread

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: SETVM Version 11BaselineVM11 + MeltdownVM11 + Meltdown + SpectreMeltdownMeltdown + Spectre300K600K900K1200K1500KSE +/- 22423.85, N = 6SE +/- 17692.64, N = 3SE +/- 3730.38, N = 3SE +/- 12611.50, N = 3SE +/- 15544.43, N = 3SE +/- 14324.13, N = 61178050.101164228.71983957.39951810.71943310.98903377.791. (CC) gcc options: -ggdb -rdynamic -lm -pthread

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: GETVM Version 11BaselineMeltdownVM11 + MeltdownVM11 + Meltdown + SpectreMeltdown + Spectre300K600K900K1200K1500KSE +/- 28846.11, N = 6SE +/- 23079.82, N = 6SE +/- 2707.48, N = 3SE +/- 21827.68, N = 6SE +/- 23499.51, N = 3SE +/- 18854.98, N = 41536158.421508887.111239681.251184312.231175113.421155302.411. (CC) gcc options: -ggdb -rdynamic -lm -pthread

Redis

Test: LPOP

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: LPOPVM Version 11BaselineVM11 + Meltdown + SpectreMeltdownVM11 + MeltdownMeltdown + Spectre400K800K1200K1600K2000KSE +/- 32746.05, N = 3SE +/- 32115.51, N = 6SE +/- 18027.37, N = 6SE +/- 21917.97, N = 4SE +/- 19336.47, N = 3SE +/- 8602.95, N = 31727381.251645086.191282797.351270135.101249046.961211754.631. (CC) gcc options: -ggdb -rdynamic -lm -pthread

PostgreSQL pgbench

Scaling: Buffer Test - Test: Heavy Contention - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.0Scaling: Buffer Test - Test: Heavy Contention - Mode: Read WriteVM Version 11BaselineVM11 + MeltdownMeltdownMeltdown + SpectreVM11 + Meltdown + Spectre10002000300040005000SE +/- 17.56, N = 3SE +/- 30.80, N = 3SE +/- 15.82, N = 3SE +/- 10.00, N = 3SE +/- 35.30, N = 3SE +/- 51.42, N = 34521.734295.783822.943798.233772.693612.821. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgcommon -lpgport -lpthread -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Heavy Contention - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.0Scaling: Buffer Test - Test: Heavy Contention - Mode: Read OnlyBaselineVM Version 11MeltdownMeltdown + SpectreVM11 + MeltdownVM11 + Meltdown + Spectre9K18K27K36K45KSE +/- 163.90, N = 3SE +/- 298.81, N = 3SE +/- 143.89, N = 3SE +/- 58.11, N = 3SE +/- 341.80, N = 3SE +/- 244.57, N = 342755.3842384.1938292.5538255.2238186.3737104.951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgcommon -lpgport -lpthread -lrt -lcrypt -ldl -lm

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeVM Version 11VM11 + Meltdown + SpectreBaselineMeltdown + SpectreMeltdownVM11 + Meltdown918273645SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 340.8041.1041.1141.1541.2541.321. (CC) gcc options: -lm -lpthread -O3

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To CompileVM Version 11BaselineMeltdownMeltdown + SpectreVM11 + MeltdownVM11 + Meltdown + Spectre50100150200250SE +/- 0.92, N = 3SE +/- 1.23, N = 3SE +/- 1.00, N = 3SE +/- 0.73, N = 3SE +/- 1.93, N = 3SE +/- 0.75, N = 3211.81215.80235.76237.06242.04243.47

Timed Apache Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.7Time To CompileVM Version 11BaselineMeltdownMeltdown + SpectreVM11 + MeltdownVM11 + Meltdown + Spectre1122334455SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.35, N = 341.3841.8845.9846.3846.6848.02

ebizzy

OpenBenchmarking.orgRecords/s, More Is Betterebizzy 0.3VM Version 11VM11 + Meltdown + SpectreBaselineVM11 + MeltdownMeltdownMeltdown + Spectre20K40K60K80K100KSE +/- 115.68, N = 3SE +/- 126.86, N = 3SE +/- 38.08, N = 3SE +/- 137.54, N = 3SE +/- 291.20, N = 3SE +/- 337.38, N = 31001811001591001369998399966996911. (CC) gcc options: -pthread -lpthread -O3 -march=native

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishVM Version 11VM11 + Meltdown + SpectreBaselineMeltdownMeltdown + SpectreVM11 + Meltdown7001400210028003500SE +/- 1.67, N = 3SE +/- 2.00, N = 3SE +/- 2.00, N = 3SE +/- 1.86, N = 33297329532953292329032901. (CC) gcc options: -fopenmp -lcrypt

lzbench

Test: Zstd 1 - Process: Decompression

OpenBenchmarking.orgMB/s, More Is Betterlzbench 2017-08-08Test: Zstd 1 - Process: DecompressionMeltdownVM11 + Meltdown + SpectreVM11 + MeltdownVM Version 11BaselineMeltdown + Spectre150300450600750SE +/- 0.33, N = 37127127127127127101. (CXX) g++ options: -lrt -static -lpthread -fomit-frame-pointer -fstrict-aliasing -ffast-math -O3

lzbench

Test: Zstd 1 - Process: Compression

OpenBenchmarking.orgMB/s, More Is Betterlzbench 2017-08-08Test: Zstd 1 - Process: CompressionVM Version 11BaselineMeltdownMeltdown + SpectreVM11 + Meltdown + SpectreVM11 + Meltdown601201802403002532532522522522521. (CXX) g++ options: -lrt -static -lpthread -fomit-frame-pointer -fstrict-aliasing -ffast-math -O3

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LavaMDBaselineVM Version 11Meltdown + SpectreVM11 + Meltdown + SpectreVM11 + MeltdownMeltdown80160240320400SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.47, N = 3SE +/- 0.65, N = 3388.40388.51388.86388.90388.96389.371. (CXX) g++ options: -O2 -lOpenCL

Parboil

Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds, Fewer Is BetterParboil 2.5Test: OpenMP CUTCPBaselineVM11 + MeltdownVM11 + Meltdown + SpectreMeltdownVM Version 11Meltdown + Spectre510152025SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 320.1020.1020.1220.1420.1520.151. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp

Loopback TCP Network Performance

Time To Transfer 10GB Via Loopback

OpenBenchmarking.orgSeconds, Fewer Is BetterLoopback TCP Network PerformanceTime To Transfer 10GB Via LoopbackVM Version 11BaselineVM11 + MeltdownVM11 + Meltdown + SpectreMeltdown + SpectreMeltdown816243240SE +/- 0.14, N = 3SE +/- 0.32, N = 6SE +/- 0.24, N = 3SE +/- 0.54, N = 6SE +/- 0.46, N = 3SE +/- 0.46, N = 314.1116.0732.3833.8735.2735.41

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMeltdownBaselineVM11 + MeltdownVM Version 11VM11 + Meltdown + SpectreMeltdown + Spectre9K18K27K36K45KSE +/- 4365.72, N = 6SE +/- 238.25, N = 3SE +/- 53.58, N = 3SE +/- 477.85, N = 3SE +/- 261.04, N = 3SE +/- 110.94, N = 34291736668360463562034113332121. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryMeltdownBaselineVM11 + MeltdownVM Version 11VM11 + Meltdown + SpectreMeltdown + Spectre4080120160200SE +/- 17.46, N = 6SE +/- 0.95, N = 3SE +/- 0.21, N = 3SE +/- 1.91, N = 3SE +/- 1.04, N = 3SE +/- 0.44, N = 3171.68146.68144.20142.49136.46132.861. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryVM11 + MeltdownVM Version 11MeltdownBaselineMeltdown + SpectreVM11 + Meltdown + Spectre15K30K45K60K75KSE +/- 817.80, N = 3SE +/- 54.00, N = 3SE +/- 214.38, N = 3SE +/- 195.85, N = 3SE +/- 612.26, N = 3SE +/- 407.06, N = 37221971278701887006970055695551. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryVM11 + MeltdownVM Version 11MeltdownBaselineMeltdown + SpectreVM11 + Meltdown + Spectre60120180240300SE +/- 3.27, N = 3SE +/- 0.22, N = 3SE +/- 0.86, N = 3SE +/- 0.78, N = 3SE +/- 2.45, N = 3SE +/- 1.63, N = 3288.89285.13280.77280.29280.24278.241. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBaselineVM11 + Meltdown + SpectreVM Version 11Meltdown + SpectreVM11 + MeltdownMeltdown30K60K90K120K150KSE +/- 2621.72, N = 3SE +/- 3053.09, N = 6SE +/- 1296.81, N = 3SE +/- 897.65, N = 3SE +/- 368.39, N = 3SE +/- 311.58, N = 315909979893780317511673599734881. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBaselineVM11 + Meltdown + SpectreVM Version 11Meltdown + SpectreVM11 + MeltdownMeltdown140280420560700SE +/- 10.49, N = 3SE +/- 12.21, N = 6SE +/- 5.19, N = 3SE +/- 3.59, N = 3SE +/- 1.47, N = 3SE +/- 1.25, N = 3636.41319.59312.14300.48294.41293.971. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.4