Selenium Browser Spectre Meltdown

Intel Core i7-8086K testing with a ASUS PRIME Z370-A (1802 BIOS) and Intel UHD 630 3GB on Ubuntu 18.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1903264-SYST-SELENIU34
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
No Mitigations
March 25 2019
  2 Hours, 34 Minutes
No Mitigations + No Site Isolation
March 25 2019
  1 Hour, 50 Minutes
Default Mitigations
March 25 2019
  1 Hour, 51 Minutes
Default Mitigations + No Site Isolation
March 25 2019
  2 Hours, 35 Minutes
Invert Hiding All Results Option
  2 Hours, 12 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

No Mitigations

Processor Notes: Scaling Governor: intel_pstate powersave
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + PTE Inversion

No Mitigations + No Site Isolation

Default Mitigations

Processor Notes: Scaling Governor: intel_pstate powersave
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion

Default Mitigations + No Site Isolation

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1802 BIOS), Chipset: Intel 8th Gen Core, Memory: 8192MB, Disk: 118GB INTEL SSDPEK1W120GA, Graphics: Intel UHD 630 3GB (1200MHz), Audio: Realtek ALC1220, Monitor: DELL P2415Q, Network: Intel I219-V

OS: Ubuntu 18.10, Kernel: 4.18.0-16-generic (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server 1.20.1, Display Driver: modesetting 1.20.1, OpenGL: 4.5 Mesa 18.2.2, Vulkan: 1.1.80, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160

Selenium Browser Spectre MeltdownOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads)ASUS PRIME Z370-A (1802 BIOS)Intel 8th Gen Core8192MB118GB INTEL SSDPEK1W120GAIntel UHD 630 3GB (1200MHz)Realtek ALC1220DELL P2415QIntel I219-VUbuntu 18.104.18.0-16-generic (x86_64)GNOME Shell 3.30.2X Server 1.20.1modesetting 1.20.14.5 Mesa 18.2.21.1.80GCC 8.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionSelenium Browser Spectre Meltdown BenchmarksSystem Logs- Scaling Governor: intel_pstate powersave- Python 2.7.15+ + Python 3.6.7- No Mitigations: __user pointer sanitization + PTE Inversion- No Mitigations + No Site Isolation: __user pointer sanitization + PTE Inversion - Default Mitigations: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion - Default Mitigations + No Site Isolation: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion

No MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site IsolationResult OverviewPhoronix Test Suite100%111%123%134%146%SeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumARES-6 - Google ChromeOctane - Google ChromeJetstream - Google ChromeSpeedometer - Google ChromeWebXPRT - Google ChromeBasemark - Google ChromeCanvasMark - Google ChromeMotionMark - Google Chrome

Selenium Browser Spectre Meltdownselenium: ARES-6 - Google Chromeselenium: Octane - Google Chromeselenium: WebXPRT - Google Chromeselenium: Basemark - Google Chromeselenium: Jetstream - Google Chromeselenium: CanvasMark - Google Chromeselenium: MotionMark - Google Chromeselenium: Speedometer - Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation16.18601802726652765056113417.58528692396542725049113323.54438562156032055056110623.434385721556820650381105OpenBenchmarking.org

Selenium

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation612182430SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.20, N = 316.1817.5823.5423.431. chrome 73.0.3683.75
OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation510152025Min: 16.01 / Avg: 16.18 / Max: 16.46Min: 17.34 / Avg: 17.58 / Max: 17.79Min: 23.27 / Avg: 23.54 / Max: 23.88Min: 23.03 / Avg: 23.43 / Max: 23.71. chrome 73.0.3683.75

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation13K26K39K52K65KSE +/- 111.84, N = 3SE +/- 180.24, N = 3SE +/- 239.61, N = 3SE +/- 260.45, N = 3601805286943856438571. chrome 73.0.3683.75
OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation10K20K30K40K50KMin: 59956 / Avg: 60179.67 / Max: 60294Min: 52617 / Avg: 52868.67 / Max: 53218Min: 43406 / Avg: 43855.67 / Max: 44224Min: 43338 / Avg: 43857 / Max: 441551. chrome 73.0.3683.75

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: WebXPRT - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation60120180240300SE +/- 0.58, N = 3SE +/- 0.88, N = 32722392152151. chrome 73.0.3683.75
OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: WebXPRT - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation50100150200250Min: 214 / Avg: 215 / Max: 216Min: 214 / Avg: 215.33 / Max: 2171. chrome 73.0.3683.75

OpenBenchmarking.orgOverall Score, More Is BetterSeleniumBenchmark: Basemark - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation140280420560700SE +/- 26.56, N = 9SE +/- 3.94, N = 3SE +/- 4.73, N = 3SE +/- 14.39, N = 96656546035681. chrome 73.0.3683.75
OpenBenchmarking.orgOverall Score, More Is BetterSeleniumBenchmark: Basemark - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation120240360480600Min: 560.03 / Avg: 665.09 / Max: 789.13Min: 646.9 / Avg: 654.17 / Max: 660.43Min: 594.46 / Avg: 602.69 / Max: 610.84Min: 493.03 / Avg: 568.05 / Max: 617.191. chrome 73.0.3683.75

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation60120180240300SE +/- 1.04, N = 3SE +/- 1.24, N = 3SE +/- 0.55, N = 3SE +/- 0.28, N = 32762722052061. chrome 73.0.3683.75
OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation50100150200250Min: 274.44 / Avg: 276.31 / Max: 278.03Min: 269.21 / Avg: 271.65 / Max: 273.23Min: 204.68 / Avg: 205.27 / Max: 206.37Min: 205.09 / Avg: 205.64 / Max: 205.981. chrome 73.0.3683.75

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: CanvasMark - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation11002200330044005500SE +/- 8.82, N = 3SE +/- 22.94, N = 3SE +/- 7.37, N = 3SE +/- 8.96, N = 350565049505650381. chrome 73.0.3683.75
OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: CanvasMark - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation9001800270036004500Min: 5043 / Avg: 5056.33 / Max: 5073Min: 5012 / Avg: 5049 / Max: 5091Min: 5045 / Avg: 5056 / Max: 5070Min: 5023 / Avg: 5038 / Max: 50541. chrome 73.0.3683.75

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: MotionMark - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation0.2250.450.6750.91.12511111. chrome 73.0.3683.75

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation306090120150SE +/- 0.67, N = 31341331061051. chrome 73.0.3683.75
OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: Google ChromeNo MitigationsNo Mitigations + No Site IsolationDefault MitigationsDefault Mitigations + No Site Isolation306090120150Min: 133 / Avg: 133.67 / Max: 1351. chrome 73.0.3683.75

No Mitigations

Processor Notes: Scaling Governor: intel_pstate powersave
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + PTE Inversion

Testing initiated at 25 March 2019 12:43 by user system.

No Mitigations + No Site Isolation

Processor Notes: Scaling Governor: intel_pstate powersave
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: __user pointer sanitization + PTE Inversion

Testing initiated at 25 March 2019 15:26 by user system.

Default Mitigations

Processor Notes: Scaling Governor: intel_pstate powersave
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion

Testing initiated at 25 March 2019 17:47 by user system.

Default Mitigations + No Site Isolation

Processor: Intel Core i7-8086K @ 5.00GHz (6 Cores / 12 Threads), Motherboard: ASUS PRIME Z370-A (1802 BIOS), Chipset: Intel 8th Gen Core, Memory: 8192MB, Disk: 118GB INTEL SSDPEK1W120GA, Graphics: Intel UHD 630 3GB (1200MHz), Audio: Realtek ALC1220, Monitor: DELL P2415Q, Network: Intel I219-V

OS: Ubuntu 18.10, Kernel: 4.18.0-16-generic (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server 1.20.1, Display Driver: modesetting 1.20.1, OpenGL: 4.5 Mesa 18.2.2, Vulkan: 1.1.80, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 3840x2160

Processor Notes: Scaling Governor: intel_pstate powersave
Python Notes: Python 2.7.15+ + Python 3.6.7
Security Notes: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion

Testing initiated at 25 March 2019 20:08 by user system.