Firefox Linux Benchmarks

Benchmarks by Michael Larabel for a future article. AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and AMD Radeon RX 7900 XTX 24GB on Ubuntu 23.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2308199-SYST-FIREFOX89
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Firefox 115.0.2
August 18 2023
  1 Hour, 18 Minutes
Firefox 116.0.3
August 18 2023
  1 Hour, 57 Minutes
Firefox 117.0b8
August 18 2023
  2 Hours, 16 Minutes
Firefox 118.0a1
August 18 2023
  1 Hour, 28 Minutes
Mercury 115.0.2
August 18 2023
  1 Hour, 19 Minutes
Invert Behavior (Only Show Selected Data)
  1 Hour, 40 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Firefox Linux BenchmarksOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS)AMD Device 14d832GBWestern Digital WD_BLACK SN850X 1000GBAMD Radeon RX 7900 XTX 24GB (2304/1249MHz)AMD Device ab30ASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 23.046.5.0-060500rc6daily20230814-generic (x86_64)GNOME Shell 44.3X Server 1.21.1.7 + Wayland4.6 Mesa 23.3~git2308100600.81cae3~oibaf~l (git-81cae3d 2023-08-10 lunar-oibaf-ppa) (LLVM 15.0.7 DRM 3.54)GCC 12.3.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionFirefox Linux Benchmarks PerformanceSystem Logs- Transparent Huge Pages: madvise- Scaling Governor: amd-pstate-epp powersave (EPP: performance) - CPU Microcode: 0xa601203- Python 3.11.4- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Firefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.2Logarithmic Result OverviewPhoronix Test SuiteSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumCanvasMark - FirefoxMotionMark - FirefoxARES-6 - FirefoxOctane - FirefoxSpeedometer - FirefoxJetstream 2 - FirefoxJetstream - FirefoxKraken - FirefoxPSPDFKit WASM - FirefoxW.i - FirefoxW.c - FirefoxMaze Solver - Firefox

Firefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.2Logarithmic Per Watt Result OverviewPhoronix Test SuiteMeta Performance Per WattsSeleniumSeleniumSeleniumSeleniumSeleniumSeleniumP.P.WMotionMark - FirefoxSpeedometer - FirefoxOctane - FirefoxJetstream - FirefoxJetstream 2 - FirefoxCanvasMark - Firefox

Firefox Linux Benchmarksselenium: ARES-6 - Firefoxselenium: MotionMark - Firefoxselenium: Speedometer - Firefoxselenium: Octane - Firefoxselenium: Jetstream - Firefoxselenium: Jetstream 2 - Firefoxselenium: CanvasMark - Firefoxselenium: Maze Solver - Firefoxselenium: PSPDFKit WASM - Firefoxselenium: WASM collisionDetection - Firefoxselenium: WASM imageConvolute - Firefoxselenium: Kraken - FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.216.69501.1334052648393.96212.691395333.92438247.718.1484.216.101606.8135452573399.89215.206443373.92436247.918.2484.814.82508.4136853525407.13224.882475713.92432247.118.2484.813.67137959324441.88239.35949603.92473246.118.0436.716.61223.8533653111395.76214.167384753.92434248.318.1484.8OpenBenchmarking.org

Selenium

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: ARES-6 - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.248121620SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 316.6916.1014.8213.6716.611. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

Benchmark: Basemark - Browser: Firefox

Firefox 115.0.2: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Firefox 116.0.3: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Firefox 117.0b8: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Firefox 118.0a1: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Mercury 115.0.2: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: MotionMark - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.230060090012001500SE +/- 1.28, N = 3SE +/- 16.80, N = 3SE +/- 4.97, N = 6SE +/- 0.00, N = 3SE +/- 2.03, N = 3501.131606.81508.411.00223.851. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgRuns Per Minute, More Is BetterSeleniumBenchmark: Speedometer - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.280160240320400SE +/- 1.86, N = 3SE +/- 2.73, N = 3SE +/- 2.60, N = 3SE +/- 0.67, N = 3SE +/- 2.65, N = 33403543683793361. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

Benchmark: WebXPRT - Browser: Firefox

Firefox 115.0.2: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Firefox 116.0.3: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Firefox 117.0b8: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Firefox 118.0a1: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

Mercury 115.0.2: The test quit with a non-zero exit status. E: selenium.common.exceptions.WebDriverException: Message: AbortError: Actor 'MarionetteCommands' destroyed before query 'MarionetteCommandsParent:findElement' was resolved

OpenBenchmarking.orgGeometric Mean, More Is BetterSeleniumBenchmark: Octane - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.213K26K39K52K65KSE +/- 92.85, N = 3SE +/- 549.78, N = 5SE +/- 140.09, N = 3SE +/- 82.88, N = 3SE +/- 103.37, N = 352648525735352559324531111. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.2100200300400500SE +/- 1.68, N = 3SE +/- 1.17, N = 3SE +/- 0.34, N = 3SE +/- 1.11, N = 3SE +/- 0.81, N = 3393.96399.89407.13441.88395.761. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: Jetstream 2 - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.250100150200250SE +/- 1.67, N = 3SE +/- 1.18, N = 3SE +/- 1.59, N = 3SE +/- 1.21, N = 3SE +/- 2.17, N = 3212.69215.21224.88239.36214.171. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgScore, More Is BetterSeleniumBenchmark: CanvasMark - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.210K20K30K40K50KSE +/- 480.22, N = 3SE +/- 982.23, N = 6SE +/- 1366.06, N = 9SE +/- 55.92, N = 3SE +/- 103.35, N = 33953344337475714960384751. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

Benchmark: StyleBench - Browser: Firefox

Firefox 115.0.2: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase.test_untitled_test_case)

Firefox 116.0.3: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase.test_untitled_test_case)

Firefox 117.0b8: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase.test_untitled_test_case)

Firefox 118.0a1: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase.test_untitled_test_case)

Mercury 115.0.2: The test quit with a non-zero exit status. E: ERROR: test_untitled_test_case (__main__.UntitledTestCase.test_untitled_test_case)

OpenBenchmarking.orgSeconds, Fewer Is BetterSeleniumBenchmark: Maze Solver - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.20.87751.7552.63253.514.3875SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.00, N = 4SE +/- 0.03, N = 4SE +/- 0.00, N = 43.93.93.93.93.91. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgScore, Fewer Is BetterSeleniumBenchmark: PSPDFKit WASM - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.25001000150020002500SE +/- 1.86, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 2.00, N = 2SE +/- 1.00, N = 3243824362432247324341. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.250100150200250SE +/- 0.79, N = 4SE +/- 1.50, N = 4SE +/- 1.29, N = 4SE +/- 1.76, N = 4SE +/- 0.93, N = 4247.7247.9247.1246.1248.31. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.248121620SE +/- 0.04, N = 5SE +/- 0.06, N = 5SE +/- 0.04, N = 5SE +/- 0.05, N = 5SE +/- 0.02, N = 518.118.218.218.018.11. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: FirefoxFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.2100200300400500SE +/- 1.52, N = 3SE +/- 1.16, N = 3SE +/- 1.39, N = 3SE +/- 2.71, N = 3SE +/- 3.09, N = 3484.2484.8484.8436.7484.81. Firefox 115.0.2: firefox 115.0.22. Firefox 116.0.3: firefox 116.0.33. Firefox 117.0b8: firefox 117.04. Firefox 118.0a1: firefox 118.0a15. Mercury 115.0.2: firefox 115.2.0

Meta Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.250010001500200025001759.932202.331876.18477.111533.94

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.2306090120150Min: 18.36 / Avg: 51.98 / Max: 139Min: 12.9 / Avg: 49.47 / Max: 149.73Min: 19.26 / Avg: 53.51 / Max: 148.29Min: 16.93 / Avg: 42.74 / Max: 148.52Min: 18.99 / Avg: 51.64 / Max: 138.6

CPU Usage (Summary) Monitor

OpenBenchmarking.orgPercentCPU Usage (Summary) MonitorPhoronix Test Suite System MonitoringFirefox 115.0.2Firefox 116.0.3Firefox 117.0b8Firefox 118.0a1Mercury 115.0.21122334455Min: 0 / Avg: 2.83 / Max: 37.25Min: 0 / Avg: 2.52 / Max: 50.58Min: 0 / Avg: 2.94 / Max: 52.46Min: 0 / Avg: 1.68 / Max: 51.97Min: 0 / Avg: 2.76 / Max: 38.33