nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.org

Source Repository

github.com

Test Created

6 December 2010

Last Updated

25 March 2023

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 12 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib + OpenSSL

Accolades

200k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2010.122011.052011.102012.032012.082013.012013.062013.112014.042014.092015.022015.072015.122016.052016.102017.032017.082018.012018.062018.112019.042019.092020.022020.072020.122021.052021.102022.032022.082023.012023.062023.1160K120K180K240K300K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 25 March 2024.
20018.5%50024.5%100021.4%209.1%10016.5%400010.0%Connections Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-3.0.1   [View Source]   Sat, 25 Mar 2023 11:35:50 GMT
Update against latest Nginx point release for GCC 13 build fix.

pts/nginx-3.0.0   [View Source]   Fri, 04 Nov 2022 09:09:12 GMT
Update against nginx 1.23.2 upstream, switch to using SSL HTTPS, ue wrk for benchmarkin.

pts/nginx-2.0.1   [View Source]   Tue, 19 Apr 2022 18:17:33 GMT
Update to support using Go install on newer versions. Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/616

pts/nginx-2.0.0   [View Source]   Thu, 12 Aug 2021 18:29:30 GMT
Update against nginx 1.21.1 upstream, switch to using Bombardier for load testing, add concurrent request option.

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

nginx 1.21.1

Concurrent Requests: 1

OpenBenchmarking.org metrics for this test profile configuration based on 752 public results since 12 August 2021 with the latest data as of 13 March 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
100th
10
173996 +/- 23106
99th
3
161057 +/- 7846
98th
3
131844 +/- 85
95th
6
121831 +/- 7928
95th
4
120862 +/- 1923
91st
4
97711 +/- 2137
88th
3
87487 +/- 496
87th
3
85994 +/- 3045
86th
4
85163 +/- 415
84th
3
77618 +/- 1099
82nd
6
74026 +/- 1431
81st
4
71854 +/- 63
Mid-Tier
75th
< 63906
75th
3
63468 +/- 950
72nd
7
62224 +/- 667
71st
3
61493 +/- 2179
70th
4
60924 +/- 5012
70th
3
60421 +/- 37
69th
3
60141 +/- 388
69th
4
60072 +/- 872
66th
4
58683 +/- 181
65th
4
58107 +/- 264
64th
8
57852 +/- 1900
61st
3
54508 +/- 270
60th
4
54301 +/- 546
60th
3
53497 +/- 1521
56th
3
49515 +/- 486
54th
3
44554 +/- 484
53rd
6
44092 +/- 41
Median
50th
43436
50th
5
43070 +/- 1114
47th
3
41293 +/- 1776
46th
7
39259 +/- 2537
43rd
4
36152 +/- 3334
42nd
3
35224 +/- 292
42nd
7
34373 +/- 3776
34th
3
27647 +/- 526
32nd
3
26875 +/- 150
31st
5
26616 +/- 2946
31st
3
26471 +/- 1055
31st
4
25779 +/- 481
28th
3
25030 +/- 146
28th
3
24142 +/- 76
27th
3
23590 +/- 64
26th
3
23030 +/- 438
Low-Tier
25th
< 22747
23rd
3
21749 +/- 377
23rd
3
21736 +/- 907
19th
3
19835 +/- 56
18th
3
19478 +/- 948
15th
4
16545 +/- 201
11th
3
14281 +/- 62
8th
18
13168 +/- 1376
6th
8
9533 +/- 576
OpenBenchmarking.orgDistribution Of Public Results - Concurrent Requests: 1752 Results Range From 35 To 216657 Requests Per Second35436887011303417367217002603330366346993903243365476985203156364606976503069363736967802982362866959102895361996941040271083601126931170261213591256921300251343581386911430241473571516901560231603561646891690221733551776881820211863541906871950201993532036862080192123522166851326395265

Based on OpenBenchmarking.org data, the selected test / test configuration (nginx 1.21.1 - Concurrent Requests: 1) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkConcurrent Requests: 1Run-Time48121620Min: 5 / Avg: 5.19 / Max: 14

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.4%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsConcurrent Requests: 1Deviation246810Min: 0 / Avg: 0.36 / Max: 4

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNGINX Benchmark CPU Core ScalingConcurrent Requests: 14681624320.42920.85841.28761.71682.146

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQU PSHUFD UCOMISD CVTSS2SD CVTSI2SD ADDSD SUBSD MULSD CVTTSD2SI DIVSD PSHUFHW MOVDQA SQRTSD COMISD CVTSD2SI ANDNPD CMPLESD ORPD ANDPD CMPNLTSD MOVAPD MOVD CVTSD2SS PSLLDQ PSRLDQ
SSSE3 (SSSE3)
Used by default on supported hardware.
 
PSHUFB PALIGNR
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT PCMPESTRI
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER VPERM2F128
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPBROADCASTB VINSERTI128 VPBLENDD VPERM2I128
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
AESENC AESENCLAST AESDEC AESDECLAST AESKEYGENASSIST AESIMC
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFNMADD231SD VFMADD213SD
Last automated analysis: 23 April 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM Z
s390x
(Many Processors)
Intel / AMD x86 32-bit
i686
(Many Processors)
ARMv7 32-bit
armv7l
ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A72 4-Core, Pi 4 2GB 32-bit
ARMv8 64-bit
aarch64
ARMv8, ARMv8 Cortex-A72 4-Core, ARMv8 Cortex-A75 8-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 32-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Apple M1, Apple M2, Pi 4 2GB 64-bit

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 10 Benchmark Results

AMD Ryzen 9 5950X 16-Core - Intel 440BX - Intel 440BX

Ubuntu 22.04 - 5.15.0-100-generic - 1.3.255

8 Systems - 182 Benchmark Results

Intel Core i7-7700HQ - KBL Neptune_KLS - 16GB

Ubuntu 20.04 - 6.5.0-15-generic - X Server

7 Systems - 182 Benchmark Results

AMD Ryzen 5 3600 6-Core - BIOSTAR B550MX/E PRO - AMD Starship

Debian 12 - 6.5.0-0.deb12.4-amd64 - GCC 12.2.0

6 Systems - 173 Benchmark Results

AMD Ryzen 5 3600 6-Core - BIOSTAR B550MX/E PRO - AMD Starship

Debian 12 - 6.5.0-0.deb12.4-amd64 - GCC 12.2.0

5 Systems - 173 Benchmark Results

AMD Ryzen 5 7600X 6-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.04 - 6.0.0-060000rc7daily20221001-generic - GNOME Shell 42.4

4 Systems - 32 Benchmark Results

Pi 4 2GB 64-bit - BCM2835 Raspberry Pi 4 Model B Rev 1.1 - Broadcom BCM2711

Debian 11 - 5.15.56-v8+ - GCC 10.2.1 20210110

Find More Test Results