nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.org

Source Repository

github.com

Test Created

6 December 2010

Last Updated

25 March 2023

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 13 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib + OpenSSL

Accolades

200k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2010.122011.052011.102012.032012.082013.012013.062013.112014.042014.092015.022015.072015.122016.052016.102017.032017.082018.012018.062018.112019.042019.092020.022020.072020.122021.052021.102022.032022.082023.012023.062023.112024.0460K120K180K240K300K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 13 April 2024.
20018.5%50024.5%100021.4%209.2%10016.5%400010.0%Connections Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-3.0.1   [View Source]   Sat, 25 Mar 2023 11:35:50 GMT
Update against latest Nginx point release for GCC 13 build fix.

pts/nginx-3.0.0   [View Source]   Fri, 04 Nov 2022 09:09:12 GMT
Update against nginx 1.23.2 upstream, switch to using SSL HTTPS, ue wrk for benchmarkin.

pts/nginx-2.0.1   [View Source]   Tue, 19 Apr 2022 18:17:33 GMT
Update to support using Go install on newer versions. Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/616

pts/nginx-2.0.0   [View Source]   Thu, 12 Aug 2021 18:29:30 GMT
Update against nginx 1.21.1 upstream, switch to using Bombardier for load testing, add concurrent request option.

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

NGINX Benchmark 1.9.9

Static Web Page Serving

OpenBenchmarking.org metrics for this test profile configuration based on 6,031 public results since 8 January 2018 with the latest data as of 27 November 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
100th
32
52137 +/- 2932
100th
11
51152 +/- 4373
100th
9
50169 +/- 559
99th
12
49215 +/- 6711
99th
5
48718 +/- 6387
98th
6
47626 +/- 2582
98th
40
47490 +/- 2493
98th
12
46569 +/- 3529
98th
17
45930 +/- 2716
97th
43
44904 +/- 3787
97th
6
44583 +/- 154
97th
82
44471 +/- 5259
97th
3
44322 +/- 3274
97th
3
44207 +/- 3592
96th
4
43223 +/- 5320
95th
3
42934 +/- 2726
95th
7
42158 +/- 3103
94th
29
42025 +/- 4819
94th
4
40731 +/- 3390
94th
4
40678 +/- 159
93rd
6
40122 +/- 5133
92nd
41
39586 +/- 1710
92nd
16
39560 +/- 3181
92nd
4
39311 +/- 119
92nd
44
38965 +/- 2496
92nd
21
38626 +/- 2110
91st
3
38540 +/- 766
91st
3
38074 +/- 2989
90th
5
37440 +/- 2778
90th
4
36833 +/- 1819
90th
8
36508 +/- 193
89th
5
35704 +/- 4801
89th
46
35641 +/- 2261
88th
7
35145 +/- 1526
87th
20
34852 +/- 2624
87th
4
34778 +/- 1846
87th
31
34681 +/- 2328
87th
4
33935 +/- 4293
86th
36
33432 +/- 1400
85th
14
32767 +/- 3283
85th
53
32760 +/- 3374
84th
10
32609 +/- 518
82nd
6
31259 +/- 1519
82nd
4
31188 +/- 4674
82nd
3
30732 +/- 1818
82nd
4
30546 +/- 1767
81st
42
30330 +/- 1538
81st
10
30219 +/- 2490
81st
6
30104 +/- 3883
81st
9
30010 +/- 3023
79th
14
29159 +/- 884
79th
3
28964 +/- 4293
78th
24
27916 +/- 4057
78th
4
27864 +/- 388
78th
9
27825 +/- 2404
77th
28
27303 +/- 3557
Mid-Tier
75th
< 27081
75th
5
26994 +/- 2765
75th
3
26983 +/- 3801
69th
3
26050 +/- 84
68th
24
25845 +/- 3509
67th
4
25508 +/- 2283
65th
3
24879 +/- 2204
65th
3
24681 +/- 2038
64th
3
24361 +/- 2344
64th
4
23904 +/- 284
64th
3
23862 +/- 2886
64th
27
23834 +/- 3123
63rd
8
23506 +/- 1654
62nd
29
22926 +/- 2271
61st
6
22215 +/- 365
61st
4
22172 +/- 486
60th
3
21826 +/- 409
59th
4
20896 +/- 142
59th
3
20627 +/- 563
59th
3
20574 +/- 1198
59th
12
20557 +/- 2118
59th
6
20508 +/- 3047
59th
4
20403 +/- 2720
58th
4
19925 +/- 21
58th
3
19909 +/- 162
58th
23
19827 +/- 1623
58th
6
19631 +/- 2839
57th
6
19326 +/- 2286
57th
3
19223 +/- 702
56th
7
18764 +/- 300
56th
5
18556 +/- 130
56th
22
18384 +/- 781
51st
3
17198 +/- 814
Median
50th
17087
50th
4
16997 +/- 268
41st
3
10334 +/- 49
41st
5
9925 +/- 740
41st
11
9719 +/- 153
Low-Tier
25th
< 5737
15th
19
5101 +/- 678
4th
8
4045 +/- 40
2nd
3
480 +/- 20
OpenBenchmarking.orgDistribution Of Public Results - Static Web Page Serving6031 Results Range From 306 To 99720 Requests Per Second30622954284627382621025112240142291621818207201962218524174261632815230141321303411936108380974008642075440644605348042500315202054009559985798759976619656395465943679326992171910738997588877877798668185583844858338782289811918009378995778977679975630060090012001500

Based on OpenBenchmarking.org data, the selected test / test configuration (NGINX Benchmark 1.9.9 - Static Web Page Serving) has an average run-time of 13 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkStatic Web Page ServingRun-Time1530456075Min: 1 / Avg: 12.51 / Max: 81

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.8%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsStatic Web Page ServingDeviation3691215Min: 0 / Avg: 0.77 / Max: 7

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNGINX Benchmark CPU Core ScalingStatic Web Page Serving246816202432400.68961.37922.06882.75843.448

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQU PSHUFD UCOMISD CVTSS2SD CVTSI2SD ADDSD SUBSD MULSD CVTTSD2SI DIVSD PSHUFHW MOVDQA SQRTSD COMISD CVTSD2SI ANDNPD CMPLESD ORPD ANDPD CMPNLTSD MOVAPD MOVD CVTSD2SS PSLLDQ PSRLDQ
SSSE3 (SSSE3)
Used by default on supported hardware.
 
PSHUFB PALIGNR
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT PCMPESTRI
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER VPERM2F128
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPBROADCASTB VINSERTI128 VPBLENDD VPERM2I128
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
AESENC AESENCLAST AESDEC AESDECLAST AESKEYGENASSIST AESIMC
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFNMADD231SD VFMADD213SD
Last automated analysis: 23 April 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM Z
s390x
(Many Processors)
MIPS 64-bit
mips64
Loongson-3A R4, Loongson-3A3000 V0.9 FPU V0.1
Intel / AMD x86 32-bit
i686
(Many Processors)
ARMv7 32-bit
armv7l
ARMv7 4-Core, ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A7 4-Core, ARMv7 Cortex-A72 4-Core, ARMv7 Cortex-A9 2-Core, ARMv7 rev 0 4-Core, ARMv7 rev 1 4-Core, ARMv7 rev 3 4-Core, ARMv7 rev 4 4-Core
ARMv6 32-bit
armv6l
ARMv6-compatible rev 7, ARMv7
ARMv8 64-bit
aarch64
(Many Processors)

Recent Test Results

OpenBenchmarking.org Results Compare

9 Systems - 28 Benchmark Results

Intel Celeron J4105 - HARDKERNEL ODROID-H2 v1.0 - Intel Device 31f0

Ubuntu 18.04 - 5.0.0-27-generic - GCC 7.4.0

9 Systems - 28 Benchmark Results

ARMv8 Cortex-A57 - jetson-nano - 4096MB

Ubuntu 18.04 - 4.9.140-tegra - Unity 7.5.0

8 Systems - 28 Benchmark Results

Rockchip ARMv8 Cortex-A53 - Firefly ROC-RK3328-CC - 2048MB

Ubuntu 18.04 - 4.4.114 - X Server 1.18.4

7 Systems - 28 Benchmark Results

ARMv7 rev 4 - BCM2835 Raspberry Pi 3 Model B Plus Rev 1.3 - 926MB

Raspbian 10 - 4.19.42-v7+ - X Server 1.20.4

19 Systems - 35 Benchmark Results

4 x Intel Xeon E312xx (Sandy Bridge IBRS update) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.15.0-88-generic - ext4

18 Systems - 35 Benchmark Results

4 x Intel Xeon E312xx (Sandy Bridge IBRS update) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 5.3.0-51-generic - ext4

17 Systems - 35 Benchmark Results

4 x QEMU Virtual 2.5+ - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 5.3.0-51-generic - ext4

15 Systems - 35 Benchmark Results

4 x AMD EPYC (with IBPB) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.15.0-88-generic - ext4

16 Systems - 35 Benchmark Results

4 x Intel Xeon E312xx (Sandy Bridge IBRS update) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 5.3.0-51-generic - ext4

15 Systems - 35 Benchmark Results

4 x QEMU Virtual 2.5+ - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.15.0-88-generic - ext4

14 Systems - 103 Benchmark Results

Intel Xeon Gold 6238R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

CentOS Linux 8 - 4.18.0-240.10.1.el8_3.x86_64 - GCC 8.3.1 20191121

13 Systems - 103 Benchmark Results

Intel Xeon Gold 6312U - Supermicro X12SPL-F v2.00 - Intel Device 0998

Rocky Linux 8.5 - 4.18.0-348.12.2.el8_5.x86_64 - GCC 8.5.0 20210514

13 Systems - 103 Benchmark Results

Intel Xeon Gold 6312U - Supermicro X12SPO-NTF v2.00 - Intel Ice Lake IEH

Rocky Linux 8.8 - 4.18.0-477.13.1.el8_8.x86_64 - GCC 8.5.0 20210514

13 Systems - 103 Benchmark Results

Intel Xeon Gold 6312U - Supermicro X12SPL-F v2.00 - Intel Device 0998

CentOS Linux 8 - 4.18.0-305.12.1.el8_4.x86_64 - GCC 8.4.1 20200928

Find More Test Results