nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.org

Source Repository

github.com

Test Created

6 December 2010

Last Updated

4 November 2022

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 18 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib + OpenSSL

Accolades

200k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2010.122011.042011.082011.122012.042012.082012.122013.042013.082013.122014.042014.082014.122015.042015.082015.122016.042016.082016.122017.042017.082017.122018.042018.082018.122019.042019.082019.122020.042020.082020.122021.042021.082021.122022.042022.0820K40K60K80K100K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 21 November 2022.
20020.1%50025.0%100020.0%2010.0%10018.0%40007.0%Connections Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-3.0.0   [View Source]   Fri, 04 Nov 2022 09:09:12 GMT
Update against nginx 1.23.2 upstream, switch to using SSL HTTPS, ue wrk for benchmarkin.

pts/nginx-2.0.1   [View Source]   Tue, 19 Apr 2022 18:17:33 GMT
Update to support using Go install on newer versions. Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/616

pts/nginx-2.0.0   [View Source]   Thu, 12 Aug 2021 18:29:30 GMT
Update against nginx 1.21.1 upstream, switch to using Bombardier for load testing, add concurrent request option.

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

nginx 1.23.2

Connections: 500

OpenBenchmarking.org metrics for this test profile configuration based on 150 public results since 4 November 2022 with the latest data as of 27 November 2022.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
99th
5
212497 +/- 8158
93rd
11
204408 +/- 3830
86th
3
187105 +/- 2919
82nd
6
174677 +/- 5221
79th
3
167324 +/- 249
76th
3
166550 +/- 572
Mid-Tier
75th
< 166411
75th
3
166316 +/- 164
73rd
3
165751 +/- 856
67th
5
165200 +/- 890
66th
3
163763 +/- 3355
63rd
3
162022 +/- 1473
63rd
3
160732 +/- 1169
57th
3
135174 +/- 1201
52nd
4
125018 +/- 2012
Median
50th
101693
49th
4
101323 +/- 427
47th
4
99088 +/- 517
44th
3
97856 +/- 725
42nd
4
86252 +/- 480
39th
3
76147 +/- 768
35th
3
52247 +/- 332
30th
3
41589 +/- 575
27th
3
39009 +/- 1454
Low-Tier
25th
< 37574
25th
4
37513 +/- 47
20th
3
33664 +/- 1113
20th
3
33655 +/- 515
18th
3
31350 +/- 108
16th
3
30816 +/- 261
13th
3
28066 +/- 1224
13th
3
28061 +/- 794
9th
3
24806 +/- 208
8th
3
20798 +/- 95
5th
3
18224 +/- 56
OpenBenchmarking.orgDistribution Of Public Results - Connections: 500140 Results Range From 202 To 213808 Requests Per Second2024475874813021172942156725840301133438638659429324720551478557516002464297685707284377116813898566289935942089848110275410702711130011557311984612411912839213266513693814121114548414975715403015830316257616684917112217539517966818394118821419248719676020103320530620957921385248121620

Based on OpenBenchmarking.org data, the selected test / test configuration (nginx 1.23.2 - Connections: 500) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkConnections: 500Run-Time3691215Min: 5 / Avg: 5.14 / Max: 12

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsConnections: 500Deviation246810Min: 0 / Avg: 0.1 / Max: 1

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQU PSHUFD UCOMISD CVTSS2SD CVTSI2SD ADDSD SUBSD MULSD CVTTSD2SI DIVSD PSHUFHW MOVDQA SQRTSD COMISD CVTSD2SI ANDNPD CMPLESD ORPD ANDPD CMPNLTSD MOVAPD MOVD CVTSD2SS PSLLDQ PSRLDQ
SSSE3 (SSSE3)
Used by default on supported hardware.
 
PSHUFB PALIGNR
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT PCMPESTRI
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER VPERM2F128
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPBROADCASTB VINSERTI128 VPBLENDD VPERM2I128
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
AESENC AESENCLAST AESDEC AESDECLAST AESKEYGENASSIST AESIMC
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFNMADD231SD VFMADD213SD
Last automated analysis: 23 April 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A73 2-Core, ARMv8 Neoverse-N1, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 256-Core, Apple M1, Apple M2

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 270 Benchmark Results

AMD EPYC 7F32 8-Core - ASRockRack EPYCD8 - AMD Starship

Debian 11 - 5.10.0-10-amd64 - GNOME Shell 3.38.6

1 System - 1 Benchmark Result

Unknown - QEMU KVM Virtual Machine - Red Hat QEMU PCIe

openEuler 22.03 LTS - 5.19.17 - ext4

1 System - 31 Benchmark Results

AMD Ryzen 7 2700 Eight-Core - ASUS PRIME X470-PRO - AMD 17h

NixOS 22.05 - 5.15.70 - X Server

2 Systems - 270 Benchmark Results

AMD EPYC 7F32 8-Core - ASRockRack EPYCD8 - AMD Starship

Debian 11 - 5.10.0-10-amd64 - GNOME Shell 3.38.6

1 System - 3 Benchmark Results

Loongson-3A5000-HV - Loongson Loongson-LS3A5000-7A2000-1w-EVB-V1.21 - Loongson LLC Hyper Transport Bridge

Loongnix 20 - 4.19.0-18-loongson-3 - X Server 1.20.11

2 Systems - 334 Benchmark Results

2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h

Ubuntu 22.04 - 5.15.0-40-generic - GNOME Shell 42.2

2 Systems - 334 Benchmark Results

2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h

Ubuntu 22.04 - 5.15.0-40-generic - GNOME Shell 42.2

1 System - 1 Benchmark Result

Unknown - QEMU KVM Virtual Machine - Red Hat QEMU PCIe

openEuler 22.03 LTS - 5.10.0-60.18.0.50.oe2203.aarch64 - GCC 10.3.1

1 System - 1 Benchmark Result

Unknown - QEMU KVM Virtual Machine - Red Hat QEMU PCIe

openEuler 22.03 LTS - 5.19.17 - GCC 10.3.1

3 Systems - 75 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 22.04 - 5.19.0-051900rc7-generic - GNOME Shell 42.2

3 Systems - 184 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 22.04 - 5.15.0-47-generic - GNOME Shell 42.2

4 Systems - 75 Benchmark Results

Intel Core i5-12600K - ASUS PRIME Z690-P WIFI D4 - Intel Device 7aa7

Ubuntu 22.04 - 5.19.0-051900rc6daily20220716-generic - GNOME Shell 42.1

2 Systems - 21 Benchmark Results

ARMv8 Cortex-A73 - Hardkernel ODROID-N2Plus - 4096MB

Debian - 6.0.8-meson64 - GCC 12.2.0

2 Systems - 21 Benchmark Results

ARMv8 Cortex-A53 - BCM2835 Raspberry Pi 3 Model B Rev 1.2 - 948MB

Ubuntu 22.10 - 5.19.0-1006-raspi - GCC 12.2.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

4 Systems - 84 Benchmark Results

AMD Ryzen 9 7950X 16-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.10 - 5.19.0-19-generic - GNOME Shell 43.0

3 Systems - 81 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 22.04 - 5.15.0-52-generic - GNOME Shell 42.2

3 Systems - 62 Benchmark Results

Apple M2 - Apple MacBook Air - 8GB

Arch rolling - 5.19.0-rc7-asahi-2-1-ARCH - KDE Plasma 5.25.4

3 Systems - 7 Benchmark Results

AMD Ryzen 5 5500U - NB01 NL5xNU - AMD Renoir

Ubuntu 22.04 - 5.15.0-52-generic - KDE Plasma 5.24.6

4 Systems - 64 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

Arch Linux ARM - 5.19.0-rc7-asahi-2-1-ARCH - KDE Plasma 5.25.4

3 Systems - 11 Benchmark Results

Intel Core i7-1065G7 - Dell 06CDVY - Intel Ice Lake-LP DRAM

Ubuntu 22.04 - 5.18.8-051808-generic - GNOME Shell 42.2

3 Systems - 7 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

3 Systems - 7 Benchmark Results

AMD Ryzen 7 PRO 5850U - HP 8A78 - AMD Renoir

Pop 22.04 - 5.19.0-76051900-generic - GNOME Shell 42.3.1

2 Systems - 168 Benchmark Results

AMD Ryzen 9 7950X 16-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.10 - 6.0.0-060000-generic - GNOME Shell 43.0

2 Systems - 384 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

3 Systems - 7 Benchmark Results

AMD Ryzen 7 7700X 8-Core - ASRock X670E PG Lightning - AMD Device 14d8

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

3 Systems - 11 Benchmark Results

Intel Core i7-1185G7 - Dell 0DXP1F - Intel Tiger Lake-LP

Ubuntu 22.04 - 5.18.8-051808-generic - GNOME Shell 42.2

3 Systems - 7 Benchmark Results

Intel Core i7-1280P - MSI MS-14C6 - Intel Alder Lake PCH

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

3 Systems - 7 Benchmark Results

AMD Ryzen 7 PRO 6850U - LENOVO 21CM0001US - AMD Device 14b5

Ubuntu 22.10 - 6.1.0-060100rc2daily20221028-generic - GNOME Shell 43.0

Find More Test Results