nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.org

Source Repository

github.com

Test Created

6 December 2010

Last Updated

4 November 2022

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

1 Minute, 16 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib + OpenSSL

Accolades

200k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2010.122011.042011.082011.122012.042012.082012.122013.042013.082013.122014.042014.082014.122015.042015.082015.122016.042016.082016.122017.042017.082017.122018.042018.082018.122019.042019.082019.122020.042020.082020.122021.042021.082021.122022.042022.082022.1250K100K150K200K250K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 24 January 2023.
20019.4%50023.3%100019.8%2010.4%10017.4%40009.8%Connections Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-3.0.0   [View Source]   Fri, 04 Nov 2022 09:09:12 GMT
Update against nginx 1.23.2 upstream, switch to using SSL HTTPS, ue wrk for benchmarkin.

pts/nginx-2.0.1   [View Source]   Tue, 19 Apr 2022 18:17:33 GMT
Update to support using Go install on newer versions. Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/616

pts/nginx-2.0.0   [View Source]   Thu, 12 Aug 2021 18:29:30 GMT
Update against nginx 1.21.1 upstream, switch to using Bombardier for load testing, add concurrent request option.

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

nginx 1.23.2

Connections: 500

OpenBenchmarking.org metrics for this test profile configuration based on 282 public results since 4 November 2022 with the latest data as of 25 January 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
100th
6
272919 +/- 3977
99th
6
232062 +/- 12790
95th
6
214899 +/- 9373
92nd
13
204188 +/- 3538
87th
8
200171 +/- 3885
84th
3
187105 +/- 2919
82nd
4
177557 +/- 1375
80th
11
175679 +/- 4190
78th
3
167324 +/- 249
76th
3
166550 +/- 572
Mid-Tier
75th
< 166411
75th
3
166316 +/- 164
74th
3
165751 +/- 856
71st
3
163763 +/- 3355
69th
3
162022 +/- 1473
69th
10
160935 +/- 5961
69th
3
160732 +/- 1169
59th
3
135174 +/- 1201
56th
4
125018 +/- 2012
52nd
4
101323 +/- 427
51st
4
99088 +/- 517
Median
50th
98640
49th
3
97856 +/- 725
47th
7
94114 +/- 119
46th
4
86252 +/- 480
41st
3
76147 +/- 768
39th
5
74942 +/- 24
29th
3
52247 +/- 332
Low-Tier
25th
< 49159
23rd
3
43953 +/- 743
22nd
3
41653 +/- 3067
22nd
3
41589 +/- 575
19th
3
39009 +/- 1454
18th
4
37513 +/- 47
16th
3
33664 +/- 1113
16th
3
33655 +/- 515
15th
3
31350 +/- 108
14th
3
30816 +/- 261
12th
3
28066 +/- 1224
12th
3
28061 +/- 794
10th
4
25026 +/- 2198
9th
3
24806 +/- 208
7th
3
20798 +/- 95
6th
3
18224 +/- 56
OpenBenchmarking.orgDistribution Of Public Results - Connections: 500278 Results Range From 202 To 276710 Requests Per Second2025733112641679522326278573338838919444504998155512610436657472105776368316788698942299976010529111082211635312188412741513294613847714400814953915507016060116613217166317719418272518825619378719931820484921038021591122144222697323250423803524356624909725462826015926569027122127675248121620

Based on OpenBenchmarking.org data, the selected test / test configuration (nginx 1.23.2 - Connections: 500) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkConnections: 500Run-Time3691215Min: 5 / Avg: 5.09 / Max: 12

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsConnections: 500Deviation246810Min: 0 / Avg: 0.15 / Max: 2

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

OpenBenchmarking.orgRelative Core Scaling To BaseNGINX Benchmark CPU Core ScalingConnections: 5006812641283691215

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQU PSHUFD UCOMISD CVTSS2SD CVTSI2SD ADDSD SUBSD MULSD CVTTSD2SI DIVSD PSHUFHW MOVDQA SQRTSD COMISD CVTSD2SI ANDNPD CMPLESD ORPD ANDPD CMPNLTSD MOVAPD MOVD CVTSD2SS PSLLDQ PSRLDQ
SSSE3 (SSSE3)
Used by default on supported hardware.
 
PSHUFB PALIGNR
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT PCMPESTRI
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER VPERM2F128
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPBROADCASTB VINSERTI128 VPBLENDD VPERM2I128
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
AESENC AESENCLAST AESDEC AESDECLAST AESKEYGENASSIST AESIMC
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFNMADD231SD VFMADD213SD
Last automated analysis: 23 April 2022

This test profile binary relies on the shared libraries libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
ARMv8 16-Core, ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A73 2-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 16-Core, ARMv8 Neoverse-N2 16-Core, ARMv8 Neoverse-V1, ARMv8 Neoverse-V1 16-Core, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 256-Core, Apple M1, Apple M2

Recent Test Results

OpenBenchmarking.org Results Compare

2 Systems - 42 Benchmark Results

Intel Core i5-1035G1 - ASUS X512JA v1.0 - Intel Ice Lake-LP DRAM

Debian 11 - 5.10.0-21-amd64 - X Server 1.20.11

7 Systems - 28 Benchmark Results

ARMv7 rev 3 - BCM2835 Raspberry Pi 4 Model B Rev 1.1 - 2048MB

Raspbian 10 - 4.19.50-v7l+ - LXDE 0.10.0

1 System - 40 Benchmark Results

Intel Core i7-6700HQ - 32GB - 472GB

Ubuntu 22.04 - 4.4.0-19041-Microsoft - 1.2.204

1 System - 40 Benchmark Results

AMD Ryzen 5 3600X 6-Core - 32GB - 931GB

Ubuntu 20.04 - 4.4.0-22621-Microsoft - 1.1.182

1 System - 19 Benchmark Results

Intel Core i7-6700HQ - 32GB - 472GB

Ubuntu 22.04 - 4.4.0-19041-Microsoft - 1.2.204

1 System - 1 Benchmark Result

Apple M1 - Apple MacBook Air - 8GB

Arch Linux ARM - 6.1.0-asahi-2-2-ARCH - KDE Plasma 5.26.5

1 System - 7 Benchmark Results

ARMv8 Neoverse-N1 - Amazon EC2 m6g.8xlarge - 128GB

Ubuntu 20.04.5 LTS - 4.14.301-224.520.amzn2.aarch64 - GCC 9.4.0

1 System - 7 Benchmark Results

ARMv8 Neoverse-V1 - Amazon EC2 c7g.8xlarge - 62GB

Ubuntu 20.04.5 LTS - 4.14.301-224.520.amzn2.aarch64 - GCC 9.4.0

1 System - 7 Benchmark Results

AMD EPYC 7R13 - Amazon EC2 m6a.8xlarge - 128GB

Ubuntu 20.04.5 LTS - 4.14.301-224.520.amzn2.x86_64 - GCC 9.4.0

2 Systems - 117 Benchmark Results

2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5

CentOS 7.9.2009 - 3.10.0-1160.81.1.el7.x86_64 - X Server

2 Systems - 118 Benchmark Results

2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5

CentOS 7.9.2009 - 3.10.0-1160.11.1.el7.x86_64 - X Server

13 Systems - 103 Benchmark Results

Intel Xeon Gold 6312U - Supermicro X12SPL-F v2.00 - Intel Device 0998

Rocky Linux 8.5 - 4.18.0-348.20.1.el8_5.x86_64 - GCC 8.5.0 20210514

11 Systems - 103 Benchmark Results

Intel Xeon Gold 6238R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

CentOS Linux 8 - 4.18.0-305.3.1.el8.x86_64 - GCC 8.4.1 20200928

12 Systems - 103 Benchmark Results

Intel Xeon Gold 6238R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

CentOS Linux 8 - 4.18.0-193.19.1.el8_2.x86_64 - GCC 8.3.1 20191121

11 Systems - 103 Benchmark Results

Intel Xeon Gold 6312U - Supermicro X12SPL-F v2.00 - Intel Device 0998

Rocky Linux 8.5 - 4.18.0-348.20.1.el8_5.x86_64 - GCC 8.5.0 20210514

Most Popular Test Results

OpenBenchmarking.org Results Compare

4 Systems - 84 Benchmark Results

AMD Ryzen 9 7950X 16-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.10 - 5.19.0-19-generic - GNOME Shell 43.0

2 Systems - 384 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Clear Linux OS 37600 - 6.0.7-1207.native - GNOME Shell 43.0

2 Systems - 168 Benchmark Results

AMD Ryzen 9 7950X 16-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.10 - 6.1.0-060100rc3daily20221103-generic - GNOME Shell 43.0

2 Systems - 334 Benchmark Results

2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h

Ubuntu 22.04 - 5.15.0-40-generic - GNOME Shell 42.2

3 Systems - 75 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 22.04 - 5.19.0-051900rc7-generic - GNOME Shell 42.2

3 Systems - 184 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 22.04 - 5.15.0-47-generic - GNOME Shell 42.2

4 Systems - 75 Benchmark Results

Intel Core i5-12600K - ASUS PRIME Z690-P WIFI D4 - Intel Device 7aa7

Ubuntu 22.04 - 5.19.0-051900rc6daily20220716-generic - GNOME Shell 42.1

3 Systems - 81 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 22.04 - 5.15.0-52-generic - GNOME Shell 42.2

3 Systems - 7 Benchmark Results

AMD Ryzen 7 PRO 5850U - HP 8A78 - AMD Renoir

Pop 22.04 - 5.19.0-76051900-generic - GNOME Shell 42.3.1

4 Systems - 64 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

Arch Linux ARM - 5.19.0-rc7-asahi-2-1-ARCH - KDE Plasma 5.25.4

3 Systems - 124 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - Gigabyte TRX40 AORUS PRO WIFI - AMD Starship

Ubuntu 22.10 - 6.0.9-060009-generic - GNOME Shell 43.0

3 Systems - 62 Benchmark Results

Apple M2 - Apple MacBook Air - 8GB

Arch rolling - 5.19.0-rc7-asahi-2-1-ARCH - KDE Plasma 5.25.4

Find More Test Results