NGINX Benchmark

This is a test of ab, which is the Apache Benchmark program running against nginx. This test profile measures how many requests per second a given system can sustain when carrying out 2,000,000 requests with 500 requests being carried out concurrently.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.net

Test Created

6 December 2010

Last Updated

12 June 2019

Test Maintainer

Pekka Panula 

Test Type

System

Average Install Time

1 Minute, 33 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib

Accolades

150k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2010.122011.042011.082011.122012.042012.082012.122013.042013.082013.122014.042014.082014.122015.042015.082015.122016.042016.082016.122017.042017.082017.122018.042018.082018.122019.042019.082019.122020.042020.082020.122021.0414K28K42K56K70K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 19 June 2021.
Sys32.4%Server67.6%Test Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

NGINX Benchmark 1.9.9

Static Web Page Serving

OpenBenchmarking.org metrics for this test profile configuration based on 40,319 public results since 8 January 2018 with the latest data as of 19 June 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Requests Per Second (Average)
100th
32
52137 +/- 2932
100th
11
51152 +/- 4373
100th
9
50169 +/- 559
100th
13
48952 +/- 6495
100th
13
48875 +/- 5602
100th
5
48718 +/- 6387
100th
7
47796 +/- 2400
100th
53
47620 +/- 3316
100th
12
46569 +/- 3529
100th
17
45930 +/- 2716
100th
56
45796 +/- 4258
100th
6
44583 +/- 154
100th
3
44322 +/- 3274
100th
3
44207 +/- 3592
100th
4
43223 +/- 5320
100th
18
42226 +/- 4799
100th
7
42158 +/- 3103
100th
29
42025 +/- 4819
100th
13
41186 +/- 4422
100th
4
40731 +/- 3390
100th
30
40413 +/- 3815
100th
41
39586 +/- 1710
99th
4
39311 +/- 119
99th
44
38965 +/- 2496
99th
3
38540 +/- 766
99th
3
38074 +/- 2989
99th
7
37840 +/- 5420
99th
31
37778 +/- 2597
99th
5
37753 +/- 3348
99th
18
37154 +/- 3690
99th
8
36508 +/- 193
99th
15
35984 +/- 3165
99th
54
35848 +/- 2473
99th
13
35769 +/- 2756
99th
56
35237 +/- 709
99th
7
35145 +/- 1526
99th
33
34868 +/- 2379
98th
7
34396 +/- 3302
98th
4
33935 +/- 4293
98th
5
33487 +/- 706
98th
36
33432 +/- 1400
98th
14
32767 +/- 3283
98th
55
32692 +/- 3330
98th
10
32609 +/- 518
98th
6
31259 +/- 1519
98th
6
31042 +/- 1571
97th
3
30732 +/- 1818
97th
4
30692 +/- 1256
97th
17
30568 +/- 3592
97th
42
30330 +/- 1538
97th
10
30219 +/- 2490
97th
6
30104 +/- 3883
97th
20
29718 +/- 2628
97th
14
29159 +/- 884
97th
3
28964 +/- 4293
97th
19
28247 +/- 2611
97th
4
27864 +/- 388
97th
14
27858 +/- 2605
97th
38
27464 +/- 3393
97th
28
27303 +/- 3557
96th
12
27211 +/- 2042
96th
3
26983 +/- 3801
95th
3
26050 +/- 84
95th
11
26018 +/- 1942
95th
24
25845 +/- 3509
94th
3
24681 +/- 2038
94th
3
24361 +/- 2344
94th
4
23904 +/- 284
94th
159
23862 +/- 2364
94th
27
23834 +/- 3123
94th
8
23506 +/- 1654
94th
14
23217 +/- 2153
94th
13
23029 +/- 1649
94th
29
22926 +/- 2271
94th
6
22215 +/- 365
94th
4
22172 +/- 486
93rd
4
21220 +/- 1257
93rd
16
20957 +/- 2212
93rd
3
20627 +/- 563
93rd
3
20574 +/- 1198
93rd
4
20403 +/- 2720
93rd
19
20137 +/- 1771
93rd
4
19925 +/- 21
93rd
3
19909 +/- 162
93rd
23
19827 +/- 1623
93rd
6
19326 +/- 2286
93rd
3
19223 +/- 702
93rd
18
18982 +/- 1327
93rd
9
18660 +/- 351
93rd
5
18556 +/- 130
93rd
22
18384 +/- 781
92nd
159
17198 +/- 667
91st
4
16997 +/- 268
90th
3
15215 +/- 1180
90th
9
12648 +/- 1067
89th
13
11337 +/- 794
88th
3
10334 +/- 49
88th
5
9925 +/- 740
88th
11
9719 +/- 153
Mid-Tier
75th
< 6589
4th
19
5101 +/- 678
Low-Tier
25th
< 5504
2nd
8
4045 +/- 40
2nd
3
480 +/- 20
OpenBenchmarking.orgDistribution Of Public Results - Static Web Page Serving40319 Results Range From 306 To 99720 Requests Per Second3062295428462738262102511224014229162181820720196221852417426163281523014132130341193610838097400864207544064460534804250031520205400955998579875997661965639546594367932699217191073899758887787779866818558384485833878228981191800937899577897767997566K12K18K24K30K

Based on OpenBenchmarking.org data, the selected test / test configuration (NGINX Benchmark 1.9.9 - Static Web Page Serving) has an average run-time of 17 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkStatic Web Page ServingRun-Time1122334455Min: 1 / Avg: 16.44 / Max: 57

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsStatic Web Page ServingDeviation246810Min: 0 / Avg: 0.32 / Max: 3

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNGINX Benchmark CPU Core ScalingStatic Web Page Serving24681216202432400.69791.39582.09372.79163.4895

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD DIVSD UCOMISD COMISD MULSD MOVAPD SUBSD ADDSD XORPD SQRTSD CVTTSD2SI ANDPD MOVDQU MOVDQA
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VINSERTF128 VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERMQ VEXTRACTI128 VPERM2I128 VINSERTI128
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD231SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 10 Benchmark Results

Intel Xeon Platinum 8369B - Alibaba Cloud ECS - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-74-generic - GCC 9.3.0

1 System - 10 Benchmark Results

Intel Xeon Platinum 8275CL - Amazon EC2 c5.2xlarge - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.8.0-1035-aws - GCC 9.3.0

3 Systems - 10 Benchmark Results

Intel Xeon Platinum 8369B - Alibaba Cloud ECS - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-74-generic - GCC 9.3.0

2 Systems - 10 Benchmark Results

Intel Xeon Platinum 8369B - Alibaba Cloud ECS - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-74-generic - GCC 9.3.0

1 System - 10 Benchmark Results

Intel Xeon Platinum 8369B - Alibaba Cloud ECS - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-74-generic - GCC 9.3.0

7 Systems - 28 Benchmark Results

ARMv8 Cortex-A53 - Libre Board ALL-H3-CC H5 - 2048MB

Raspbian 9.6 - 4.18.0-rc3-gfc36def997cf-dirty - X Server 1.19.2

3 Systems - 103 Benchmark Results

Intel Xeon Gold 6238R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

CentOS Linux 8 - 4.18.0-305.3.1.el8.x86_64 - GCC 8.4.1 20200928

8 Systems - 195 Benchmark Results

AMD EPYC - Hetzner vServer v20171111 - 1 x 8000 MB RAM QEMU

Debian 10 - 4.19.0-16-amd64 - GCC 8.3.0

1 System - 56 Benchmark Results

2 x Intel Xeon E5-2640 v4 - Supermicro X10DRG-O+-CPU v1.00 - Intel Xeon E7 v4

Ubuntu 16.04 - 4.15.0-142-generic - X Server 1.19.6

7 Systems - 195 Benchmark Results

AMD EPYC - Hetzner vServer v20171111 - 1 x 8000 MB RAM QEMU

Debian 11 - 5.12.8-051208-generic - GCC 10.2.1 20210110

10 Systems - 16 Benchmark Results

Intel Core i3-3110M - LENOVO 20236 Lenovo G500 - Intel 3rd Gen Core DRAM

FreeBSD - 13.0-RELEASE - MATE 1.24.1

6 Systems - 195 Benchmark Results

AMD EPYC - Hetzner vServer v20171111 - 1 x 8000 MB RAM QEMU

Debian 11 - 5.12.8-051208-lowlatency - GCC 10.2.1 20210110

Most Popular Test Results

OpenBenchmarking.org Results Compare

1 System - 1269 Benchmark Results

Intel Core i5-4570 - ASRock Z87 Extreme4 - Intel 4th Gen Core DRAM

Ubuntu 18.04 - 4.15.0-20-generic - GNOME Shell 3.28.1

2 Systems - 178 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

14 Systems - 22 Benchmark Results

Intel Xeon E5-2687W v3 - MSI X99S SLI PLUS - Intel Xeon E7 v3

Ubuntu 18.04 - 4.19.0-041900rc1-generic - GNOME Shell 3.28.2

3 Systems - 301 Benchmark Results

Intel Core i5-4670 - MSI B85M-P33 - Intel 4th Gen Core DRAM

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3

6 Systems - 20 Benchmark Results

Intel Xeon E3-1280 v5 - MSI C236A WORKSTATION - Intel Skylake

Ubuntu 17.10 - 4.14.0-041400-generic - GNOME Shell 3.26.2

3 Systems - 182 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

7 Systems - 28 Benchmark Results

ARMv8 Cortex-A53 - Libre Board ALL-H3-CC H5 - 2048MB

Raspbian 9.6 - 4.18.0-rc3-gfc36def997cf-dirty - X Server 1.19.2

6 Systems - 45 Benchmark Results

4 x Intel Xeon (Skylake) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.15.0-88-generic - ext4

12 Systems - 48 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD Device 1450

Ubuntu 16.04 - 4.13.0-39-generic - Unity 7.4.5

1 System - 248 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.3

5 Systems - 75 Benchmark Results

AMD Ryzen 5 PRO 4650G - ASUS TUF X470-PLUS GAMING - AMD Renoir Root Complex

Gentoo - 5.11.8-gentoo-r1 - GCC 10.2.0

Find More Test Results