NGINX Benchmark

This is a test of ab, which is the Apache Benchmark program running against nginx. This test profile measures how many requests per second a given system can sustain when carrying out 2,000,000 requests with 500 requests being carried out concurrently.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.net

Test Created

6 December 2010

Last Updated

12 June 2019

Test Maintainer

Pekka Panula 

Test Type

System

Average Install Time

1 Minute, 33 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib

Accolades

150k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2011.052011.092012.012012.052012.092013.012013.052013.092014.012014.052014.092015.012015.052015.092016.012016.052016.092017.012017.052017.092018.012018.052018.092019.012019.052019.092020.012020.052020.092021.012021.0514K28K42K56K70K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Mon, 10 May 2021 15:33:18 GMT.
Sys32.4%Server67.6%Test Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

NGINX Benchmark 1.9.9

Static Web Page Serving

OpenBenchmarking.org metrics for this test profile configuration based on 11,618 public results since 8 January 2018 with the latest data as of 10 May 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Requests Per Second (Average)
100th
32
52137 +/- 2932
100th
11
51152 +/- 4373
100th
9
50169 +/- 559
100th
13
48952 +/- 6495
100th
13
48875 +/- 5602
100th
5
48718 +/- 6387
99th
7
47796 +/- 2400
99th
53
47620 +/- 3316
99th
12
46569 +/- 3529
99th
17
45930 +/- 2716
99th
56
45796 +/- 4258
98th
6
44583 +/- 154
98th
3
44322 +/- 3274
98th
3
44207 +/- 3592
98th
4
43223 +/- 5320
97th
18
42226 +/- 4799
97th
7
42158 +/- 3103
97th
29
42025 +/- 4819
97th
13
41186 +/- 4422
96th
4
40731 +/- 3390
96th
30
40413 +/- 3815
96th
41
39586 +/- 1710
96th
4
39311 +/- 119
95th
44
38965 +/- 2496
95th
3
38540 +/- 766
95th
3
38074 +/- 2989
95th
7
37840 +/- 5420
95th
31
37778 +/- 2597
95th
5
37753 +/- 3348
94th
18
37154 +/- 3690
94th
8
36508 +/- 193
94th
15
35984 +/- 3165
94th
54
35848 +/- 2473
94th
13
35769 +/- 2756
93rd
7
35145 +/- 1526
93rd
33
34868 +/- 2379
93rd
13
34708 +/- 1441
92nd
7
34396 +/- 3302
92nd
4
33935 +/- 4293
92nd
5
33487 +/- 706
92nd
36
33432 +/- 1400
91st
14
32767 +/- 3283
91st
55
32692 +/- 3330
91st
10
32609 +/- 518
90th
6
31259 +/- 1519
90th
6
31042 +/- 1571
89th
3
30732 +/- 1818
89th
4
30692 +/- 1256
89th
17
30568 +/- 3592
89th
42
30330 +/- 1538
89th
10
30219 +/- 2490
89th
6
30104 +/- 3883
88th
20
29718 +/- 2628
88th
14
29159 +/- 884
88th
3
28964 +/- 4293
87th
19
28247 +/- 2611
87th
4
27864 +/- 388
87th
14
27858 +/- 2605
87th
38
27464 +/- 3393
86th
28
27303 +/- 3557
86th
12
27211 +/- 2042
86th
3
26983 +/- 3801
83rd
3
26050 +/- 84
83rd
11
26018 +/- 1942
82nd
24
25845 +/- 3509
80th
3
24681 +/- 2038
80th
3
24361 +/- 2344
80th
4
23904 +/- 284
80th
30
23862 +/- 2397
80th
27
23834 +/- 3123
79th
8
23506 +/- 1654
79th
14
23217 +/- 2153
79th
13
23029 +/- 1649
79th
29
22926 +/- 2271
78th
6
22215 +/- 365
78th
4
22172 +/- 486
77th
4
21220 +/- 1257
77th
16
20957 +/- 2212
77th
3
20627 +/- 563
77th
3
20574 +/- 1198
77th
4
20403 +/- 2720
77th
19
20137 +/- 1771
76th
4
19925 +/- 21
76th
3
19909 +/- 162
76th
23
19827 +/- 1623
76th
6
19326 +/- 2286
76th
3
19223 +/- 702
76th
18
18982 +/- 1327
Mid-Tier
75th
< 18832
75th
9
18660 +/- 351
75th
5
18556 +/- 130
75th
22
18384 +/- 781
73rd
30
17198 +/- 676
72nd
4
16997 +/- 268
69th
3
15215 +/- 1180
68th
9
12648 +/- 1067
67th
13
11337 +/- 794
66th
3
10334 +/- 49
66th
5
9925 +/- 740
66th
11
9719 +/- 153
Median
50th
6446
9th
19
5101 +/- 678
Low-Tier
25th
< 5529
3rd
8
4045 +/- 40
2nd
3
480 +/- 20
OpenBenchmarking.orgDistribution Of Public Results - Static Web Page Serving10948 Results Range From 306 To 99720 Requests Per Second30622954284627382621025112240142291621818207201962218524174261632815230141321303411936108380974008642075440644605348042500315202054009559985798759976619656395465943679326992171910738997588877877798668185583844858338782289811918009378995778977679975610002000300040005000

Based on OpenBenchmarking.org data, the selected test / test configuration (NGINX Benchmark 1.9.9 - Static Web Page Serving) has an average run-time of 14 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkStatic Web Page ServingRun-Time1530456075Min: 1 / Avg: 13.83 / Max: 81

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.5%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsStatic Web Page ServingDeviation246810Min: 0 / Avg: 0.53 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNGINX Benchmark CPU Core ScalingStatic Web Page Serving24681216202432400.69581.39162.08742.78323.479

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD DIVSD UCOMISD COMISD MULSD MOVAPD SUBSD ADDSD XORPD SQRTSD CVTTSD2SI ANDPD MOVDQU MOVDQA
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VINSERTF128 VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERMQ VEXTRACTI128 VPERM2I128 VINSERTI128
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD231SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

4 Systems - 159 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - ASRock X370 Gaming X - AMD 17h

Arch rolling - 5.11.16-arch1-1 - Xfce 4.16

1 System - 1 Benchmark Result

ARMv7 rev 4 - BCM2835 Raspberry Pi 3 Model B Plus Rev 1.3 - 924MB

Raspbian 10 - 5.10.17-v7+ - LXDE

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

1 System - 1269 Benchmark Results

Intel Core i5-4570 - ASRock Z87 Extreme4 - Intel 4th Gen Core DRAM

Ubuntu 18.04 - 4.15.0-20-generic - GNOME Shell 3.28.1

2 Systems - 178 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

14 Systems - 22 Benchmark Results

64 x Intel Xeon (Skylake IBRS) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.19.0-041900rc1-generic - GNOME Shell 3.28.2

3 Systems - 301 Benchmark Results

Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3

1 System - 248 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.3

6 Systems - 45 Benchmark Results

4 x Intel Xeon E312xx (Sandy Bridge) - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.15.0-88-generic - ext4

5 Systems - 1840 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

6 Systems - 20 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Device 2020

Ubuntu 17.10 - 4.14.0-phx-retpoline-gcc-retpo - GNOME Shell 3.26.1

7 Systems - 28 Benchmark Results

ARMv7 rev 3 - BCM2835 Raspberry Pi 4 Model B Rev 1.1 - 4096MB

Raspbian 10 - 4.19.50-v7l+ - LXDE 0.10.0

12 Systems - 48 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD Device 1450

Ubuntu 16.04 - 4.13.0-39-generic - Unity 7.4.5

3 Systems - 182 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - ASUS ROG STRIX X399-E GAMING - AMD Device 1450

Ubuntu 17.10 - 4.13.0-32-generic - KDE Frameworks 5

Find More Test Results