NGINX Benchmark

This is a test of ab, which is the Apache Benchmark program running against nginx. This test profile measures how many requests per second a given system can sustain when carrying out 2,000,000 requests with 500 requests being carried out concurrently.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark nginx.

Project Site

nginx.net

Test Created

6 December 2010

Last Updated

12 June 2019

Test Maintainer

Pekka Panula 

Test Type

System

Average Install Time

1 Minute, 36 Seconds

Average Run Time

4 Minutes, 7 Seconds

Test Dependencies

C/C++ Compiler Toolchain + Zlib

Accolades

150k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsNGINX Benchmark Popularity Statisticspts/nginx2011.022011.062011.102012.022012.062012.102013.022013.062013.102014.022014.062014.102015.022015.062015.102016.022016.062016.102017.022017.062017.102018.022018.062018.102019.022019.062019.102020.022020.062020.102021.0213K26K39K52K65K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sun, 28 Feb 2021 06:52:54 GMT.
Sys32.4%Server67.6%Test Option PopularityOpenBenchmarking.org

Revision History

pts/nginx-1.2.2   [View Source]   Wed, 12 Jun 2019 08:03:17 GMT
Fixes for newer distros like RHEL8 - https://github.com/phoronix-test-suite/test-profiles/pull/84

pts/nginx-1.2.1   [View Source]   Fri, 02 Mar 2018 11:01:40 GMT
Add initial Windows support.

pts/nginx-1.2.0   [View Source]   Mon, 08 Jan 2018 10:30:06 GMT
Update against upstream nginx 1.9.9, increase workload size.

pts/nginx-1.1.0   [View Source]   Sun, 29 Jan 2012 14:40:36 GMT
Update against upstream NGINX 1.0.11 web-server release.

pts/nginx-1.0.0   [View Source]   Mon, 06 Dec 2010 15:00:01 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

C/C++ Compiler Tests

Server

CPU Massive

Single-Threaded


Performance Metrics

Analyze Test Configuration:

NGINX Benchmark 1.9.9

Static Web Page Serving

OpenBenchmarking.org metrics for this test profile configuration based on 5,883 public results since 8 January 2018 with the latest data as of 28 February 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Requests Per Second (Average)
97th
30
52551 +/- 2253
97th
11
51152 +/- 4373
96th
9
50169 +/- 559
95th
13
48952 +/- 6495
95th
13
48875 +/- 5602
95th
5
48718 +/- 6387
95th
7
47796 +/- 2400
95th
53
47620 +/- 3316
94th
12
46569 +/- 3529
94th
17
45930 +/- 2716
94th
56
45796 +/- 4258
93rd
6
44583 +/- 154
93rd
3
44322 +/- 3274
91st
4
43223 +/- 5320
90th
18
42226 +/- 4799
90th
7
42158 +/- 3103
90th
29
42025 +/- 4819
89th
13
41186 +/- 4422
89th
4
40731 +/- 3390
89th
30
40413 +/- 3815
88th
41
39586 +/- 1710
87th
4
39311 +/- 119
87th
44
38965 +/- 2496
87th
3
38540 +/- 766
86th
3
38074 +/- 2989
86th
7
37840 +/- 5420
86th
31
37778 +/- 2597
86th
5
37753 +/- 3348
85th
18
37154 +/- 3690
84th
8
36508 +/- 193
84th
14
35984 +/- 3165
83rd
54
35848 +/- 2473
83rd
13
35769 +/- 2756
82nd
7
35145 +/- 1526
82nd
33
34868 +/- 2379
81st
7
34396 +/- 3302
81st
4
33935 +/- 4293
80th
5
33487 +/- 706
80th
36
33432 +/- 1400
79th
14
32767 +/- 3283
79th
55
32692 +/- 3330
79th
10
32609 +/- 518
77th
4
32035 +/- 2604
76th
6
31259 +/- 1519
76th
6
31042 +/- 1571
76th
4
30692 +/- 1256
Mid-Tier
75th
< 30643
75th
17
30568 +/- 3592
75th
42
30330 +/- 1538
75th
10
30219 +/- 2490
75th
6
30104 +/- 3883
74th
20
29718 +/- 2628
73rd
14
29159 +/- 884
72nd
3
28964 +/- 4293
71st
19
28247 +/- 2611
71st
4
27864 +/- 388
71st
14
27858 +/- 2605
70th
38
27464 +/- 3393
70th
28
27303 +/- 3557
70th
12
27211 +/- 2042
68th
3
26050 +/- 84
68th
11
26018 +/- 1942
67th
24
25845 +/- 3509
63rd
3
24681 +/- 2038
62nd
3
24361 +/- 2344
62nd
4
23904 +/- 284
62nd
180
23862 +/- 2363
61st
27
23834 +/- 3123
61st
8
23506 +/- 1654
60th
14
23217 +/- 2153
60th
13
23029 +/- 1649
60th
29
22926 +/- 2271
58th
4
21220 +/- 1257
57th
16
20957 +/- 2212
56th
3
20627 +/- 563
56th
3
20574 +/- 1198
54th
4
20403 +/- 2720
54th
19
20137 +/- 1771
54th
4
19925 +/- 21
54th
3
19909 +/- 162
53rd
23
19827 +/- 1623
53rd
6
19326 +/- 2286
53rd
3
19223 +/- 702
52nd
18
18982 +/- 1327
52nd
9
18660 +/- 351
51st
5
18556 +/- 130
51st
22
18384 +/- 781
Median
50th
18138
46th
180
17198 +/- 666
39th
3
15215 +/- 1180
36th
9
12648 +/- 1067
32nd
13
11337 +/- 794
28th
3
10334 +/- 49
27th
5
9925 +/- 740
27th
11
9719 +/- 153
Low-Tier
25th
< 8467
8th
19
5101 +/- 678
4th
8
4045 +/- 40
2nd
3
480 +/- 20
OpenBenchmarking.orgDistribution Of Public Results - Static Web Page Serving5592 Results Range From 306 To 99720 Requests Per Second306229542846273826210251122401422916218182072019622185241742616328152301413213034119361083809740086420754406446053480425003152020540095599857987599766196563954659436793269921719107389975888778777986681855838448583387822898119180093789957789776799756130260390520650

Based on OpenBenchmarking.org data, the selected test / test configuration (NGINX Benchmark 1.9.9 - Static Web Page Serving) has an average run-time of 8 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkStatic Web Page ServingRun-Time20406080100Min: 1 / Avg: 8.19 / Max: 104

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.7%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsStatic Web Page ServingDeviation3691215Min: 0 / Avg: 0.71 / Max: 7

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseNGINX Benchmark CPU Core ScalingStatic Web Page Serving2468121620320.76081.52162.28243.04323.804

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSI2SD DIVSD UCOMISD MULSD MOVAPD SUBSD ADDSD COMISD XORPD SQRTSD CVTTSD2SI ANDPD MOVDQA MOVDQU
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VINSERTF128 VEXTRACTF128 VZEROUPPER
Requires passing a supported compiler/build flag (verified with targets: skylake, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VINSERTI128 VPERMQ VEXTRACTI128 VPERM2I128
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD231SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libm.so.6, libexpat.so.1, libuuid.so.1, librt.so.1, libcrypt.so.1, libpthread.so.0, libdl.so.2, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 14 Benchmark Results

2 x Intel Core - OpenStack Foundation Nova v14.1.1 - Intel 440FX 82441FX PMC

Ubuntu 20.10 - 5.8.0-41-generic - GCC 10.2.0

1 System - 14 Benchmark Results

Intel Xeon E5-2650 v4 - DigitalOcean Droplet v20171212 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-60-generic - GCC 9.3.0

1 System - 13 Benchmark Results

Intel Xeon E5-2680 v2 - Red Hat KVM - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-20-generic - GCC 7.5.0

1 System - 14 Benchmark Results

Intel Xeon Silver 4214 - 1024MB - 20GB

Ubuntu 20.04 - 5.4.0 - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon E5-2690 0 - 4096MB - 59GB

Ubuntu 20.04 - 3.10.0-1127.8.2.vz7.151.14 - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon E3-12xx v2 - RDO OpenStack Compute - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-65-generic - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon Gold 6140 - DigitalOcean Droplet v20171212 - Intel 440FX 82441FX PMC

Ubuntu 20.10 - 5.8.0-25-generic - GCC 10.2.0

1 System - 14 Benchmark Results

AMD EPYC 7702P 64-Core - netcup KVM Server - Intel 440FX 82441FX PMC

Debian 10 - 4.19.0-14-amd64 - GCC 8.3.0

1 System - 14 Benchmark Results

Intel Xeon - Hetzner vServer v20171111 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-54-generic - GCC 9.3.0

1 System - 14 Benchmark Results

2 x Intel Core - OpenStack Foundation Nova v14.1.1 - Intel 440FX 82441FX PMC

Ubuntu 20.10 - 5.8.0-41-generic - GCC 10.2.0

1 System - 14 Benchmark Results

2 x Intel Xeon E312xx - QEMU Standard PC - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-64-generic - GCC 9.3.0

1 System - 14 Benchmark Results

Intel Xeon E5-2650 v4 - DigitalOcean Droplet v20171212 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-60-generic - GCC 9.3.0

Most Popular Test Results

OpenBenchmarking.org Results Compare

2 Systems - 178 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

14 Systems - 22 Benchmark Results

2 x Intel Xeon Gold 6138 - TYAN S7106 - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.19.0-041900rc1-generic - GNOME Shell 3.28.2

3 Systems - 301 Benchmark Results

Intel Core i5-4670 - MSI B85M-P33 - Intel 4th Gen Core DRAM

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3

1 System - 248 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.3

5 Systems - 1840 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

6 Systems - 45 Benchmark Results

4 x QEMU Virtual 2.5+ - QEMU Standard PC - Intel 440FX- 82441FX PMC

Ubuntu 18.04 - 4.15.0-88-generic - ext4

6 Systems - 20 Benchmark Results

Intel Xeon E3-1280 v5 - MSI C236A WORKSTATION - Intel Skylake

Ubuntu 17.10 - 4.14.0-041400-generic - GNOME Shell 3.26.2

12 Systems - 48 Benchmark Results

Intel Core i7-6800K - MSI X99A WORKSTATION - Intel Xeon E7 v4

Ubuntu 16.04 - 4.13.0-39-generic - Unity 7.4.5

7 Systems - 28 Benchmark Results

ARMv7 rev 3 - BCM2835 Raspberry Pi 4 Model B Rev 1.1 - 4096MB

Raspbian 10 - 4.19.50-v7l+ - LXDE 0.10.0

5 Systems - 1839 Benchmark Results

Intel Core i5-6200U - HP 8079 - Intel Xeon E3-1200 v5

Ubuntu 18.04 - 4.18.0-21-generic - GNOME Shell 3.28.4

3 Systems - 182 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment