Apache Siege

This is a test of the Apache web server performance being facilitated by the Siege web server benchmark program.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark apache-siege.

Project Site

joedog.org

Test Created

29 July 2018

Last Updated

11 December 2020

Test Maintainer

Michael Larabel 

Test Type

System

Test Dependencies

C/C++ Compiler Toolchain + PERL + Perl Compatible Regular Expressions + OpenSSL + Expat XML Parser Library

Accolades

50k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsApache Siege Popularity Statisticspts/apache-siege2018.072018.082018.092018.102018.112018.122019.012019.022019.032019.042019.052019.062019.072019.082019.092019.102019.112019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.112020.122021.012021.022021.032021.049K18K27K36K45K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Mon, 12 Apr 2021 06:38:43 GMT.
5013.2%20019.6%10015.3%25033.0%1012.2%16.7%Concurrent Users Option PopularityOpenBenchmarking.org

Revision History

pts/apache-siege-1.0.5   [View Source]   Fri, 11 Dec 2020 11:05:10 GMT
BSD build fix via https://github.com/apurvanandan1997/pts-test-profiles-dev/commit/00997d16bb4fe34cbd717e8d98d2e39ad54e795d#diff-143fbe9705f52c93bb44c2f83720d9648349060057dcfa046f91f3d04b6df6ab

pts/apache-siege-1.0.4   [View Source]   Fri, 31 May 2019 18:17:44 GMT
Specify log file argument to log in current directory, avoid situation like https://github.com/phoronix-test-suite/test-profiles/issues/77

pts/apache-siege-1.0.3   [View Source]   Fri, 31 May 2019 18:09:47 GMT
Add expat as possible external dependency - https://github.com/phoronix-test-suite/test-profiles/issues/82

pts/apache-siege-1.0.2   [View Source]   Sun, 29 Jul 2018 18:57:33 GMT
Don't spew so much unneeded information to the log file as was getting 100MB+ logs with intensive tests.

pts/apache-siege-1.0.1   [View Source]   Sun, 29 Jul 2018 18:08:19 GMT
Ensure siege.config is generated.

pts/apache-siege-1.0.0   [View Source]   Sun, 29 Jul 2018 17:22:54 GMT
Add an additional Apache HTTPD benchmark profile, this one allows multi-threaded testing using Siege.

Suites Using This Test

Server

CPU Massive

Server CPU Tests


Performance Metrics

Analyze Test Configuration:

Apache Siege 2.4.29

Concurrent Users: 250

OpenBenchmarking.org metrics for this test profile configuration based on 2,041 public results since 29 July 2018 with the latest data as of 1 April 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Transactions Per Second (Average)
100th
5
123263 +/- 4142
100th
8
103748 +/- 1785
98th
3
78552 +/- 149
97th
3
68488 +/- 4880
95th
4
60636 +/- 3365
94th
4
55213 +/- 2392
91st
3
44000 +/- 697
88th
21
40116 +/- 5249
85th
6
37384 +/- 5169
85th
12
37217 +/- 1300
85th
13
37033 +/- 5178
83rd
4
36072 +/- 3888
83rd
8
35678 +/- 2576
81st
14
34698 +/- 2512
81st
3
34676 +/- 383
80th
39
34622 +/- 2938
Mid-Tier
75th
< 34017
73rd
3
33412 +/- 678
72nd
4
32801 +/- 3471
70th
7
31366 +/- 1424
57th
8
22639 +/- 2212
57th
5
22323 +/- 1471
Median
50th
10034
Low-Tier
25th
< 4992
14th
3
3870 +/- 217
OpenBenchmarking.orgDistribution Of Public Results - Concurrent Users: 2502031 Results Range From 1244 To 145908 Transactions Per Second12444138703299261282015714186082150224396272903018433078359723886641760446544754850442533365623059124620186491267806707007359476488793828227685170880649095893852967469964010253410542810832211121611411011700411989812279212568612858013147413436813726214015614305014594480160240320400

Based on OpenBenchmarking.org data, the selected test / test configuration (Apache Siege 2.4.29 - Concurrent Users: 250) has an average run-time of 21 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkConcurrent Users: 250Run-Time20406080100Min: 1 / Avg: 20.6 / Max: 100

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 8.9%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsConcurrent Users: 250Deviation20406080100Min: 0 / Avg: 8.87 / Max: 113

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
CVTSS2SD CVTSI2SD DIVSD MULSD MOVDQA CVTTSD2SI COMISD ADDSD CVTSD2SS MOVDQU MOVD
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER VINSERTF128 VEXTRACTF128
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERM2I128 VPBROADCASTQ
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD213SD VFMADD132SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libpthread.so.0, libdl.so.2, libssl.so.1.1, libcrypto.so.1.1, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 115 Benchmark Results

Intel Xeon E3-1225 v6 - (2.002 BIOS) - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.4.0-70-generic - 1.2.145

1 System - 115 Benchmark Results

Intel Xeon E3-1225 v5 - INTEL H110 - Intel Xeon E3-1200 v5

Ubuntu 20.04 - 5.4.0-66-generic - 1.2.145

1 System - 108 Benchmark Results

2 x Intel Xeon Gold 5218R - Supermicro X11DPX-T - Intel Device 2020

Ubuntu 16.04 - 4.15.0-140-generic - Unity 7.4.0

1 System - 212 Benchmark Results

Intel Core i5-8250U - LENOVO 20L7CTO1WW - Intel Xeon E3-1200 v6

Debian testing - 5.10.0-5-amd64 - GNOME Shell 3.38.4

1 System - 272 Benchmark Results

1 System - 272 Benchmark Results

4 Systems - 23 Benchmark Results

2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Clear Linux OS 34420 - 5.10.19-1032.native - GNOME Shell 3.38.4

1 System - 87 Benchmark Results

2 x Intel Xeon E5-2680 0 - Cisco UCSC-C220-M3S - Intel Xeon E5

CentOS 7.9.2009 - 3.10.0-1160.6.1.el7.x86_64 - X Server

1 System - 107 Benchmark Results

2 x Intel Xeon Gold 6240 - Intel 440BX - Intel 440BX

OracleServer 8.3 - 5.4.17-2036.104.4.el8uek.x86_64 - vmware

1 System - 119 Benchmark Results

2 x Intel Xeon E5-2680 v3 - Cisco UCSB-B200-M4 - Intel Xeon E7 v3

OracleServer 7.9 - 5.4.17-2011.6.2.el7uek.x86_64 - matrox

1 System - 94 Benchmark Results

2 x Intel Xeon Gold 6240 - Intel 440BX - Intel 440BX

Amazon Linux 2 - 4.14.214-160.339.amzn2.x86_64 - vmware

1 System - 119 Benchmark Results

2 x Intel Xeon E5-2680 v3 - Cisco UCSB-B200-M4 - Intel Xeon E7 v3

OracleServer 7.9 - 5.4.17-2011.6.2.el7uek.x86_64 - matrox

Most Popular Test Results

OpenBenchmarking.org Results Compare

1 System - 248 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.3

2 Systems - 123 Benchmark Results

Intel Core i7-8700K - ASUS TUF Z370-PLUS GAMING - Intel 8th Gen Core

ManjaroLinux 18.0.4 - 4.19.49-1-MANJARO - Xfce 4.13

6 Systems - 104 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2

1 System - 263 Benchmark Results

AMD Ryzen 7 3700X 8-Core - MSI MEG X570 GODLIKE - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.4

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

2 Systems - 475 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 19.10 - 5.3.0-40-generic - GNOME Shell 3.34.1

8 Systems - 79 Benchmark Results

Intel Core i7-8086K - ASUS PRIME Z370-A - Intel 8th Gen Core

Ubuntu 18.10 - 5.0.0-rc7-skylake - GNOME Shell 3.30.1

3 Systems - 579 Benchmark Results

Intel Atom C3338 - AMI Aptio CRB - Intel Device 1980

Ubuntu 18.04 - 4.15.0-52-generic - GCC 7.4.0

Find More Test Results