Sockperf

This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark sockperf.

Project Site

docs.mellanox.com

Source Repository

github.com

Test Created

28 May 2018

Last Updated

16 November 2021

Test Maintainer

Michael Larabel

Test Type

Network

Average Install Time

3 Minutes, 22 Seconds

Average Run Time

2 Minutes, 2 Seconds

Test Dependencies

C/C++ Compiler Toolchain + PERL

Accolades

50k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 5 December 2022.

Revision History

pts/sockperf-1.1.0 [View Source] Tue, 16 Nov 2021 18:45:36 GMT
Update against Sockperf 3.7 upstream.

pts/sockperf-1.0.1 [View Source] Sun, 27 Sep 2020 13:53:10 GMT
Set as OS test type is more accurate.

pts/sockperf-1.0.0 [View Source] Mon, 28 May 2018 15:33:23 GMT
Initial commit of Mellanox Sockperf test profile, quite easy addition.

Suites Using This Test

Networking Test Suite

CPU Massive

Performance Metrics

Analyze Test Configuration:

Sockperf 3.4

Test: Throughput

OpenBenchmarking.org metrics for this test profile configuration based on 1,424 public results since 28 May 2018 with the latest data as of 16 July 2022.

Based on OpenBenchmarking.org data, the selected test / test configuration (Sockperf 3.4 - Test: Throughput) has an average run-time of 3 minutes. By default this test profile is set to run at least 5 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 2.8%.

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQU CVTSI2SD DIVSD SUBSD MULSD MOVDQA PUNPCKLQDQ MOVAPD ADDSD CVTTSD2SI UCOMISD MOVD COMISD PSHUFD SQRTSD

Advanced Vector Extensions (AVX)

Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VZEROUPPER VEXTRACTF128

FMA (FMA)

Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD231SD VFMADD132SD VFNMADD132SD

Advanced Vector Extensions 2 (AVX2)

Requires passing a supported compiler/build flag (verified with targets: tigerlake, cascadelake, sapphirerapids).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

VPBROADCASTQ

Advanced Vector Extensions 512 (AVX512)

Requires passing a supported compiler/build flag (verified with targets: cascadelake, sapphirerapids).

(ZMM REGISTER USE)

The test / benchmark does honor compiler flag changes.

Last automated analysis: 18 January 2022

This test profile binary relies on the shared libraries libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

IBM POWER (PowerPC) 64-bit

ppc64le

POWER9 altivec supported 44-Core

ARMv7 32-bit

armv7l

ARMv7 Cortex-A72 4-Core, ARMv7 rev 1 4-Core

ARMv8 64-bit

aarch64

ARMv8 Cortex-A72, ARMv8 Cortex-A72 2-Core, ARMv8 Cortex-A72 4-Core, ARMv8 Neoverse-N1 16-Core, ARMv8 Neoverse-N1 64-Core, ARMv8 rev 0 8-Core, ARMv8 rev 3 4-Core, SiFive RISC-V

OpenBSD Raptor Lake 1 System - 28 Benchmark Results	Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - 32GB OpenBSD - 7.2 - X Server
2022-11-29-1906 1 System - 3 Benchmark Results	Intel Core i5-10210U - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 5.15.0-53-generic - GNOME Shell 42.2
2022-11-29-1032 1 System - 3 Benchmark Results	Intel Core i5-10210U - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 5.15.0-53-generic - GNOME Shell 42.2
2022-11-22-1437 1 System - 3 Benchmark Results	Intel Core i5-10210U - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 5.15.0-53-generic - GNOME Shell 42.2
2022-11-22-1415 1 System - 3 Benchmark Results	Intel Core i5-10210U - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 5.15.0-53-generic - GNOME Shell 42.2
2022-11-22-1340 1 System - 3 Benchmark Results	Intel Core i5-10210U - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 22.04 - 5.15.0-53-generic - GNOME Shell 42.2
2022-11-22-1122 1 System - 3 Benchmark Results	2 x Intel Xeon Silver 4208 - Dell PowerEdge R740 [06WXJT] - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.4.0-128-generic - GNOME Shell 3.36.9
211122 1 System - 17 Benchmark Results	Intel Celeron N4000 - ASUS E203MAH v1.0 - Intel Gemini Lake Ubuntu 18.04 - 5.4.0-124-generic - GNOME Shell 3.28.4
211122 1 System - 16 Benchmark Results	Intel Celeron N4000 - ASUS E203MAH v1.0 - Intel Gemini Lake Ubuntu 18.04 - 5.4.0-124-generic - GNOME Shell 3.28.4
211122 1 System - 16 Benchmark Results	Intel Celeron N4000 - ASUS E203MAH v1.0 - Intel Gemini Lake Ubuntu 18.04 - 5.4.0-124-generic - GNOME Shell 3.28.4
609xanv3_Home 1 System - 109 Benchmark Results	Intel Core i9-12900K - ASUS PRIME Z690M-HZ - Intel Alder Lake-S PCH Debian - 6.0.9-x64v3-xanmod1 - Xfce 4.16
609xanv3_oldHome 1 System - 60 Benchmark Results	Intel Core i9-12900K - ASUS PRIME Z690M-HZ - Intel Alder Lake-S PCH Debian - 6.0.9-x64v3-xanmod1 - Xfce 4.16
centos76-aarch64-sockperf-testall 2 Systems - 3 Benchmark Results	Unknown - PowerLeader BC82AMDGK - Huawei HiSilicon CentOS Linux 7 - 4.14.0-115.el7a.0.1.aarch64 - GNOME Shell 3.28.3
centos76-aarch64-sockperf-testall 1 System - 3 Benchmark Results	Unknown - PowerLeader BC82AMDGK - Huawei HiSilicon CentOS Linux 7 - 4.14.0-115.el7a.0.1.aarch64 - GNOME Shell 3.28.3
centos76-aarch64-sockperf-testall 1 System - 3 Benchmark Results	Unknown - PowerLeader BC82AMDGK - Huawei HiSilicon CentOS Linux 7 - 4.14.0-115.el7a.0.1.aarch64 - GNOME Shell 3.28.3

test1 Featured Graphics Comparison	Intel Core i7-3770K - ASRock Z77 Professional - Intel Xeon E3-1200 v2 Ubuntu 18.10 - 4.18.0-15-generic - KDE Frameworks 5
test1 Featured Graphics Comparison	Intel Core i7-3770K - ASRock Z77 Professional - Intel Xeon E3-1200 v2 Ubuntu 18.10 - 5.0.0-rc7-custom - KDE Frameworks 5
MickMake NanoPC-T4 20180921 (default heatsink) 1 System - 1004 Benchmark Results	SiFive RISC-V - FriendlyElec NanoPC-T4 - Rockchip RK3399 Ubuntu 18.04 - 4.4.138 - LXDE 0.9.3
Core i9 10900K vs. Ryzen 9 3900X/3950X Linux Benchmarks Featured Processor Comparison	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.7.0-999-generic - GNOME Shell 3.36.1
i7-7700k-msi-z270 1 System - 748 Benchmark Results	Intel Core i7-7700K - MSI Z270 GAMING M7 - Intel Intel Kaby Lake + Z270 Ubuntu 18.04 - 4.15.0-23-generic - GNOME Shell 3.28.1
Core i7 3960X vs. AMD Ryzen 5 3600X vs. Core i7 8700K 4 Systems - 67 Benchmark Results	Intel Core i7-3960X - Intel DX79SI - Intel Xeon E5 Ubuntu 18.04 - 5.0.0-27-generic - GNOME Shell 3.28.4
3 Years CPU Security Mitigations 22 Systems - 46 Benchmark Results	Intel Core i7-8700K - ASUS TUF Z370-PLUS GAMING - Intel 8th Gen Core Ubuntu 20.10 - 5.10.4-051004-generic - GNOME Shell 3.38.1
Amazon Graviton2 vs. AMD EPYC 7742 3 Systems - 143 Benchmark Results	AMD EPYC 7742 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.4.0-31-generic - GNOME Shell 3.36.1
Linux Kernel Tuning -March= Patch Benchmarks 8 Systems - 79 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers Ubuntu 18.10 - 5.0.0-rc7-stock - GNOME Shell 3.30.1
Intel Xeon Ice Lake Mitigation Comparison 2 Systems - 46 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4
amitest20180601 2 Systems - 1813 Benchmark Results	Intel Xeon Platinum 8163 - Alibaba Cloud ECS - Intel 440FX- 82441FX PMC Amazon Linux 2 - 4.14.33-59.37.amzn2.x86_64 - GCC 7.3.1 20180303
Core i7 5600U Linux Laptop Spectre Meltdown ZombieLoad Featured Processor Comparison	Intel Core i7-5600U - LENOVO 20BSCTO1WW - Intel Broadwell-U-OPI Ubuntu 19.04 - 5.0.0-15-generic - GNOME Shell 3.32.0
AMD Ryzen 9 3900X + ASUS X570 AGESA ABBA Featured Motherboard Comparison	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 19.10 - 5.3.0-10-generic - GNOME Shell 3.34.0
Linux 5.0 Spectre Meltdown Benchmarks Intel/AMD 6 Systems - 57 Benchmark Results	Intel Core i9-7960X - MSI X299 SLI PLUS - Intel Sky Lake-E DMI3 Registers Ubuntu 18.10 - 5.0.0-999-generic - GNOME Shell 3.30.1
amitest20180601 3 Systems - 1847 Benchmark Results	Intel Xeon Platinum 8163 - Alibaba Cloud ECS - Intel 440FX- 82441FX PMC Amazon Linux 2 - 4.14.33-59.37.amzn2.x86_64 - GCC 7.3.1 20180303