New Round Windows Network Tests

2 x Intel Xeon Gold 6138 testing with a TYAN S7106 (V1.02.B20 BIOS) and ASPEED Family on Debian 9.6 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1901239-SP-1901226SP47&grr&sro.

ProcessorMotherboardMemoryDiskGraphicsNetworkChipsetMonitorOSKernelDisplay DriverCompilerFile-SystemScreen ResolutionDesktopDisplay ServerOpenGLIntel I210ConnectXIntel I210ConnectXIntel I210ConnectXIntel I210 Windows 2016 Windows 2016 Windows 2019 Windows 2019 FreeBSD 12 FreeBSD 12 Ubuntu 18.04 Ubuntu 18.04 Debian 9.6 Debian 9.62 x Intel Xeon Gold 6138 @ 2.00GHz (40 Cores / 80 Threads)TYAN S710612 x 8192 MB 2666MHz Micron 9ASF1G72PZ-2G6B1233GB Samsung SSD 970 EVO 250GBMicrosoft Basic DisplayIntel I210 Gigabit Connection + Intel I210 Gigabit Connection #2Microsoft Windows Server 2016 Essentials Build 1439310.0 (x86_64)10.0.14393.0GCC 7.1.0NTFS1024x768Intel I210 Gigabit Connection + Intel I210 Gigabit Connection #2 + Microsoft ISATAPIntel I210 Gigabit Connection + Intel I210 Gigabit Connection #2Microsoft Windows Server 2019 Essentials Build 1776310.0.17763.1Intel Xeon Gold 6138 @ 2.00GHz (80 Cores)TYAN B7106G24EV4HRIntel Sky Lake-E DMI3 Registers97024MBGeneric NVMe DeviceASPEED FamilyFreeBSD12.0-RELEASE (x86_64)Clang 6.0.1 (SVN 335540)zfs800x6002 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106 (V1.02.B20 BIOS)96256MBSamsung SSD 970 EVO 250GBVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE + Mellanox MT26448Ubuntu 18.044.15.0-43-generic (x86_64)GNOME Shell 3.28.3X Server 1.19.6modesetting 1.19.63.3 Mesa 18.0.5 (LLVM 6.0 256 bits)GCC 7.3.0ext41920x1080llvmpipe 93GBIntel Device 202012 x 8192 MB DDR4-2666MHz Micron 9ASF1G72PZ-2G6B1LLVMpipeDebian 9.64.9.0-8-amd64 (x86_64)GNOME Shell 3.22.3X Server 1.19.23.3 Mesa 13.0.6 Gallium 0.4 (LLVM 3.9 256 bits)GCC 6.3.0 201705161024x768OpenBenchmarking.orgSecurity Details- Intel I210: FreeBSD 12: KPTI- ConnectX: FreeBSD 12: KPTI- ConnectX: Ubuntu 18.04: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Intel I210: Ubuntu 18.04: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- ConnectX: Debian 9.6: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Intel I210: Debian 9.6: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerableCompiler Details- ConnectX: Ubuntu 18.04: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Intel I210: Ubuntu 18.04: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- ConnectX: Debian 9.6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Intel I210: Debian 9.6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -vProcessor Details- ConnectX: Ubuntu 18.04, Intel I210: Ubuntu 18.04, ConnectX: Debian 9.6, Intel I210: Debian 9.6: Scaling Governor: intel_pstate powersave

netperf: 192.168.1.83 - UDP Request Response - 60 Secondsnetperf: 192.168.1.83 - TCP Request Response - 60 Secondsiperf: 192.168.1.83 - 5201 - 60 Seconds - UDP - 1000Mbit Objective - 5ethr: 192.168.1.83 - TCP - Latency - 1ethr: 192.168.1.83 - TCP - Latency - 8ethr: 192.168.1.83 - TCP - Connections/s - 64iperf: 192.168.1.83 - 5201 - 60 Seconds - TCP - 5iperf: 192.168.1.83 - 5201 - 60 Seconds - TCP - 1iperf: 192.168.1.83 - 5201 - 60 Seconds - TCP - 20ethr: 192.168.1.83 - TCP - Latency - 64ethr: 192.168.1.83 - TCP - Connections/s - 1ethr: 192.168.1.83 - HTTP - Bandwidth - 1ethr: 192.168.1.83 - UDP - Bandwidth - 64nuttcp: TCP Transfer - Default - 192.168.1.83ethr: 192.168.1.83 - TCP - Connections/s - 8ethr: 192.168.1.83 - TCP - Bandwidth - 64ethr: 192.168.1.83 - UDP - Bandwidth - 8ethr: 192.168.1.83 - TCP - Bandwidth - 8Intel I210ConnectXIntel I210ConnectXIntel I210ConnectXIntel I210 Windows 2016 Windows 2016 Windows 2019 Windows 2019 FreeBSD 12 FreeBSD 12 Ubuntu 18.04 Ubuntu 18.04 Debian 9.6 Debian 9.6660672575949949950949379138101863917655669041942943876783480364.1064.944779692525672909864.4853505879599942044917779595679143150134574134.42125.3665756949949950134.84414632699694935700986961949417999867941940943940424032024667887986408626890929552815399756.3457.945643788629178871352.45412358196629156529037524958988035862423557485.9288.384397194294294197.3866733059414416394298294337773851499852.6752.754940688749165875052.80992557395999177438537784959888364264504857479.6979.334279094294294278.95944330910501794151487981961942OpenBenchmarking.org

Netperf

Server: 192.168.1.83 - Test: UDP Request Response - Duration: 60 Seconds

ConnectXIntel I210OpenBenchmarking.orgTransaction Rate Per Second, More Is BetterNetperf 2.7.0Server: 192.168.1.83 - Test: UDP Request Response - Duration: 60 SecondsDebian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 201913002600390052006500SE +/- 163.52, N = 12SE +/- 457.23, N = 9SE +/- 1278.74, N = 9SE +/- 233.54, N = 12SE +/- 1135.88, N = 12SE +/- 969.08, N = 11SE +/- 148.56, N = 12SE +/- 95.38, N = 3SE +/- 0.52, N = 3SE +/- 106.41, N = 937774240295537914387426441758626601501. (CC) gcc options: -O3 -march=native -lm

Netperf

Server: 192.168.1.83 - Test: TCP Request Response - Duration: 60 Seconds

ConnectXIntel I210OpenBenchmarking.orgTransaction Rate Per Second, More Is BetterNetperf 2.7.0Server: 192.168.1.83 - Test: TCP Request Response - Duration: 60 SecondsDebian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 201915003000450060007500SE +/- 169.72, N = 12SE +/- 445.01, N = 12SE +/- 1283.87, N = 9SE +/- 145.85, N = 12SE +/- 878.26, N = 9SE +/- 916.63, N = 9SE +/- 0.72, N = 3SE +/- 767.35, N = 9SE +/- 12.12, N = 3SE +/- 62.01, N = 938513202281538106783504899942356721341. (CC) gcc options: -O3 -march=native -lm

iPerf

Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: UDP - 1000Mbit Objective - Parallel: 5

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetteriPerf 3.1.3Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: UDP - 1000Mbit Objective - Parallel: 5Debian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 201911002200330044005500SE +/- 333.32, N = 12SE +/- 521.81, N = 12SE +/- 377.08, N = 12SE +/- 38.22, N = 3SE +/- 115.48, N = 12SE +/- 115.48, N = 12SE +/- 115.55, N = 12SE +/- 115.48, N = 1249984667399718634803574867574575574

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 1

ConnectXIntel I210OpenBenchmarking.orgMicroseconds, Fewer Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 1Debian 9.6Ubuntu 18.04Windows 2019306090120150SE +/- 0.62, N = 12SE +/- 1.07, N = 12SE +/- 1.36, N = 9SE +/- 3.16, N = 12SE +/- 2.33, N = 9SE +/- 1.93, N = 1252.6756.3464.1079.6985.92134.42

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 8

ConnectXIntel I210OpenBenchmarking.orgMicroseconds, Fewer Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 8Debian 9.6Ubuntu 18.04Windows 2019306090120150SE +/- 0.71, N = 12SE +/- 1.22, N = 12SE +/- 1.58, N = 12SE +/- 3.27, N = 12SE +/- 2.13, N = 12SE +/- 2.43, N = 352.7557.9464.9479.3388.38125.36

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 64

ConnectXIntel I210OpenBenchmarking.orgConnections/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 64Debian 9.6Ubuntu 18.04Windows 201914K28K42K56K70KSE +/- 1801.31, N = 12SE +/- 766.64, N = 3SE +/- 3310.06, N = 9SE +/- 3449.12, N = 12SE +/- 3390.83, N = 12SE +/- 7763.88, N = 12494065643747796427904397165756

iPerf

Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 5

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetteriPerf 3.1.3Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 5Debian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 20192K4K6K8K10KSE +/- 40.40, N = 3SE +/- 79.51, N = 3SE +/- 76.70, N = 3SE +/- 17.44, N = 3SE +/- 49.49, N = 3SE +/- 0.33, N = 388748879886291769252942941942949949

iPerf

Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 1

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetteriPerf 3.1.3Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 1Debian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 20192K4K6K8K10KSE +/- 4.36, N = 3SE +/- 117.46, N = 3SE +/- 23.36, N = 3SE +/- 25.46, N = 3SE +/- 39.67, N = 391658640917855665672942940942949949

iPerf

Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 20

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetteriPerf 3.1.3Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 20Debian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 20192K4K6K8K10KSE +/- 19.72, N = 3SE +/- 16.51, N = 3SE +/- 21.66, N = 3SE +/- 44.92, N = 3SE +/- 17.52, N = 387508626871390419098942943941950950

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 64

ConnectXIntel I210OpenBenchmarking.orgMicroseconds, Fewer Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 64Debian 9.6Ubuntu 18.04Windows 2019306090120150SE +/- 0.73, N = 3SE +/- 0.17, N = 3SE +/- 1.07, N = 12SE +/- 3.58, N = 9SE +/- 0.03, N = 3SE +/- 2.60, N = 1252.8052.4564.4878.9597.38134.84

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 1

ConnectXIntel I210OpenBenchmarking.orgConnections/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 1Debian 9.6Ubuntu 18.04Windows 20192K4K6K8K10KSE +/- 414.15, N = 12SE +/- 63.03, N = 4SE +/- 55.08, N = 3SE +/- 169.54, N = 3SE +/- 27.28, N = 3SE +/- 98.75, N = 12992541235350944366734146

Ethr

Server Address: 192.168.1.83 - Protocol: HTTP - Test: Bandwidth - Threads: 1

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: HTTP - Test: Bandwidth - Threads: 1Debian 9.6Ubuntu 18.04Windows 2019130260390520650SE +/- 6.28, N = 10SE +/- 3.60, N = 3SE +/- 9.83, N = 4SE +/- 5.75, N = 12SE +/- 2.23, N = 3SE +/- 1.18, N = 3573581587309305326

Ethr

Server Address: 192.168.1.83 - Protocol: UDP - Test: Bandwidth - Threads: 64

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: UDP - Test: Bandwidth - Threads: 64Debian 9.6Ubuntu 18.04Windows 201920K40K60K80K100KSE +/- 0.38, N = 3SE +/- 34.90, N = 3SE +/- 0.67, N = 3SE +/- 2603.79, N = 12SE +/- 10.38, N = 12959996629599105017996

Nuttcp

Test: TCP Transfer - Default - Server Address: 192.168.1.83

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetterNuttcp 8.1.4Test: TCP Transfer - Default - Server Address: 192.168.1.83Debian 9.6FreeBSD 12Ubuntu 18.04Windows 2016Windows 20192K4K6K8K10KSE +/- 9.90, N = 3SE +/- 36.45, N = 3SE +/- 11.16, N = 3SE +/- 41.16, N = 3SE +/- 56.96, N = 3SE +/- 0.43, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 391778909915694299420941940941949949

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 8

ConnectXIntel I210OpenBenchmarking.orgConnections/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 8Debian 9.6Ubuntu 18.04Windows 201911K22K33K44K55KSE +/- 5762.94, N = 9SE +/- 84.52, N = 3SE +/- 392.82, N = 3SE +/- 290.36, N = 3SE +/- 35.28, N = 3SE +/- 398.04, N = 3438535290344917514874416335700

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Bandwidth - Threads: 64

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Bandwidth - Threads: 64Debian 9.6Ubuntu 18.04Windows 20192K4K6K8K10KSE +/- 5.55, N = 3SE +/- 32.36, N = 3SE +/- 97.74, N = 3SE +/- 11.69, N = 12SE +/- 0.30, N = 3SE +/- 8.22, N = 6778475247795981942986

Ethr

Server Address: 192.168.1.83 - Protocol: UDP - Test: Bandwidth - Threads: 8

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: UDP - Test: Bandwidth - Threads: 8Debian 9.6Ubuntu 18.04Windows 20192K4K6K8K10KSE +/- 1.56, N = 3SE +/- 2.70, N = 3SE +/- 31.01, N = 3SE +/- 0.00, N = 3SE +/- 10.35, N = 3SE +/- 0.04, N = 3959895899567961982961

Ethr

Server Address: 192.168.1.83 - Protocol: TCP - Test: Bandwidth - Threads: 8

ConnectXIntel I210OpenBenchmarking.orgMbits/sec, More Is BetterEthr 2019-01-02Server Address: 192.168.1.83 - Protocol: TCP - Test: Bandwidth - Threads: 8Debian 9.6Ubuntu 18.04Windows 20192K4K6K8K10KSE +/- 10.26, N = 3SE +/- 37.44, N = 3SE +/- 48.30, N = 3SE +/- 0.26, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 3883688039143942943949

Phoronix Test Suite v10.8.4