10GbE Linux Networking Performance Tests Tests by Michael Larabel for a future article of 10GbE Linux network benchmarks. Fedora Server 29: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: ASPEED Family, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Fedora 29, Kernel: 4.19.13-300.fc29.x86_64 (x86_64), Compiler: GCC 8.2.1 20181215, File-System: xfs, Screen Resolution: 1920x1080 Debian 9.6: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Device 2020, Memory: 12 x 8192 MB DDR4-2666MHz Micron 9ASF1G72PZ-2G6B1, Disk: Samsung SSD 970 EVO 250GB, Graphics: ASPEED Family, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Debian 9.6, Kernel: 4.9.0-8-amd64 (x86_64), Desktop: GNOME Shell 3.22.3, Display Server: X Server 1.19.2, Compiler: GCC 6.3.0 20170516, File-System: ext4, Screen Resolution: 1024x768 CentOS 7: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 95232MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: llvmpipe 93GB, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: CentOS Linux 7, Kernel: 3.10.0-957.1.3.el7.x86_64 (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.20.1, Display Driver: modesetting 1.20.1, OpenGL: 2.1 Mesa 18.0.5 (LLVM 6.0 256 bits), Compiler: GCC 4.8.5 20150623, File-System: xfs, Screen Resolution: 1920x1080 Clear Linux: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: llvmpipe 93GB, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Clear Linux OS 27230, Kernel: 4.20.2-683.native (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server 1.20.3, Display Driver: modesetting 1.20.3, OpenGL: 3.3 Mesa 19.0.0-devel (LLVM 7.0 256 bits), Compiler: GCC 8.2.1 20180502 + Clang 7.0.1 + LLVM 7.0.1, File-System: ext4, Screen Resolution: 1920x1080 Ubuntu 18.04.1 LTS: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: ASPEED Family, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 18.04, Kernel: 4.15.0-43-generic (x86_64), Desktop: GNOME Shell 3.28.3, Display Server: X Server 1.19.6, Display Driver: modesetting 1.19.6, OpenGL: 3.3 Mesa 18.0.5 (LLVM 6.0 256 bits), Compiler: GCC 7.3.0, File-System: ext4, Screen Resolution: 1024x768 openSUSE Leap 15.0: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: ASPEED Family, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: openSUSE Leap 15.0, Kernel: 4.12.14-lp150.12.28-default (x86_64), Desktop: KDE Plasma 5.12.6, Display Server: X Server 1.19.6, Display Driver: modesetting 1.19.6, Compiler: GCC 7.3.1 20180323 [gcc-7-branch revision 258812], File-System: xfs, Screen Resolution: 1920x1080 openSUSE Tumbleweed: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: llvmpipe 93GB, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: openSUSE Tumbleweed 20190115, Kernel: 4.20.0-1-default (x86_64), Desktop: KDE Plasma 5.14.5, Display Server: X Server 1.20.3, Display Driver: modesetting 1.20.3, OpenGL: 3.3 Mesa 18.3.1 (LLVM 7.0 256 bits), Compiler: GCC 8.2.1 20181108 [gcc-8-branch revision 265914], File-System: btrfs, Screen Resolution: 1920x1080 Antergos 19.1: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: ASPEED Family, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Antergos Linux 19.1-ISO-Rolling, Kernel: 4.20.3-arch1-1-ARCH (x86_64), Desktop: GNOME Shell 3.30.2, Display Server: X Server 1.20.3, Display Driver: modesetting 1.20.3, OpenGL: 3.3 Mesa 18.3.1 (LLVM 7.0 256 bits), Compiler: GCC 8.2.1 20181127, File-System: ext4, Screen Resolution: 1920x1080 Ubuntu 18.10: Processor: 2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads), Motherboard: TYAN S7106 (V1.02.B20 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 96256MB, Disk: Samsung SSD 970 EVO 250GB, Graphics: ASPEED Family, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 18.10, Kernel: 4.18.0-13-generic (x86_64), Desktop: GNOME Shell 3.30.1, Display Server: X Server 1.20.1, Display Driver: modesetting 1.20.1, Compiler: GCC 8.2.0, File-System: ext4, Screen Resolution: 1920x1080 Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 1 Microseconds < Lower Is Better Fedora Server 29 .... 104.71 |============================================== Debian 9.6 .......... 80.18 |=================================== CentOS 7 ............ 107.62 |================================================ Clear Linux ......... 59.12 |========================== Ubuntu 18.04.1 LTS .. 94.46 |========================================== openSUSE Leap 15.0 .. 96.92 |=========================================== openSUSE Tumbleweed . 110.81 |================================================= Antergos 19.1 ....... 88.51 |======================================= Ubuntu 18.10 ........ 94.59 |========================================== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 2 Microseconds < Lower Is Better Fedora Server 29 .... 104.62 |================================================ Debian 9.6 .......... 73.02 |================================== CentOS 7 ............ 106.03 |================================================= Clear Linux ......... 60.37 |============================ Ubuntu 18.04.1 LTS .. 88.33 |========================================= openSUSE Leap 15.0 .. 95.08 |============================================ openSUSE Tumbleweed . 106.57 |================================================= Antergos 19.1 ....... 95.94 |============================================ Ubuntu 18.10 ........ 91.25 |========================================== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 8 Microseconds < Lower Is Better Fedora Server 29 .... 102.47 |================================================ Debian 9.6 .......... 69.72 |================================= CentOS 7 ............ 104.82 |================================================= Clear Linux ......... 61.03 |============================= Ubuntu 18.04.1 LTS .. 91.23 |=========================================== openSUSE Leap 15.0 .. 96.99 |============================================= openSUSE Tumbleweed . 103.35 |================================================ Antergos 19.1 ....... 95.51 |============================================= Ubuntu 18.10 ........ 94.20 |============================================ Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 16 Microseconds < Lower Is Better Fedora Server 29 .... 102.13 |============================================= Debian 9.6 .......... 71.67 |================================ CentOS 7 ............ 108.15 |================================================ Clear Linux ......... 60.16 |=========================== Ubuntu 18.04.1 LTS .. 87.59 |======================================= openSUSE Leap 15.0 .. 96.87 |=========================================== openSUSE Tumbleweed . 111.01 |================================================= Antergos 19.1 ....... 94.68 |========================================== Ubuntu 18.10 ........ 93.18 |========================================= Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 32 Microseconds < Lower Is Better Fedora Server 29 .... 106.07 |================================================= Debian 9.6 .......... 70.78 |================================= CentOS 7 ............ 106.54 |================================================= Clear Linux ......... 61.68 |============================ Ubuntu 18.04.1 LTS .. 89.70 |========================================= openSUSE Leap 15.0 .. 98.68 |============================================= openSUSE Tumbleweed . 103.49 |================================================ Antergos 19.1 ....... 97.94 |============================================= Ubuntu 18.10 ........ 94.80 |============================================ Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Latency - Threads: 64 Microseconds < Lower Is Better Fedora Server 29 .... 104.18 |================================================ Debian 9.6 .......... 70.62 |================================ CentOS 7 ............ 106.56 |================================================= Clear Linux ......... 61.81 |============================ Ubuntu 18.04.1 LTS .. 90.42 |========================================= openSUSE Leap 15.0 .. 96.36 |============================================ openSUSE Tumbleweed . 106.84 |================================================= Antergos 19.1 ....... 94.68 |=========================================== Ubuntu 18.10 ........ 87.40 |======================================== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: HTTP - Test: Bandwidth - Threads: 1 Mbits/sec > Higher Is Better Fedora Server 29 .... 340 |====================================== Debian 9.6 .......... 412 |============================================== CentOS 7 ............ 336 |====================================== Clear Linux ......... 465 |==================================================== Ubuntu 18.04.1 LTS .. 364 |========================================= openSUSE Leap 15.0 .. 348 |======================================= openSUSE Tumbleweed . 324 |==================================== Antergos 19.1 ....... 342 |====================================== Ubuntu 18.10 ........ 359 |======================================== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: HTTP - Test: Bandwidth - Threads: 2 Mbits/sec > Higher Is Better Fedora Server 29 .... 628 |======================================= Debian 9.6 .......... 762 |=============================================== CentOS 7 ............ 629 |======================================= Clear Linux ......... 847 |==================================================== Ubuntu 18.04.1 LTS .. 685 |========================================== openSUSE Leap 15.0 .. 632 |======================================= openSUSE Tumbleweed . 612 |====================================== Antergos 19.1 ....... 650 |======================================== Ubuntu 18.10 ........ 664 |========================================= Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 1 Connections/sec > Higher Is Better Fedora Server 29 .... 5077 |======================== Debian 9.6 .......... 9283 |============================================= CentOS 7 ............ 3617 |================= Clear Linux ......... 10427 |================================================== Ubuntu 18.04.1 LTS .. 6600 |================================ openSUSE Leap 15.0 .. 6307 |============================== openSUSE Tumbleweed . 4800 |======================= Antergos 19.1 ....... 6603 |================================ Ubuntu 18.10 ........ 6547 |=============================== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 2 Connections/sec > Higher Is Better Fedora Server 29 .... 13017 |============================= Debian 9.6 .......... 19760 |============================================= CentOS 7 ............ 8470 |=================== Clear Linux ......... 22193 |================================================== Ubuntu 18.04.1 LTS .. 13413 |============================== openSUSE Leap 15.0 .. 16058 |==================================== openSUSE Tumbleweed . 13600 |=============================== Antergos 19.1 ....... 14007 |================================ Ubuntu 18.10 ........ 14473 |================================= Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 8 Connections/sec > Higher Is Better Fedora Server 29 .... 39573 |====================================== Debian 9.6 .......... 52497 |================================================== CentOS 7 ............ 43750 |========================================== Clear Linux ......... 47419 |============================================= Ubuntu 18.04.1 LTS .. 41550 |======================================== openSUSE Leap 15.0 .. 43043 |========================================= openSUSE Tumbleweed . 39503 |====================================== Antergos 19.1 ....... 42913 |========================================= Ubuntu 18.10 ........ 43793 |========================================== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 16 Connections/sec > Higher Is Better Fedora Server 29 .... 48949 |================================================== Debian 9.6 .......... 45338 |============================================== CentOS 7 ............ 33191 |================================== Clear Linux ......... 31373 |================================ Ubuntu 18.04.1 LTS .. 38127 |======================================= openSUSE Leap 15.0 .. 42287 |=========================================== openSUSE Tumbleweed . 48329 |================================================= Antergos 19.1 ....... 38759 |======================================== Ubuntu 18.10 ........ 37728 |======================================= Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 32 Connections/sec > Higher Is Better Fedora Server 29 .... 46620 |================= Debian 9.6 .......... 36452 |============== CentOS 7 ............ 27607 |========== Clear Linux ......... 41296 |=============== Ubuntu 18.04.1 LTS .. 131175 |================================================= openSUSE Leap 15.0 .. 37643 |============== openSUSE Tumbleweed . 44523 |================= Antergos 19.1 ....... 33525 |============= Ubuntu 18.10 ........ 39647 |=============== Ethr 2019-01-02 Server Address: 192.168.1.83 - Protocol: TCP - Test: Connections/s - Threads: 64 Connections/sec > Higher Is Better Fedora Server 29 .... 44541 |============================================== Debian 9.6 .......... 44914 |============================================== CentOS 7 ............ 24411 |========================= Clear Linux ......... 37602 |====================================== Ubuntu 18.04.1 LTS .. 44174 |============================================= openSUSE Leap 15.0 .. 46333 |=============================================== openSUSE Tumbleweed . 39560 |======================================== Antergos 19.1 ....... 40780 |========================================== Ubuntu 18.10 ........ 48868 |================================================== iPerf 3.1.3 Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: UDP - 1000Mbit Objective - Parallel: 5 Mbits/sec > Higher Is Better Fedora Server 29 .... 4996 |=================================================== Debian 9.6 .......... 4994 |=================================================== CentOS 7 ............ 4995 |=================================================== Clear Linux ......... 4858 |================================================== Ubuntu 18.04.1 LTS .. 4973 |=================================================== openSUSE Leap 15.0 .. 4997 |=================================================== openSUSE Tumbleweed . 4997 |=================================================== Antergos 19.1 ....... 4998 |=================================================== Ubuntu 18.10 ........ 4998 |=================================================== iPerf 3.1.3 Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: UDP - 1000Mbit Objective - Parallel: 10 Mbits/sec > Higher Is Better Fedora Server 29 .... 6863 |=========================================== Debian 9.6 .......... 7633 |=============================================== CentOS 7 ............ 7916 |================================================= Clear Linux ......... 5449 |================================== Ubuntu 18.04.1 LTS .. 6307 |======================================= openSUSE Leap 15.0 .. 8216 |=================================================== openSUSE Tumbleweed . 6651 |========================================= Antergos 19.1 ....... 8126 |================================================== Ubuntu 18.10 ........ 7977 |================================================== iPerf 3.1.3 Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: UDP - 1000Mbit Objective - Parallel: 20 Mbits/sec > Higher Is Better Fedora Server 29 .... 4977 |=============================== Debian 9.6 .......... 5112 |================================ CentOS 7 ............ 8228 |=================================================== Clear Linux ......... 4809 |============================== Ubuntu 18.04.1 LTS .. 5752 |==================================== openSUSE Leap 15.0 .. 4776 |============================== openSUSE Tumbleweed . 6362 |======================================= Antergos 19.1 ....... 4911 |============================== Ubuntu 18.10 ........ 4612 |============================= iPerf 3.1.3 Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 1 Mbits/sec > Higher Is Better Fedora Server 29 .... 7603 |================================================= Debian 9.6 .......... 7973 |=================================================== CentOS 7 ............ 7625 |================================================= Clear Linux ......... 6000 |====================================== Ubuntu 18.04.1 LTS .. 7819 |================================================== openSUSE Leap 15.0 .. 7650 |================================================= openSUSE Tumbleweed . 7563 |================================================ Antergos 19.1 ....... 7722 |================================================= Ubuntu 18.10 ........ 7700 |================================================= iPerf 3.1.3 Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 5 Mbits/sec > Higher Is Better Fedora Server 29 .... 8907 |=================================================== Debian 9.6 .......... 8994 |=================================================== CentOS 7 ............ 8878 |================================================== Clear Linux ......... 7415 |========================================== Ubuntu 18.04.1 LTS .. 8915 |=================================================== openSUSE Leap 15.0 .. 8948 |=================================================== openSUSE Tumbleweed . 8952 |=================================================== Antergos 19.1 ....... 8950 |=================================================== Ubuntu 18.10 ........ 6925 |======================================= iPerf 3.1.3 Server Address: 192.168.1.83 - Server Port: 5201 - Duration: 60 Seconds - Test: TCP - Parallel: 20 Mbits/sec > Higher Is Better Fedora Server 29 .... 8712 |================================================== Debian 9.6 .......... 8798 |=================================================== CentOS 7 ............ 8817 |=================================================== Clear Linux ......... 7893 |============================================== Ubuntu 18.04.1 LTS .. 8797 |=================================================== openSUSE Leap 15.0 .. 8839 |=================================================== openSUSE Tumbleweed . 8754 |=================================================== Antergos 19.1 ....... 8783 |=================================================== Ubuntu 18.10 ........ 6598 |====================================== Nuttcp 8.1.4 Test: TCP Transfer - Default - Server Address: 192.168.1.83 Mbits/sec > Higher Is Better Fedora Server 29 .... 7505 |================================================ Debian 9.6 .......... 8034 |=================================================== CentOS 7 ............ 7562 |================================================ Clear Linux ......... 5955 |====================================== Ubuntu 18.04.1 LTS .. 7659 |================================================= openSUSE Leap 15.0 .. 7715 |================================================= openSUSE Tumbleweed . 7517 |================================================ Antergos 19.1 ....... 7577 |================================================ Ubuntu 18.10 ........ 7576 |================================================ Netperf 2.7.0 Server: 192.168.1.83 - Test: TCP Request Response - Duration: 60 Seconds Transaction Rate Per Second > Higher Is Better Fedora Server 29 .... 2252 |============== Debian 9.6 .......... 5449 |================================== CentOS 7 ............ 1331 |======== Clear Linux ......... 8110 |=================================================== Ubuntu 18.04.1 LTS .. 5007 |=============================== openSUSE Leap 15.0 .. 3507 |====================== openSUSE Tumbleweed . 1679 |=========== Antergos 19.1 ....... 4906 |=============================== Ubuntu 18.10 ........ 5022 |================================ Netperf 2.7.0 Server: 192.168.1.83 - Test: UDP Request Response - Duration: 60 Seconds Transaction Rate Per Second > Higher Is Better Fedora Server 29 .... 1929 |============ Debian 9.6 .......... 4896 |============================== CentOS 7 ............ 1689 |========== Clear Linux ......... 8218 |=================================================== Ubuntu 18.04.1 LTS .. 5683 |=================================== openSUSE Leap 15.0 .. 3717 |======================= openSUSE Tumbleweed . 1573 |========== Antergos 19.1 ....... 4504 |============================ Ubuntu 18.10 ........ 5131 |================================ Netperf 2.7.0 Server: 192.168.1.83 - Test: TCP Stream - Client To Server - Duration: 60 Seconds Megabits/sec Throughput > Higher Is Better Fedora Server 29 .... 772 |================================================ Debian 9.6 .......... 685 |=========================================== CentOS 7 ............ 667 |========================================== Clear Linux ......... 812 |=================================================== Ubuntu 18.04.1 LTS .. 773 |================================================ openSUSE Leap 15.0 .. 724 |============================================= openSUSE Tumbleweed . 830 |==================================================== Antergos 19.1 ....... 799 |================================================== Ubuntu 18.10 ........ 754 |=============================================== Netperf 2.7.0 Server: 192.168.1.83 - Test: TCP Stream - Server To Client - Duration: 60 Seconds Megabits/sec Throughput > Higher Is Better Fedora Server 29 .... 565.42 |================================== Debian 9.6 .......... 797.45 |=============================================== CentOS 7 ............ 638.43 |====================================== Clear Linux ......... 91.01 |===== Ubuntu 18.04.1 LTS .. 826.83 |================================================= openSUSE Leap 15.0 .. 653.38 |======================================= openSUSE Tumbleweed . 591.97 |=================================== Antergos 19.1 ....... 715.71 |========================================== Ubuntu 18.10 ........ 671.81 |========================================