AMD EPYC vs. Intel Xeon - Ubuntu Linux

Tests for a future article. Some initial AMD EPYC 7601 tests on Ubuntu 17.04 with Linux 4.13. Tests for a future article on Phoronix.com. Benchmarks by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1709186-TY-10X39044750&sor&grs.

AMD EPYC vs. Intel Xeon - Ubuntu LinuxProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkAudioOSKernelDisplay DriverCompilerFile-SystemScreen ResolutionDesktopSystem LayerAMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138Intel Xeon E3-1280 v5Intel Xeon E5-1680 v3Intel Xeon E5-2687W v3m4.10xlargeAMD EPYC 7601 32-Core @ 2.20GHz (64 Cores)TYAN B8026T70AE24HRAMD Device 1450129024MB234GBASPEED ASPEED FamilyAcer P243WBroadcom Limited NetXtreme BCM5720 Gigabit PCIeUbuntu 17.044.13.0-041300-generic (x86_64)modesetting 1.19.3GCC 6.3.0 20170406ext41920x1200Unity 7.5.02 x Intel Xeon Gold 6138 @ 3.70GHz (80 Cores)TYAN S7106Intel Device 202096256MB256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150Intel I210 Gigabit ConnectionIntel Xeon E3-1280 v5 @ 4.00GHz (8 Cores)MSI C236A WORKSTATION (MS-7998) v1.0Intel Skylake16384MB256GB TOSHIBA-RD400Sapphire AMD Radeon RX 470/480 4096MBRealtek ALC1150ASUS PB278Intel Connection2560x1440Intel Xeon E5-1680 v3 @ 3.80GHz (16 Cores)ASUS X99-AIntel Xeon E7 v3/Xeon60GB Patriot TorcheVGA NVIDIA GeForce GT 740 1024MBDELL S2409W1920x1080Intel Xeon E5-2687W v3 @ 3.50GHz (20 Cores)MSI X99S SLI PLUS (MS-7885) v1.032768MB80GB INTEL SSDSCKGW08NVIDIA GeForce GTX 770 2048MBRealtek ALC8922 x Intel Xeon E5-2676 v3 @ 3.00GHz (40 Cores)Xen HVM domUIntel 440FX- 82441FX PMC161792MB8GBCirrus Logic GD 5446Intel 82599 Virtual FunctionUbuntu 16.044.4.0-1022-aws (x86_64)GCC 5.4.0 20160609Xen HVM domU 4.2.amazonOpenBenchmarking.orgCompiler Details- AMD EPYC 7601: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - AMD EPYC 7601 (NUMA Interleave All): --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 2 x Intel Xeon Gold 6138: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Intel Xeon E3-1280 v5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Intel Xeon E5-1680 v3: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Intel Xeon E5-2687W v3: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - m4.10xlarge: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Processor Details- AMD EPYC 7601: Scaling Governor: acpi-cpufreq ondemand- AMD EPYC 7601 (NUMA Interleave All): Scaling Governor: acpi-cpufreq ondemand- 2 x Intel Xeon Gold 6138: Scaling Governor: intel_pstate powersave- Intel Xeon E3-1280 v5: Scaling Governor: intel_pstate powersave- Intel Xeon E5-1680 v3: Scaling Governor: intel_pstate powersave- Intel Xeon E5-2687W v3: Scaling Governor: intel_pstate powersave- m4.10xlarge: Scaling Governor: intel_pstate powersave

AMD EPYC vs. Intel Xeon - Ubuntu Linuxnpb: LU.Copenssl: RSA 4096-bit Performancec-ray: Total Timeprimesieve: 1e12 Prime Number Generationrodinia: OpenMP LavaMDnpb: EP.Cbuild-llvm: Time To Compilenpb: LU.Aparboil: OpenMP Stenciljohn-the-ripper: Blowfishparboil: OpenMP LBMbuild-linux-kernel: Time To Compilerodinia: OpenMP Streamclusterx264: H.264 Video EncodingAMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138Intel Xeon E3-1280 v5Intel Xeon E5-1680 v3Intel Xeon E5-2687W v3m4.10xlarge46983.343294.532.8414.0830.961610.17175.1163042.8013.822955350.9537.4023.15292.6350046.903306.372.8514.0630.141607.68192.2662479.087.753433538.3739.2814.66288.2850072.254826.702.8411.8131.441815.89134.6453974.497.753037350.0430.5422.52310.796771.72697.1019.6471.03177.39334.80715.0312819.4935.627556166.83122.2830.08182.7614551.951271.2711.0938.2098.38660.24408.0720916.2412.741381590.0175.8326.20262.1316108.031339.0010.5336.3393.93686.32388.1219699.8612.6114520108.0773.0227.29311.3336509.862229.106.4522.1856.47629.38213.9437949.8511.472352074.4341.8423.66264.84OpenBenchmarking.org

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.C2 x Intel Xeon Gold 6138AMD EPYC 7601 (NUMA Interleave All)AMD EPYC 7601m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v511K22K33K44K55KSE +/- 637.78, N = 3SE +/- 25.06, N = 3SE +/- 747.98, N = 3SE +/- 143.51, N = 3SE +/- 89.16, N = 3SE +/- 55.08, N = 3SE +/- 6.85, N = 350072.2550046.9046983.3436509.8616108.0314551.956771.721. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi2. 2 x Intel Xeon Gold 6138: Open MPI 2.0.23. AMD EPYC 7601 (NUMA Interleave All): Open MPI 2.0.24. AMD EPYC 7601: Open MPI 2.0.25. m4.10xlarge: Open MPI 1.10.26. Intel Xeon E5-2687W v3: Open MPI 2.0.27. Intel Xeon E5-1680 v3: Open MPI 2.0.28. Intel Xeon E3-1280 v5: Open MPI 2.0.2

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit Performance2 x Intel Xeon Gold 6138AMD EPYC 7601 (NUMA Interleave All)AMD EPYC 7601m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v510002000300040005000SE +/- 23.22, N = 3SE +/- 13.22, N = 3SE +/- 14.45, N = 3SE +/- 1.32, N = 3SE +/- 0.46, N = 3SE +/- 0.38, N = 3SE +/- 0.21, N = 34826.703306.373294.532229.101339.001271.27697.101. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeAMD EPYC 76012 x Intel Xeon Gold 6138AMD EPYC 7601 (NUMA Interleave All)m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v5510152025SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 32.842.842.856.4510.5311.0919.641. (CC) gcc options: -lm -lpthread -O3

Primesieve

1e12 Prime Number Generation

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 5.4.21e12 Prime Number Generation2 x Intel Xeon Gold 6138AMD EPYC 7601 (NUMA Interleave All)AMD EPYC 7601m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v51632486480SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 311.8114.0614.0822.1836.3338.2071.031. (CXX) g++ options: -O2 -fopenmp

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LavaMDAMD EPYC 7601 (NUMA Interleave All)AMD EPYC 76012 x Intel Xeon Gold 6138m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v54080120160200SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.39, N = 330.1430.9631.4456.4793.9398.38177.391. (CXX) g++ options: -O2 -lOpenCL

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.C2 x Intel Xeon Gold 6138AMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)Intel Xeon E5-2687W v3Intel Xeon E5-1680 v3m4.10xlargeIntel Xeon E3-1280 v5400800120016002000SE +/- 34.76, N = 6SE +/- 0.32, N = 3SE +/- 0.90, N = 3SE +/- 3.03, N = 3SE +/- 0.54, N = 3SE +/- 1.36, N = 3SE +/- 0.81, N = 31815.891610.171607.68686.32660.24629.38334.801. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi2. 2 x Intel Xeon Gold 6138: Open MPI 2.0.23. AMD EPYC 7601: Open MPI 2.0.24. AMD EPYC 7601 (NUMA Interleave All): Open MPI 2.0.25. Intel Xeon E5-2687W v3: Open MPI 2.0.26. Intel Xeon E5-1680 v3: Open MPI 2.0.27. m4.10xlarge: Open MPI 1.10.28. Intel Xeon E3-1280 v5: Open MPI 2.0.2

Timed LLVM Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 4.0.1Time To Compile2 x Intel Xeon Gold 6138AMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v5150300450600750SE +/- 0.81, N = 3SE +/- 3.02, N = 4SE +/- 2.34, N = 3SE +/- 1.94, N = 3SE +/- 0.11, N = 3SE +/- 0.61, N = 3SE +/- 0.14, N = 3134.64175.11192.26213.94388.12408.07715.03

NAS Parallel Benchmarks

Test / Class: LU.A

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: LU.AAMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138m4.10xlargeIntel Xeon E5-1680 v3Intel Xeon E5-2687W v3Intel Xeon E3-1280 v514K28K42K56K70KSE +/- 1051.01, N = 4SE +/- 437.89, N = 3SE +/- 3783.72, N = 6SE +/- 902.21, N = 6SE +/- 11.47, N = 3SE +/- 19.47, N = 3SE +/- 21.86, N = 363042.8062479.0853974.4937949.8520916.2419699.8612819.491. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi2. AMD EPYC 7601: Open MPI 2.0.23. AMD EPYC 7601 (NUMA Interleave All): Open MPI 2.0.24. 2 x Intel Xeon Gold 6138: Open MPI 2.0.25. m4.10xlarge: Open MPI 1.10.26. Intel Xeon E5-1680 v3: Open MPI 2.0.27. Intel Xeon E5-2687W v3: Open MPI 2.0.28. Intel Xeon E3-1280 v5: Open MPI 2.0.2

Parboil

Test: OpenMP Stencil

OpenBenchmarking.orgSeconds, Fewer Is BetterParboil 2.5Test: OpenMP StencilAMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3AMD EPYC 7601Intel Xeon E3-1280 v5816243240SE +/- 0.00, N = 3SE +/- 0.17, N = 6SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.68, N = 6SE +/- 0.09, N = 37.757.7511.4712.6112.7413.8235.621. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishAMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138AMD EPYC 7601m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v57K14K21K28K35KSE +/- 764.17, N = 6SE +/- 2076.33, N = 6SE +/- 2253.07, N = 6SE +/- 73.10, N = 3SE +/- 9.33, N = 3SE +/- 3.33, N = 334335303732955323520145201381575561. (CC) gcc options: -fopenmp -lcrypt

Parboil

Test: OpenMP LBM

OpenBenchmarking.orgSeconds, Fewer Is BetterParboil 2.5Test: OpenMP LBMAMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138AMD EPYC 7601m4.10xlargeIntel Xeon E5-1680 v3Intel Xeon E5-2687W v3Intel Xeon E3-1280 v54080120160200SE +/- 0.26, N = 3SE +/- 1.14, N = 6SE +/- 0.66, N = 3SE +/- 3.88, N = 6SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.35, N = 338.3750.0450.9574.4390.01108.07166.831. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.9Time To Compile2 x Intel Xeon Gold 6138AMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)m4.10xlargeIntel Xeon E5-2687W v3Intel Xeon E5-1680 v3Intel Xeon E3-1280 v5306090120150SE +/- 0.89, N = 6SE +/- 0.51, N = 6SE +/- 0.58, N = 5SE +/- 0.63, N = 5SE +/- 0.75, N = 3SE +/- 1.05, N = 6SE +/- 0.94, N = 330.5437.4039.2841.8473.0275.83122.28

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP StreamclusterAMD EPYC 7601 (NUMA Interleave All)2 x Intel Xeon Gold 6138AMD EPYC 7601m4.10xlargeIntel Xeon E5-1680 v3Intel Xeon E5-2687W v3Intel Xeon E3-1280 v5714212835SE +/- 0.27, N = 6SE +/- 0.42, N = 3SE +/- 1.43, N = 6SE +/- 0.36, N = 3SE +/- 0.59, N = 6SE +/- 0.02, N = 3SE +/- 0.00, N = 314.6622.5223.1523.6626.2027.2930.081. (CXX) g++ options: -O2 -lOpenCL

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2017-09-08H.264 Video EncodingIntel Xeon E5-2687W v32 x Intel Xeon Gold 6138AMD EPYC 7601AMD EPYC 7601 (NUMA Interleave All)m4.10xlargeIntel Xeon E5-1680 v3Intel Xeon E3-1280 v570140210280350SE +/- 1.06, N = 3SE +/- 3.63, N = 3SE +/- 1.27, N = 3SE +/- 0.45, N = 3SE +/- 5.12, N = 3SE +/- 2.72, N = 3SE +/- 0.91, N = 3311.33310.79292.63288.28264.84262.13182.76-lavformat -lavcodec -lavutil -lswscale-lavformat -lavcodec -lavutil -lswscale1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize

Phoronix Test Suite v10.8.4