MNN Comparison

2 x Intel Xeon Platinum 8280 testing with a GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2101067-HA-2101067PT39.

MNN ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionRyzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2PAMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads)ASUS ROG CROSSHAIR VIII HERO (2702 BIOS)AMD Starship/Matisse16GB1000GB Sabrent Rocket 4.0 1TB + 1000GB Samsung SSD 980 PRO 1TBSapphire AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 6GB (1780/875MHz)AMD Navi 10 HDMI AudioASUS VP28URealtek RTL8125 2.5GbE + Intel I211Ubuntu 20.105.10.0-phx (x86_64)GNOME Shell 3.38.1X Server 1.20.9modesetting 1.20.94.6 Mesa 20.2.1 (LLVM 11.0.0)1.2.131GCC 10.2.0ext43840x2160Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads)Dell 0GG9PT (1.0.3 BIOS)Intel Tiger Lake-LPKioxia KBG40ZNS256G NVMe 256GBIntel UHD 3GB (1300MHz)Realtek ALC289Intel Wi-Fi 6 AX2015.11.0-rc1-phx (x86_64) 202012284.6 Mesa 21.0.0-devel (git-7d8d99e 2020-12-25 groovy-oibaf-ppa)1.2.1451920x12002 x AMD EPYC 7742 64-Core @ 2.25GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RDY1006G BIOS)AMD Starship/Matisse504GB2 x 3841GB Micron_9300_MTFDHAL3T8TDPllvmpipeVE2282 x Mellanox MT27710Ubuntu 20.045.4.0-48-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.8 (LLVM 10.0.0 128 bits)GCC 9.3.01920x1080AMD Ryzen 5 4500U @ 2.38GHz (6 Cores)LENOVO LNVNB161216 (EECN20WW BIOS)AMD Renoir Root Complex16GB256GB SK hynix HFM256GDHTNI-87A0BAMD Renoir 512MB (1500/400MHz)AMD Device 1637Realtek RTL8822CE 802.11ac PCIeUbuntu 20.105.10.0-pts (x86_64)GNOME Shell 3.38.1X Server 1.20.9amdgpu 19.1.04.6 Mesa 21.0.0-devel (git-448e603 2020-12-21 groovy-oibaf-ppa) (LLVM 11.0.0)1.2.145GCC 10.2.02 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPED1D280GAllvmpipeVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.4.0-18-generic (x86_64)GNOME Shell 3.36.0X Server 1.20.7modesetting 1.20.73.3 Mesa 20.0.2 (LLVM 9.0.1 256 bits)GCC 9.3.0OpenBenchmarking.orgCompiler Details- Ryzen 9 5950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Core i7 1165G7: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - EPYC 7742 2P: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 5 4500U: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Xeon Platinum 8280 2P: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 9 5950X: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa201009- Core i7 1165G7: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3- EPYC 7742 2P: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0x8301034- Ryzen 5 4500U: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8600102- Xeon Platinum 8280 2P: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002cSecurity Details- Ryzen 9 5950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Core i7 1165G7: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected- EPYC 7742 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 5 4500U: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected- Xeon Platinum 8280 2P: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

MNN Comparisonmnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3mnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P6.49427.8303.1885.81328.1785.12526.6033.3573.53528.62510.84051.8925.9178.11165.9957.88343.3764.3945.38360.78411.95234.1465.7475.59835.45911.49930.1305.0213.51239.8058.92234.3635.4965.03846.1708.13739.1904.8084.82439.8859.18932.8395.0925.13530.4957.21426.8024.0252.58932.451OpenBenchmarking.org

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: SqueezeNetV1.0Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P3691215SE +/- 0.010, N = 3SE +/- 0.028, N = 3SE +/- 0.369, N = 12SE +/- 0.135, N = 3SE +/- 0.230, N = 156.49410.84011.9528.9229.189MIN: 6.05 / MAX: 16.53MIN: 10.3 / MAX: 25.66MIN: 9.51 / MAX: 28.35MIN: 7.72 / MAX: 27.24MIN: 7.02 / MAX: 16.881. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: resnet-v2-50Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1224364860SE +/- 0.03, N = 3SE +/- 1.08, N = 3SE +/- 0.42, N = 12SE +/- 0.45, N = 3SE +/- 0.25, N = 1527.8351.8934.1534.3632.84MIN: 26.53 / MAX: 38.71MIN: 31.81 / MAX: 69.41MIN: 29.94 / MAX: 262.37MIN: 31.71 / MAX: 94.36MIN: 30.04 / MAX: 156.691. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: MobileNetV2_224Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1.33132.66263.99395.32526.6565SE +/- 0.008, N = 3SE +/- 0.025, N = 3SE +/- 0.102, N = 12SE +/- 0.033, N = 3SE +/- 0.154, N = 153.1885.9175.7475.4965.092MIN: 2.97 / MAX: 13.1MIN: 5.77 / MAX: 20.66MIN: 4.74 / MAX: 14.71MIN: 4.74 / MAX: 23.14MIN: 4.25 / MAX: 6.151. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: mobilenet-v1-1.0Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P246810SE +/- 0.007, N = 3SE +/- 0.006, N = 3SE +/- 0.029, N = 12SE +/- 0.016, N = 3SE +/- 0.016, N = 155.8138.1115.5985.0385.135MIN: 5.6 / MAX: 15.97MIN: 7.94 / MAX: 23.02MIN: 5.23 / MAX: 28.01MIN: 4.36 / MAX: 22.26MIN: 4.87 / MAX: 13.621. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: inception-v3Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1530456075SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 12SE +/- 1.05, N = 3SE +/- 0.20, N = 1528.1866.0035.4646.1730.50MIN: 26.69 / MAX: 79.62MIN: 65.27 / MAX: 103.19MIN: 33 / MAX: 142.28MIN: 42.15 / MAX: 128.35MIN: 24.64 / MAX: 154.561. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.1Model: SqueezeNetV1.0Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P3691215SE +/- 0.054, N = 3SE +/- 0.008, N = 3SE +/- 0.121, N = 3SE +/- 0.135, N = 3SE +/- 0.231, N = 125.1257.88311.4998.1377.214MIN: 4.84 / MAX: 14.46MIN: 7.79 / MAX: 22.3MIN: 9.91 / MAX: 15.08MIN: 7.06 / MAX: 25.42MIN: 5.38 / MAX: 19.431. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.1Model: resnet-v2-50Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1020304050SE +/- 0.10, N = 3SE +/- 1.10, N = 3SE +/- 0.28, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 1226.6043.3830.1339.1926.80MIN: 25.42 / MAX: 37.11MIN: 27.03 / MAX: 64.42MIN: 25.61 / MAX: 107.35MIN: 36.97 / MAX: 61.79MIN: 25.76 / MAX: 95.871. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.1Model: MobileNetV2_224Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1.12972.25943.38914.51885.6485SE +/- 0.003, N = 3SE +/- 0.010, N = 3SE +/- 0.207, N = 3SE +/- 0.024, N = 3SE +/- 0.088, N = 123.3574.3945.0214.8084.025MIN: 3.09 / MAX: 4.49MIN: 4.23 / MAX: 18.64MIN: 4.52 / MAX: 13.36MIN: 3.97 / MAX: 22.02MIN: 3.49 / MAX: 5.281. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.1Model: mobilenet-v1-1.0Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1.21122.42243.63364.84486.056SE +/- 0.024, N = 3SE +/- 0.005, N = 3SE +/- 0.277, N = 3SE +/- 0.033, N = 3SE +/- 0.013, N = 123.5355.3833.5124.8242.589MIN: 3.34 / MAX: 14.12MIN: 5.3 / MAX: 19.58MIN: 2.91 / MAX: 6.99MIN: 4.16 / MAX: 22.5MIN: 2.42 / MAX: 3.51. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.1.1Model: inception-v3Ryzen 9 5950XCore i7 1165G7EPYC 7742 2PRyzen 5 4500UXeon Platinum 8280 2P1428425670SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 1.02, N = 3SE +/- 0.55, N = 3SE +/- 0.12, N = 1228.6360.7839.8139.8932.45MIN: 27.55 / MAX: 40.86MIN: 59.66 / MAX: 120.25MIN: 35.7 / MAX: 352.78MIN: 36.85 / MAX: 68.38MIN: 28.79 / MAX: 149.231. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Phoronix Test Suite v10.8.4