OpenVINO Xeon Platinum 8280 2P

Intel Xeon Gold 5218R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2010195-FI-OPENVINOX34&sro.

OpenVINO Xeon Platinum 8280 2PProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution123gold 1gold 2gold 32 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPED1D280GAllvmpipe2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.9.0-050900rc4daily20200912-generic (x86_64) 20200911GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080VE228Intel Xeon Gold 5218R @ 4.00GHz (20 Cores / 40 Threads)Supermicro X11SPL-F v1.02 (3.1 BIOS)188GB2 x Intel I2105.4.0-21-generic (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- 1: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c- 2: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c- 3: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c- gold 1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- gold 2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- gold 3: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002cPython Details- Python 3.8.2Security Details- 1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - 2: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - 3: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - gold 1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled - gold 2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled - gold 3: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

OpenVINO Xeon Platinum 8280 2Prnnoise: openvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Ultra Fastkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Ultra Fastx265: Bosphorus 1080px265: Bosphorus 4K123gold 1gold 2gold 328.41115.511783.9115.311807.428.813112.298.723134.2737412.380.6337425.680.6328.48815.491787.0315.281812.858.823105.798.713134.9637277.560.6337422.380.6328.50315.491784.6415.291811.168.853099.958.703132.4937385.390.6337321.780.6328.3233.892548.923.882559.022.364209.862.324236.1912654.880.7612476.950.7724.5325.3460.19109.426.937.1017.9532.4255.5120.1428.3253.902544.913.882563.012.374189.982.354216.7212635.410.7612504.090.7724.5525.3160.20109.186.937.0917.8832.5255.6120.1628.3383.902542.203.862566.252.374206.292.364205.7212649.270.7612445.160.7724.5625.3360.13109.166.917.1017.9132.4355.8420.12OpenBenchmarking.org

RNNoise

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28123gold 1gold 2gold 3714212835SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 328.4128.4928.5028.3228.3328.341. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU123gold 1gold 2gold 348121620SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 315.5115.4915.493.893.903.90

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU123gold 1gold 2gold 35001000150020002500SE +/- 3.57, N = 3SE +/- 3.14, N = 3SE +/- 2.49, N = 3SE +/- 10.15, N = 3SE +/- 5.25, N = 3SE +/- 5.93, N = 31783.911787.031784.642548.922544.912542.20

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU123gold 1gold 2gold 348121620SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 315.3115.2815.293.883.883.86

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU123gold 1gold 2gold 36001200180024003000SE +/- 2.96, N = 3SE +/- 1.23, N = 3SE +/- 0.91, N = 3SE +/- 5.45, N = 3SE +/- 9.85, N = 3SE +/- 5.69, N = 31807.421812.851811.162559.022563.012566.25

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU123gold 1gold 2gold 3246810SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 38.818.828.852.362.372.37

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU123gold 1gold 2gold 39001800270036004500SE +/- 3.41, N = 3SE +/- 13.06, N = 3SE +/- 6.28, N = 3SE +/- 5.41, N = 3SE +/- 24.60, N = 3SE +/- 4.13, N = 33112.293105.793099.954209.864189.984206.29

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU123gold 1gold 2gold 3246810SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.728.718.702.322.352.36

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU123gold 1gold 2gold 39001800270036004500SE +/- 6.35, N = 3SE +/- 10.02, N = 3SE +/- 5.78, N = 3SE +/- 5.97, N = 3SE +/- 29.49, N = 3SE +/- 38.57, N = 33134.273134.963132.494236.194216.724205.72

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU123gold 1gold 2gold 38K16K24K32K40KSE +/- 58.69, N = 3SE +/- 29.21, N = 3SE +/- 31.04, N = 3SE +/- 61.15, N = 3SE +/- 68.89, N = 3SE +/- 58.78, N = 337412.3837277.5637385.3912654.8812635.4112649.27

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU123gold 1gold 2gold 30.1710.3420.5130.6840.855SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 30.630.630.630.760.760.76

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU123gold 1gold 2gold 38K16K24K32K40KSE +/- 91.23, N = 3SE +/- 17.58, N = 3SE +/- 14.69, N = 3SE +/- 85.73, N = 3SE +/- 145.30, N = 3SE +/- 93.56, N = 337425.6837422.3837321.7812476.9512504.0912445.16

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU123gold 1gold 2gold 30.17330.34660.51990.69320.8665SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 30.630.630.630.770.770.77

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Slowgold 1gold 2gold 3612182430SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 324.5324.5524.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Mediumgold 1gold 2gold 3612182430SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 325.3425.3125.331. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Very Fastgold 1gold 2gold 31326395265SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.10, N = 360.1960.2060.131. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Ultra Fastgold 1gold 2gold 320406080100SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.28, N = 3109.42109.18109.161. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Slowgold 1gold 2gold 3246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 36.936.936.911. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Mediumgold 1gold 2gold 3246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.107.097.101. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Very Fastgold 1gold 2gold 348121620SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 317.9517.8817.911. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Ultra Fastgold 1gold 2gold 3816243240SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 332.4232.5232.431. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

x265

Video Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 1080pgold 1gold 2gold 31326395265SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 355.5155.6155.841. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4Kgold 1gold 2gold 3510152025SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 320.1420.1620.121. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Phoronix Test Suite v10.8.4