OpenVINO Xeon Platinum 8280 2P

2 x Intel Xeon Platinum 8280 testing with a GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2010082-FI-OPENVINOX82
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Creator Workloads 2 Tests
HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
October 08 2020
  43 Minutes
2
October 08 2020
  43 Minutes
3
October 08 2020
  43 Minutes
Invert Hiding All Results Option
  43 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


OpenVINO Xeon Platinum 8280 2PProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution1232 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPED1D280GAllvmpipe2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.9.0-050900rc4daily20200912-generic (x86_64) 20200911GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080VE228OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002cPython Details- Python 3.8.2Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

123Result OverviewPhoronix Test Suite100%100%100%100%101%OpenVINOOpenVINOOpenVINORNNoiseOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOP.D.0.F - CPUP.D.0.F - CPUA.G.R.R.0.F - CPUF.D.0.F - CPUA.G.R.R.0.F - CPUP.D.0.F - CPUF.D.0.F - CPUF.D.0.F - CPUF.D.0.F - CPUP.D.0.F - CPUA.G.R.R.0.F - CPUA.G.R.R.0.F - CPU

OpenVINO Xeon Platinum 8280 2Prnnoise: openvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPU12328.41115.511783.9115.311807.428.813112.298.723134.2737412.380.6337425.680.6328.48815.491787.0315.281812.858.823105.798.713134.9637277.560.6337422.380.6328.50315.491784.6415.291811.168.853099.958.703132.4937385.390.6337321.780.63OpenBenchmarking.org

RNNoise

RNNoise is a recurrent neural network for audio noise reduction developed by Mozilla and Xiph.Org. This test profile is a single-threaded test measuring the time to denoise a sample 26 minute long 16-bit RAW audio file using this recurrent neural network noise suppression library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28321714212835SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 328.5028.4928.411. (CC) gcc options: -O2 -pedantic -fvisibility=hidden
OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28321612182430Min: 28.49 / Avg: 28.5 / Max: 28.51Min: 28.48 / Avg: 28.49 / Max: 28.5Min: 28.41 / Avg: 28.41 / Max: 28.411. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU32148121620SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 315.4915.4915.51
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU32148121620Min: 15.42 / Avg: 15.49 / Max: 15.6Min: 15.43 / Avg: 15.49 / Max: 15.54Min: 15.47 / Avg: 15.51 / Max: 15.58

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU321400800120016002000SE +/- 2.49, N = 3SE +/- 3.14, N = 3SE +/- 3.57, N = 31784.641787.031783.91
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU32130060090012001500Min: 1779.7 / Avg: 1784.64 / Max: 1787.65Min: 1781.06 / Avg: 1787.03 / Max: 1791.71Min: 1777.71 / Avg: 1783.91 / Max: 1790.07

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU32148121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 315.2915.2815.31
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU32148121620Min: 15.27 / Avg: 15.29 / Max: 15.31Min: 15.26 / Avg: 15.28 / Max: 15.29Min: 15.27 / Avg: 15.31 / Max: 15.38

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU321400800120016002000SE +/- 0.91, N = 3SE +/- 1.23, N = 3SE +/- 2.96, N = 31811.161812.851807.42
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU32130060090012001500Min: 1809.34 / Avg: 1811.16 / Max: 1812.18Min: 1811.13 / Avg: 1812.85 / Max: 1815.24Min: 1801.53 / Avg: 1807.42 / Max: 1810.84

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU321246810SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 38.858.828.81
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU3213691215Min: 8.8 / Avg: 8.85 / Max: 8.89Min: 8.78 / Avg: 8.82 / Max: 8.88Min: 8.8 / Avg: 8.81 / Max: 8.81

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU3217001400210028003500SE +/- 6.28, N = 3SE +/- 13.06, N = 3SE +/- 3.41, N = 33099.953105.793112.29
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU3215001000150020002500Min: 3091.2 / Avg: 3099.95 / Max: 3112.12Min: 3080.78 / Avg: 3105.79 / Max: 3124.79Min: 3107.39 / Avg: 3112.29 / Max: 3118.84

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU321246810SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 38.708.718.72
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU3213691215Min: 8.67 / Avg: 8.7 / Max: 8.74Min: 8.64 / Avg: 8.71 / Max: 8.79Min: 8.68 / Avg: 8.72 / Max: 8.76

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU3217001400210028003500SE +/- 5.78, N = 3SE +/- 10.02, N = 3SE +/- 6.35, N = 33132.493134.963134.27
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU3215001000150020002500Min: 3121.5 / Avg: 3132.49 / Max: 3141.09Min: 3116.9 / Avg: 3134.96 / Max: 3151.52Min: 3121.71 / Avg: 3134.27 / Max: 3142.16

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU3218K16K24K32K40KSE +/- 31.04, N = 3SE +/- 29.21, N = 3SE +/- 58.69, N = 337385.3937277.5637412.38
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU3216K12K18K24K30KMin: 37332.22 / Avg: 37385.39 / Max: 37439.72Min: 37220.71 / Avg: 37277.56 / Max: 37317.65Min: 37348.92 / Avg: 37412.38 / Max: 37529.62

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU3210.14180.28360.42540.56720.709SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.630.630.63
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU321246810Min: 0.63 / Avg: 0.63 / Max: 0.63Min: 0.63 / Avg: 0.63 / Max: 0.63Min: 0.63 / Avg: 0.63 / Max: 0.63

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU3218K16K24K32K40KSE +/- 14.69, N = 3SE +/- 17.58, N = 3SE +/- 91.23, N = 337321.7837422.3837425.68
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU3216K12K18K24K30KMin: 37300.3 / Avg: 37321.78 / Max: 37349.89Min: 37389.62 / Avg: 37422.38 / Max: 37449.82Min: 37243.25 / Avg: 37425.68 / Max: 37519.6

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU3210.14180.28360.42540.56720.709SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.630.630.63
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU321246810Min: 0.63 / Avg: 0.63 / Max: 0.63Min: 0.63 / Avg: 0.63 / Max: 0.63Min: 0.63 / Avg: 0.63 / Max: 0.63

13 Results Shown

RNNoise
OpenVINO:
  Face Detection 0106 FP16 - CPU:
    FPS
    ms
  Face Detection 0106 FP32 - CPU:
    FPS
    ms
  Person Detection 0106 FP16 - CPU:
    FPS
    ms
  Person Detection 0106 FP32 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP32 - CPU:
    FPS
    ms