TFLite Xeon

2 x AMD EPYC 7282 16-Core testing with a Supermicro H11DSi-NT v2.00 (2.1 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2009067-NE-TFLITEXEO66&grs.

TFLite XeonProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverCompilerFile-SystemScreen Resolution4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPE21D280GAASPEEDVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.8.0-050800rc6daily20200721-generic (x86_64) 20200720GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.8GCC 9.3.0ext41920x1080Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads)188GB1024x7682 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)378GB1920x10802 x AMD EPYC 7282 16-Core @ 2.80GHz (32 Cores / 64 Threads)Supermicro H11DSi-NT v2.00 (2.1 BIOS)AMD Starship/Matisse474GBVE2282 x Intel 10G X550TOpenBenchmarking.orgProcessor Details- 4210R v1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 4210R v2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 v1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 v2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 v3: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 2P v1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 2P v2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 2P v3: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 7282 2P: Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301034Security Details- 4210R v1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 4210R v2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 v1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 v2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 v3: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 2P v1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 2P v2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 2P v3: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 7282 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

TFLite Xeontensorflow-lite: Inception V4tensorflow-lite: SqueezeNettensorflow-lite: Mobilenet Floattensorflow-lite: Inception ResNet V2tensorflow-lite: NASNet Mobiletensorflow-lite: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2319593154716109921205358015522711374223146401545821100522041053154476113566155493710574374575.1139055312268476579.2154110310280074240.6138761011950776592.0153829010284773976.2138613711855975997.2106932067472.462934.7935544114202.364430.1100599176156.072332.697326015343469941.6105583389144.469538.998044915390267326.2105415380937.248021.993634510879949668.3OpenBenchmarking.org

TensorFlow Lite

Model: Inception V4

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Inception V44210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P500K1000K1500K2000K2500KSE +/- 1516.29, N = 3SE +/- 2959.04, N = 3SE +/- 2242.09, N = 3SE +/- 774.97, N = 3SE +/- 400.67, N = 3SE +/- 20326.92, N = 15SE +/- 10450.58, N = 15SE +/- 15517.10, N = 3SE +/- 1284.35, N = 3231959323146401554937154110315382901069320100599110558331054153

TensorFlow Lite

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: SqueezeNet4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30K60K90K120K150KSE +/- 152.07, N = 3SE +/- 150.87, N = 3SE +/- 1283.06, N = 6SE +/- 233.29, N = 3SE +/- 126.24, N = 3SE +/- 1098.16, N = 3SE +/- 1762.12, N = 15SE +/- 1941.92, N = 15SE +/- 1025.33, N = 15154716.0154582.0105743.0102800.0102847.067472.476156.089144.480937.2

TensorFlow Lite

Model: Mobilenet Float

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Mobilenet Float4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20K40K60K80K100KSE +/- 66.48, N = 3SE +/- 63.93, N = 3SE +/- 162.15, N = 3SE +/- 161.34, N = 3SE +/- 220.54, N = 3SE +/- 1916.53, N = 15SE +/- 647.40, N = 3SE +/- 1490.28, N = 15SE +/- 60.48, N = 3109921.0110052.074575.174240.673976.262934.772332.669538.948021.9

TensorFlow Lite

Model: Inception ResNet V2

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P400K800K1200K1600K2000KSE +/- 9019.28, N = 3SE +/- 4314.23, N = 3SE +/- 1031.28, N = 3SE +/- 788.48, N = 3SE +/- 383.68, N = 3SE +/- 5901.31, N = 3SE +/- 8738.98, N = 3SE +/- 15046.75, N = 3SE +/- 990.14, N = 320535802041053139055313876101386137935544973260980449936345

TensorFlow Lite

Model: NASNet Mobile

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: NASNet Mobile4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30K60K90K120K150KSE +/- 142.99, N = 3SE +/- 283.20, N = 3SE +/- 663.59, N = 3SE +/- 277.66, N = 3SE +/- 175.36, N = 3SE +/- 2961.47, N = 15SE +/- 3072.44, N = 15SE +/- 443.76, N = 3SE +/- 389.84, N = 3155227.0154476.0122684.0119507.0118559.0114202.3153434.0153902.0108799.0

TensorFlow Lite

Model: Mobilenet Quant

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20K40K60K80K100KSE +/- 97.74, N = 3SE +/- 171.12, N = 3SE +/- 47.48, N = 3SE +/- 98.01, N = 3SE +/- 133.45, N = 3SE +/- 1621.78, N = 15SE +/- 1177.33, N = 15SE +/- 1711.56, N = 12SE +/- 81.92, N = 3113742.0113566.076579.276592.075997.264430.169941.667326.249668.3

Phoronix Test Suite v10.8.4