TFLite Xeon

2 x AMD EPYC 7282 16-Core testing with a Supermicro H11DSi-NT v2.00 (2.1 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009067-NE-TFLITEXEO66
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Perf-Per
Dollar
Date
Triggered
  Test
  Duration
4210R v1
August 23 2020
  24 Minutes
4210R v2
August 23 2020
  24 Minutes
8280 v1
August 23 2020
  23 Minutes
8280 v2
August 23 2020
  20 Minutes
8280 v3
August 23 2020
  20 Minutes
8280 2P v1
August 24 2020
  1 Hour, 8 Minutes
8280 2P v2
August 24 2020
  1 Hour, 7 Minutes
8280 2P v3
August 24 2020
  52 Minutes
7282 2P
September 06 2020
  31 Minutes
Invert Hiding All Results Option
  37 Minutes
Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):

4210R v1

4210R v2

Processor: 2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

8280 v1

8280 v2

8280 v3

Processor: Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 188GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768

8280 2P v1

Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

8280 2P v2

8280 2P v3

OS: Ubuntu 20.04, Kernel: 5.8.0-050800rc6daily20200721-generic (x86_64) 20200720, Desktop: GNOME Shell 3.36.1, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

7282 2P

Processor: 2 x AMD EPYC 7282 16-Core @ 2.80GHz (32 Cores / 64 Threads), Motherboard: Supermicro H11DSi-NT v2.00 (2.1 BIOS), Chipset: AMD Starship/Matisse, Memory: 474GB, Disk: 280GB INTEL SSDPE21D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel 10G X550T

Processor Notes: Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301034
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

TFLite XeonProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverCompilerFile-SystemScreen Resolution4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2 x Intel Xeon Silver 4210R @ 3.20GHz (20 Cores / 40 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPE21D280GAASPEEDVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.8.0-050800rc6daily20200721-generic (x86_64) 20200720GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.8GCC 9.3.0ext41920x1080Intel Xeon Platinum 8280 @ 4.00GHz (28 Cores / 56 Threads)188GB1024x7682 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)378GB1920x10802 x AMD EPYC 7282 16-Core @ 2.80GHz (32 Cores / 64 Threads)Supermicro H11DSi-NT v2.00 (2.1 BIOS)AMD Starship/Matisse474GBVE2282 x Intel 10G X550TOpenBenchmarking.orgProcessor Details- 4210R v1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 4210R v2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 v1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 v2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 v3: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 2P v1: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 2P v2: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 8280 2P v3: Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002c- 7282 2P: Scaling Governor: acpi-cpufreq ondemand - CPU Microcode: 0x8301034Security Details- 4210R v1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 4210R v2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 v1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 v2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 v3: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 2P v1: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 2P v2: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 8280 2P v3: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled- 7282 2P: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2PResult OverviewPhoronix Test Suite 10.2.2100%133%165%198%231%TensorFlow LiteTensorFlow LiteTensorFlow LiteTensorFlow LiteTensorFlow LiteTensorFlow LiteInception V4SqueezeNetMobilenet FloatMobilenet QuantI.R.VNASNet Mobile

TFLite Xeontensorflow-lite: SqueezeNettensorflow-lite: Inception V4tensorflow-lite: NASNet Mobiletensorflow-lite: Mobilenet Floattensorflow-lite: Mobilenet Quanttensorflow-lite: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P1547162319593155227109921113742205358015458223146401544761100521135662041053105743155493712268474575.176579.21390553102800154110311950774240.676592.01387610102847153829011855973976.275997.2138613767472.41069320114202.362934.764430.193554476156.0100599115343472332.669941.697326089144.4105583315390269538.967326.298044980937.2105415310879948021.949668.3936345OpenBenchmarking.org

TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: SqueezeNet4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30K60K90K120K150KSE +/- 152.07, N = 3SE +/- 150.87, N = 3SE +/- 1283.06, N = 6SE +/- 233.29, N = 3SE +/- 126.24, N = 3SE +/- 1098.16, N = 3SE +/- 1762.12, N = 15SE +/- 1941.92, N = 15SE +/- 1025.33, N = 15154716.0154582.0105743.0102800.0102847.067472.476156.089144.480937.2
OpenBenchmarking.orgMicroseconds x Core, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Core - Model: SqueezeNet4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P1.1M2.2M3.3M4.4M5.5M3094320.03091640.02960804.02878400.02879716.03778454.44264736.04992086.42589990.41. 4210R v1: Detected core count of 202. 4210R v2: Detected core count of 203. 8280 v1: Detected core count of 284. 8280 v2: Detected core count of 285. 8280 v3: Detected core count of 286. 8280 2P v1: Detected core count of 567. 8280 2P v2: Detected core count of 568. 8280 2P v3: Detected core count of 569. 7282 2P: Detected core count of 32
OpenBenchmarking.orgMicroseconds x Thread, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Thread - Model: SqueezeNet4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2M4M6M8M10M6188640.06183280.05921608.05756800.05759432.07556908.88529472.09984172.85179980.81. 4210R v1: Detected thread count of 402. 4210R v2: Detected thread count of 403. 8280 v1: Detected thread count of 564. 8280 v2: Detected thread count of 565. 8280 v3: Detected thread count of 566. 8280 2P v1: Detected thread count of 1127. 8280 2P v2: Detected thread count of 1128. 8280 2P v3: Detected thread count of 1129. 7282 2P: Detected thread count of 64
OpenBenchmarking.orgMicroseconds x GHz, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Clock - Model: SqueezeNet4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P110K220K330K440K550K495091.20494662.40422972.00411200.00411388.00269889.60304624.00356577.60226624.161. 4210R v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.202. 4210R v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.203. 8280 v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.004. 8280 v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.005. 8280 v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.006. 8280 2P v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.007. 8280 2P v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.008. 8280 2P v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.009. 7282 2P: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 2.80
OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: SqueezeNet4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30K60K90K120K150KMin: 154429 / Avg: 154715.67 / Max: 154947Min: 154282 / Avg: 154582 / Max: 154760Min: 104097 / Avg: 105742.83 / Max: 112140Min: 102400 / Avg: 102799.67 / Max: 103208Min: 102683 / Avg: 102846.67 / Max: 103095Min: 65731.6 / Avg: 67472.43 / Max: 69502.6Min: 67290.2 / Avg: 76155.95 / Max: 95618.5Min: 73953.5 / Avg: 89144.35 / Max: 96745.8Min: 78724.6 / Avg: 80937.21 / Max: 92728.6

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Inception V44210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P500K1000K1500K2000K2500KSE +/- 1516.29, N = 3SE +/- 2959.04, N = 3SE +/- 2242.09, N = 3SE +/- 774.97, N = 3SE +/- 400.67, N = 3SE +/- 20326.92, N = 15SE +/- 10450.58, N = 15SE +/- 15517.10, N = 3SE +/- 1284.35, N = 3231959323146401554937154110315382901069320100599110558331054153
OpenBenchmarking.orgMicroseconds x Core, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Core - Model: Inception V44210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P13M26M39M52M65M4639186046292800435382364315088443072120598819205633549659126648337328961. 4210R v1: Detected core count of 202. 4210R v2: Detected core count of 203. 8280 v1: Detected core count of 284. 8280 v2: Detected core count of 285. 8280 v3: Detected core count of 286. 8280 2P v1: Detected core count of 567. 8280 2P v2: Detected core count of 568. 8280 2P v3: Detected core count of 569. 7282 2P: Detected core count of 32
OpenBenchmarking.orgMicroseconds x Thread, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Thread - Model: Inception V44210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30M60M90M120M150M9278372092585600870764728630176886144240119763840112670992118253296674657921. 4210R v1: Detected thread count of 402. 4210R v2: Detected thread count of 403. 8280 v1: Detected thread count of 564. 8280 v2: Detected thread count of 565. 8280 v3: Detected thread count of 566. 8280 2P v1: Detected thread count of 1127. 8280 2P v2: Detected thread count of 1128. 8280 2P v3: Detected thread count of 1129. 7282 2P: Detected thread count of 64
OpenBenchmarking.orgMicroseconds x GHz, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Clock - Model: Inception V44210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P1.6M3.2M4.8M6.4M8M7422697.67406848.06219748.06164412.06153160.04277280.04023964.04223332.02951628.41. 4210R v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.202. 4210R v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.203. 8280 v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.004. 8280 v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.005. 8280 v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.006. 8280 2P v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.007. 8280 2P v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.008. 8280 2P v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.009. 7282 2P: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 2.80
OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Inception V44210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P400K800K1200K1600K2000KMin: 2316570 / Avg: 2319593.33 / Max: 2321310Min: 2310760 / Avg: 2314640 / Max: 2320450Min: 1552430 / Avg: 1554936.67 / Max: 1559410Min: 1539590 / Avg: 1541103.33 / Max: 1542150Min: 1537490 / Avg: 1538290 / Max: 1538730Min: 953728 / Avg: 1069320.13 / Max: 1197720Min: 965195 / Avg: 1005990.53 / Max: 1114170Min: 1027970 / Avg: 1055833.33 / Max: 1081600Min: 1052660 / Avg: 1054153.33 / Max: 1056710

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: NASNet Mobile4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30K60K90K120K150KSE +/- 142.99, N = 3SE +/- 283.20, N = 3SE +/- 663.59, N = 3SE +/- 277.66, N = 3SE +/- 175.36, N = 3SE +/- 2961.47, N = 15SE +/- 3072.44, N = 15SE +/- 443.76, N = 3SE +/- 389.84, N = 3155227.0154476.0122684.0119507.0118559.0114202.3153434.0153902.0108799.0
OpenBenchmarking.orgMicroseconds x Core, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Core - Model: NASNet Mobile4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2M4M6M8M10M3104540.03089520.03435152.03346196.03319652.06395328.88592304.08618512.03481568.01. 4210R v1: Detected core count of 202. 4210R v2: Detected core count of 203. 8280 v1: Detected core count of 284. 8280 v2: Detected core count of 285. 8280 v3: Detected core count of 286. 8280 2P v1: Detected core count of 567. 8280 2P v2: Detected core count of 568. 8280 2P v3: Detected core count of 569. 7282 2P: Detected core count of 32
OpenBenchmarking.orgMicroseconds x Thread, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Thread - Model: NASNet Mobile4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P4M8M12M16M20M6209080.06179040.06870304.06692392.06639304.012790657.617184608.017237024.06963136.01. 4210R v1: Detected thread count of 402. 4210R v2: Detected thread count of 403. 8280 v1: Detected thread count of 564. 8280 v2: Detected thread count of 565. 8280 v3: Detected thread count of 566. 8280 2P v1: Detected thread count of 1127. 8280 2P v2: Detected thread count of 1128. 8280 2P v3: Detected thread count of 1129. 7282 2P: Detected thread count of 64
OpenBenchmarking.orgMicroseconds x GHz, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Clock - Model: NASNet Mobile4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P130K260K390K520K650K496726.4494323.2490736.0478028.0474236.0456809.2613736.0615608.0304637.21. 4210R v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.202. 4210R v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.203. 8280 v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.004. 8280 v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.005. 8280 v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.006. 8280 2P v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.007. 8280 2P v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.008. 8280 2P v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.009. 7282 2P: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 2.80
OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: NASNet Mobile4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P30K60K90K120K150KMin: 155054 / Avg: 155227.33 / Max: 155511Min: 153973 / Avg: 154476 / Max: 154953Min: 121357 / Avg: 122683.67 / Max: 123379Min: 118973 / Avg: 119507 / Max: 119906Min: 118379 / Avg: 118559.33 / Max: 118910Min: 95589.9 / Avg: 114202.33 / Max: 133504Min: 135284 / Avg: 153433.6 / Max: 176482Min: 153383 / Avg: 153902 / Max: 154785Min: 108087 / Avg: 108799.33 / Max: 109430

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Mobilenet Float4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20K40K60K80K100KSE +/- 66.48, N = 3SE +/- 63.93, N = 3SE +/- 162.15, N = 3SE +/- 161.34, N = 3SE +/- 220.54, N = 3SE +/- 1916.53, N = 15SE +/- 647.40, N = 3SE +/- 1490.28, N = 15SE +/- 60.48, N = 3109921.0110052.074575.174240.673976.262934.772332.669538.948021.9
OpenBenchmarking.orgMicroseconds x Core, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Core - Model: Mobilenet Float4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P900K1800K2700K3600K4500K2198420.02201040.02088102.82078736.82071333.63524343.24050625.63894178.41536700.81. 4210R v1: Detected core count of 202. 4210R v2: Detected core count of 203. 8280 v1: Detected core count of 284. 8280 v2: Detected core count of 285. 8280 v3: Detected core count of 286. 8280 2P v1: Detected core count of 567. 8280 2P v2: Detected core count of 568. 8280 2P v3: Detected core count of 569. 7282 2P: Detected core count of 32
OpenBenchmarking.orgMicroseconds x Thread, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Thread - Model: Mobilenet Float4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2M4M6M8M10M4396840.04402080.04176205.64157473.64142667.27048686.48101251.27788356.83073401.61. 4210R v1: Detected thread count of 402. 4210R v2: Detected thread count of 403. 8280 v1: Detected thread count of 564. 8280 v2: Detected thread count of 565. 8280 v3: Detected thread count of 566. 8280 2P v1: Detected thread count of 1127. 8280 2P v2: Detected thread count of 1128. 8280 2P v3: Detected thread count of 1129. 7282 2P: Detected thread count of 64
OpenBenchmarking.orgMicroseconds x GHz, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Clock - Model: Mobilenet Float4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P80K160K240K320K400K351747.20352166.40298300.40296962.40295904.80251738.80289330.40278155.60134461.321. 4210R v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.202. 4210R v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.203. 8280 v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.004. 8280 v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.005. 8280 v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.006. 8280 2P v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.007. 8280 2P v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.008. 8280 2P v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.009. 7282 2P: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 2.80
OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Mobilenet Float4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20K40K60K80K100KMin: 109816 / Avg: 109920.67 / Max: 110044Min: 109935 / Avg: 110052.33 / Max: 110155Min: 74250.8 / Avg: 74575.1 / Max: 74737.5Min: 73920.6 / Avg: 74240.6 / Max: 74436.6Min: 73545 / Avg: 73976.23 / Max: 74272.1Min: 49562.5 / Avg: 62934.66 / Max: 75437.7Min: 71038 / Avg: 72332.6 / Max: 72999.7Min: 58519.9 / Avg: 69538.91 / Max: 77146.3Min: 47922 / Avg: 48021.87 / Max: 48130.9

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20K40K60K80K100KSE +/- 97.74, N = 3SE +/- 171.12, N = 3SE +/- 47.48, N = 3SE +/- 98.01, N = 3SE +/- 133.45, N = 3SE +/- 1621.78, N = 15SE +/- 1177.33, N = 15SE +/- 1711.56, N = 12SE +/- 81.92, N = 3113742.0113566.076579.276592.075997.264430.169941.667326.249668.3
OpenBenchmarking.orgMicroseconds x Core, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Core - Model: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P800K1600K2400K3200K4000K2274840.02271320.02144217.62144576.02127921.63608085.63916729.63770267.21589385.61. 4210R v1: Detected core count of 202. 4210R v2: Detected core count of 203. 8280 v1: Detected core count of 284. 8280 v2: Detected core count of 285. 8280 v3: Detected core count of 286. 8280 2P v1: Detected core count of 567. 8280 2P v2: Detected core count of 568. 8280 2P v3: Detected core count of 569. 7282 2P: Detected core count of 32
OpenBenchmarking.orgMicroseconds x Thread, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Thread - Model: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P2M4M6M8M10M4549680.04542640.04288435.24289152.04255843.27216171.27833459.27540534.43178771.21. 4210R v1: Detected thread count of 402. 4210R v2: Detected thread count of 403. 8280 v1: Detected thread count of 564. 8280 v2: Detected thread count of 565. 8280 v3: Detected thread count of 566. 8280 2P v1: Detected thread count of 1127. 8280 2P v2: Detected thread count of 1128. 8280 2P v3: Detected thread count of 1129. 7282 2P: Detected thread count of 64
OpenBenchmarking.orgMicroseconds x GHz, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Clock - Model: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P80K160K240K320K400K363974.40363411.20306316.80306368.00303988.80257720.40279766.40269304.80139071.241. 4210R v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.202. 4210R v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.203. 8280 v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.004. 8280 v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.005. 8280 v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.006. 8280 2P v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.007. 8280 2P v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.008. 8280 2P v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.009. 7282 2P: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 2.80
OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Mobilenet Quant4210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20K40K60K80K100KMin: 113567 / Avg: 113741.67 / Max: 113905Min: 113231 / Avg: 113565.67 / Max: 113795Min: 76486 / Avg: 76579.2 / Max: 76641.6Min: 76401.5 / Avg: 76591.97 / Max: 76727.3Min: 75752.6 / Avg: 75997.17 / Max: 76212Min: 53845.3 / Avg: 64430.14 / Max: 75867.7Min: 62904.8 / Avg: 69941.63 / Max: 76355.8Min: 58964.5 / Avg: 67326.23 / Max: 78575.1Min: 49576.1 / Avg: 49668.3 / Max: 49831.7

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P400K800K1200K1600K2000KSE +/- 9019.28, N = 3SE +/- 4314.23, N = 3SE +/- 1031.28, N = 3SE +/- 788.48, N = 3SE +/- 383.68, N = 3SE +/- 5901.31, N = 3SE +/- 8738.98, N = 3SE +/- 15046.75, N = 3SE +/- 990.14, N = 320535802041053139055313876101386137935544973260980449936345
OpenBenchmarking.orgMicroseconds x Core, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Core - Model: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P12M24M36M48M60M4107160040821060389354843885308038811836523904645450256054905144299630401. 4210R v1: Detected core count of 202. 4210R v2: Detected core count of 203. 8280 v1: Detected core count of 284. 8280 v2: Detected core count of 285. 8280 v3: Detected core count of 286. 8280 2P v1: Detected core count of 567. 8280 2P v2: Detected core count of 568. 8280 2P v3: Detected core count of 569. 7282 2P: Detected core count of 32
OpenBenchmarking.orgMicroseconds x Thread, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Thread - Model: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P20M40M60M80M100M8214320081642120778709687770616077623672104780928109005120109810288599260801. 4210R v1: Detected thread count of 402. 4210R v2: Detected thread count of 403. 8280 v1: Detected thread count of 564. 8280 v2: Detected thread count of 565. 8280 v3: Detected thread count of 566. 8280 2P v1: Detected thread count of 1127. 8280 2P v2: Detected thread count of 1128. 8280 2P v3: Detected thread count of 1129. 7282 2P: Detected thread count of 64
OpenBenchmarking.orgMicroseconds x GHz, Fewer Is BetterTensorFlow Lite 2020-08-23Performance Per Clock - Model: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P1.4M2.8M4.2M5.6M7M6571456.06531369.65562212.05550440.05544548.03742176.03893040.03921796.02621766.01. 4210R v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.202. 4210R v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 3.203. 8280 v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.004. 8280 v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.005. 8280 v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.006. 8280 2P v1: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.007. 8280 2P v2: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.008. 8280 2P v3: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 4.009. 7282 2P: Detected GHz base clock speed (use PTS sensors for real-time frequency/sensor reporting) count of 2.80
OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2020-08-23Model: Inception ResNet V24210R v14210R v28280 v18280 v28280 v38280 2P v18280 2P v28280 2P v37282 2P400K800K1200K1600K2000KMin: 2040410 / Avg: 2053580 / Max: 2070840Min: 2034200 / Avg: 2041053.33 / Max: 2049020Min: 1389390 / Avg: 1390553.33 / Max: 1392610Min: 1386220 / Avg: 1387610 / Max: 1388950Min: 1385600 / Avg: 1386136.67 / Max: 1386880Min: 924598 / Avg: 935544 / Max: 944840Min: 955926 / Avg: 973260.33 / Max: 983864Min: 953272 / Avg: 980449 / Max: 1005230Min: 934494 / Avg: 936345 / Max: 937880

OpenBenchmarking.org Community User Comments

Post A Comment