Caffe AlexNet

This is a benchmark of the Caffe deep learning framework and currently uses the AlexNet model.

Learn more about this test at the upstream project site: http://caffe.berkeleyvision.org/.

This benchmark test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 14 November 2015 and last updated on 26 September 2020. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark caffe.

This test has an average install time of 1 second and an average run-time of 2 minutes, 1 second.

100k+ Downloads

Installation StatsTest Completion StatsOpenBenchmarking.orgEventsCaffe AlexNet Popularitypts/caffe2015.112016.012016.032016.072016.092016.112017.012017.032017.052017.072017.092017.112018.012018.032018.052018.072018.092018.112019.012019.032019.062020.012020.07110220330440550

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting.

GoogleNet49.6%AlexNet50.4%Model Option PopularityOpenBenchmarking.org
NVIDIA CUDA 31.8%CPU68.2%Acceleration Option PopularityOpenBenchmarking.org
20042.0%100016.3%10041.7%Iterations Option PopularityOpenBenchmarking.org

Revision History

pts/caffe-1.5.0   [View Source]   26 Sep 2020 21:35 EDT
Overhaul Caffe test profile with latest Git snapshot, switch to CMake build system, clean up test options, etc.

pts/caffe-1.4.0   [View Source]   29 Dec 2018 11:15 EST
Update Caffe to latest Git snapshot to hopefully workaround build problems on newer distros.

pts/caffe-1.3.3   [View Source]   01 Apr 2018 18:50 EDT
Basic fix for OpenCV 3.4.

pts/caffe-1.3.2   [View Source]   04 Jan 2017 11:07 EST
Fix for OpenCV 3.2.

pts/caffe-1.3.1   [View Source]   28 Dec 2016 20:36 EST
Don't show title string of "Caffe AlexNet" but "Caffe" with recent test profile versions supporting more than just AlexNet.

pts/caffe-1.3.0   [View Source]   28 Dec 2016 20:34 EST
Update to latest Git snapshot to fix OpenCV compatibility.

pts/caffe-1.2.0   [View Source]   15 Aug 2016 16:11 EDT
Add Googlenet support, decrease CPU only iteration count.

pts/caffe-1.1.1   [View Source]   12 Jun 2016 18:32 EDT
Add OpenCV and OpenBLAS support.

pts/caffe-1.1.0   [View Source]   11 Jun 2016 19:32 EDT
Update

pts/caffe-1.0.0   [View Source]   14 Nov 2015 15:29 EST
Initial commit of Caffe deep learning framework and with this benchmark using the AlexNet model for benchmarking.

Suites Using This Test

Machine Learning

NVIDIA GPU Compute

Performance Metrics

Analyze Test Configuration:

Caffe 2020-02-13

Model: AlexNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.org metrics for this test profile configuration based on 219 public samples since 26 September 2020 with the latest data as of 21 October 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Milli-Seconds (Average)
Mid-Tier
75th
> 104104
Median
50th
119485
Low-Tier
25th
> 137153
OpenBenchmarking.orgDistribution Of Public Results - Model: AlexNet - Acceleration: CPU - Iterations: 200219 Results Range From 56145 To 251777 Milli-Seconds561456005863971678847179775710796238353687449913629527599188103101107014110927114840118753122666126579130492134405138318142231146144150057153970157883161796165709169622173535177448181361185274189187193100197013200926204839208752212665216578220491224404228317232230236143240056243969247882251795510152025

Based on OpenBenchmarking.org data, the selected test / test configuration (Caffe 2020-02-13 - Model: AlexNet - Acceleration: CPU - Iterations: 200) has an average run-time of 7 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkModel: AlexNet - Acceleration: CPU - Iterations: 200Run-Time510152025Min: 3 / Avg: 6.61 / Max: 22

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsModel: AlexNet - Acceleration: CPU - Iterations: 200Deviation246810Min: 0 / Avg: 0.21 / Max: 3

Recent Test Results

Compare

1 System - 295 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.04 - 5.4.0-7642-generic - GNOME Shell 3.36.4

1 System - 132 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 197 Benchmark Results

AMD Ryzen 3 1300X - ASRock AB350 Pro4 - AMD 17h

Ubuntu 20.04 - 5.9.0-050900daily20201021-generic - GNOME Shell 3.36.4

3 Systems - 232 Benchmark Results

Intel Core i7-4960X - MSI X79MA-GD45 - Intel Xeon E7 v2

Ubuntu 19.10 - 5.3.0-40-generic - GNOME Shell 3.34.1

5 Systems - 44 Benchmark Results

2 x Intel Xeon Gold 6238R - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 5.3.0-40-generic - GNOME Shell 3.28.4

1 System - 290 Benchmark Results

AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4

3 Systems - 103 Benchmark Results

Intel Core i7-4770K - Gigabyte Z97-HD3 - Intel 4th Gen Core DRAM

Ubuntu 20.10 - 5.8.0-21-generic - GNOME Shell 3.38.0

3 Systems - 31 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

3 Systems - 32 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4

Most Popular Test Results

Compare

2 Systems - 535 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

3 Systems - 406 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 31 Benchmark Results

AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4

3 Systems - 131 Benchmark Results

Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-45-generic - GNOME Shell 3.36.4

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4

3 Systems - 32 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4

3 Systems - 25 Benchmark Results

AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD 17h

Debian 10 - 4.19.0-11-amd64 - X Server 1.20.4

3 Systems - 41 Benchmark Results

Intel Xeon E3-1231 v3 - Gigabyte H81M-S1 - Intel Xeon E3-1200 v3 DRAM

Debian 10 - 4.19.0-11-amd64 - X Server 1.20.4

3 Systems - 68 Benchmark Results

Intel Core i5-2500K - SAPPHIRE Pure Black P67 Hydra - Intel 2nd Generation Core DRAM

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.4

3 Systems - 100 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4

Find More Test Results


User Comments

Update for new CuDNN libraries?

I recently ran this test and found I had to use v5.1 or earlier to compile and couldn't get v6 or v7 to compile as there was an enumeration case not handled. Have I missed something?

v/r,
LabUserBen

Post by labuserben on 19 September 2017, 09.32.

Post A Comment