Caffe AlexNet

This is a benchmark of the Caffe deep learning framework and currently supports the AlexNet and Googlenet model and execution on both CPUs and NVIDIA GPUs.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark caffe.

Project Site

caffe.berkeleyvision.org

Test Created

14 November 2015

Last Updated

26 September 2020

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

32 Seconds

Average Run Time

2 Minutes, 1 Second

Accolades

100k+ Downloads

Supported Platforms

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Wed, 20 Jan 2021 01:14:50 GMT.

Revision History

pts/caffe-1.5.0 [View Source] Sat, 26 Sep 2020 21:35:45 GMT
Overhaul Caffe test profile with latest Git snapshot, switch to CMake build system, clean up test options, etc.

pts/caffe-1.4.0 [View Source] Sat, 29 Dec 2018 11:15:41 GMT
Update Caffe to latest Git snapshot to hopefully workaround build problems on newer distros.

pts/caffe-1.3.3 [View Source] Sun, 01 Apr 2018 18:50:19 GMT
Basic fix for OpenCV 3.4.

pts/caffe-1.3.2 [View Source] Wed, 04 Jan 2017 11:07:36 GMT
Fix for OpenCV 3.2.

pts/caffe-1.3.1 [View Source] Wed, 28 Dec 2016 20:36:42 GMT
Don't show title string of "Caffe AlexNet" but "Caffe" with recent test profile versions supporting more than just AlexNet.

pts/caffe-1.3.0 [View Source] Wed, 28 Dec 2016 20:34:27 GMT
Update to latest Git snapshot to fix OpenCV compatibility.

pts/caffe-1.2.0 [View Source] Mon, 15 Aug 2016 16:11:16 GMT
Add Googlenet support, decrease CPU only iteration count.

pts/caffe-1.1.1 [View Source] Sun, 12 Jun 2016 18:32:44 GMT
Add OpenCV and OpenBLAS support.

pts/caffe-1.1.0 [View Source] Sat, 11 Jun 2016 19:32:55 GMT
Update

pts/caffe-1.0.0 [View Source] Sat, 14 Nov 2015 15:29:45 GMT
Initial commit of Caffe deep learning framework and with this benchmark using the AlexNet model for benchmarking.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

NVIDIA GPU Compute

Performance Metrics

Analyze Test Configuration:

Caffe 2020-02-13

Model: AlexNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.org metrics for this test profile configuration based on 447 public results since 26 September 2020 with the latest data as of 18 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

Milli-Seconds (Average)

Intel Core i5-8400

100th

31313 ^{+/- 140}

Intel Core i5-9400F

99th

32010 ^{+/- 67}

Intel Core i3-8100

99th

34822 ^{+/- 9}

AMD Ryzen 7 5800X 8-Core

98th

35373 ^{+/- 193}

AMD Ryzen 5 5600X 6-Core

96th

36528 ^{+/- 290}

Intel Core i5-7600K

95th

37173 ^{+/- 22}

AMD Ryzen 3 3300X 4-Core

93rd

37955 ^{+/- 132}

Intel Core i5-6500

92nd

38315 ^{+/- 72}

AMD Ryzen 9 5900X 12-Core

92nd

38664 ^{+/- 1255}

Intel Xeon E-2288G

90th

39683 ^{+/- 446}

Intel Core i5-4670

88th

40100 ^{+/- 99}

AMD Ryzen 9 5950X 16-Core

88th

40193 ^{+/- 288}

Intel Core i9-9900KS

86th

40696 ^{+/- 46}

AMD Ryzen 3 2200G

85th

41490 ^{+/- 228}

Intel Core i9-10980XE

83rd

42896 ^{+/- 16}

Intel Core i7-9700TE

83rd

43703 ^{+/- 1085}

Intel Core i9-9900K

83rd

44032 ^{+/- 123}

Intel Core i5-10600K

81st

44786 ^{+/- 117}

AMD Ryzen 3 1300X

80th

46908 ^{+/- 38}

Intel Core i7-7900X

79th

48030 ^{+/- 65}

Intel Xeon Gold 5217

79th

48632

AMD Ryzen 3 3100 4-Core

78th

49030 ^{+/- 55}

AMD Ryzen 5 3600XT 6-Core

76th

50195 ^{+/- 92}

Intel Xeon Silver 4215R

76th

50835

Mid-Tier

75th

> 50835

AMD Ryzen 9 3950X 16-Core

75th

51637 ^{+/- 187}

AMD Ryzen 7 3700X 8-Core

74th

51775 ^{+/- 77}

AMD Ryzen 7 3800XT 8-Core

74th

51822 ^{+/- 2121}

Intel Core i7-7700K

73rd

52433 ^{+/- 1007}

Intel Xeon Gold 6226R

73rd

52864

Intel Core i7-8086K

69th

53894 ^{+/- 254}

AMD Ryzen 9 3900XT 12-Core

69th

53938 ^{+/- 2643}

Intel Core i7-8700K

68th

54246 ^{+/- 97}

AMD Ryzen 9 3900X 12-Core

68th

54528 ^{+/- 194}

AMD Ryzen Threadripper 3990X 64-Core

66th

55134 ^{+/- 1125}

AMD Ryzen 5 4500U

66th

55743 ^{+/- 343}

Intel Xeon Gold 5218

66th

55863

Intel Xeon Silver 4214R

64th

56188

Intel Core i7-4790K

63rd

57031 ^{+/- 72}

AMD Ryzen 7 1800X Eight-Core

62nd

58695 ^{+/- 367}

Intel Xeon E3-1275 v6

62nd

58792 ^{+/- 45}

Intel Xeon E5-1680 v3

60th

59244 ^{+/- 55}

Intel Xeon E5-2609 v4

59th

59847 ^{+/- 31}

Intel Core i3-10100

59th

60055 ^{+/- 341}

AMD Ryzen 7 2700X Eight-Core

58th

60184 ^{+/- 65}

Intel Core i9-7980XE

58th

60383 ^{+/- 85}

Intel Core i7-7740K

56th

60847 ^{+/- 97}

Intel Core i5-2500K

54th

60956 ^{+/- 44}

AMD Ryzen 7 2700 Eight-Core

54th

61442 ^{+/- 484}

AMD EPYC 7662 64-Core

54th

61568

AMD EPYC 7702 64-Core

52nd

62139

Median

50th

62610

Intel Core i5-3470

50th

62756 ^{+/- 661}

Intel Xeon Silver 4216

50th

63592 ^{+/- 3987}

AMD Ryzen Threadripper 3960X 24-Core

50th

63674 ^{+/- 138}

AMD Ryzen Threadripper 3970X 32-Core

49th

63878 ^{+/- 2643}

Intel Core i7-4770K

49th

63959 ^{+/- 372}

Intel Core i7-5960X

48th

64167 ^{+/- 112}

Intel Core i7-5775C

47th

64360 ^{+/- 4536}

Intel Core i7-1065G7

47th

64670 ^{+/- 1103}

2 x Intel Xeon Gold 5220R

46th

65462 ^{+/- 825}

Intel Xeon E3-1280 v5

46th

65525 ^{+/- 14}

Intel Xeon E3-1245 v5

44th

66966 ^{+/- 92}

Intel Xeon E5-2687W v3

43rd

67388 ^{+/- 194}

Intel Xeon E3-1260L v5

41st

68781 ^{+/- 164}

AMD EPYC 7552 48-Core

40th

68979

AMD EPYC 7F32 8-Core

37th

69294 ^{+/- 545}

AMD EPYC 7642 48-Core

36th

70290

AMD EPYC 7F52 16-Core

35th

70420 ^{+/- 1606}

AMD FX-8370 Eight-Core

34th

70911 ^{+/- 127}

Intel Core i7-9750H

33rd

71502 ^{+/- 272}

Intel Core i7-4960X

32nd

71788 ^{+/- 91}

Intel Core i3-7100

31st

73006 ^{+/- 157}

AMD EPYC 7302P 16-Core

31st

73660

AMD EPYC 7262 8-Core

29th

74361

AMD EPYC 7402P 24-Core

29th

74842

AMD EPYC 7F72 24-Core

26th

75063 ^{+/- 162}

AMD EPYC 7282 16-Core

26th

75192

Low-Tier

25th

> 75192

AMD EPYC 7232P 8-Core

24th

75301

AMD Ryzen Threadripper 2950X 16-Core

23rd

75656 ^{+/- 796}

AMD EPYC 7252 8-Core

22nd

76141

2 x AMD EPYC 7742 64-Core

22nd

76325 ^{+/- 1670}

AMD EPYC 7542 32-Core

21st

79050

Intel Core i7-6700HQ

20th

79454 ^{+/- 240}

AMD EPYC 7272 12-Core

19th

80200

AMD EPYC 7502 32-Core

18th

81683

AMD FX-8150 Eight-Core

17th

81789 ^{+/- 576}

AMD EPYC 7502P 32-Core

17th

81848

Intel Core i7-8550U

16th

83498 ^{+/- 14682}

AMD EPYC 7352 24-Core

15th

84809

Intel Core i9-10900K

14th

84810

AMD EPYC 7452 32-Core

13th

85230

AMD Ryzen Threadripper 2970WX 24-Core

12th

85495 ^{+/- 382}

Intel Core i7-1165G7

12th

85526 ^{+/- 1817}

Intel Core i7-5600U

11th

86210 ^{+/- 644}

AMD EPYC 7532 32-Core

10th

88694

Intel Core i7-8565U

8th

95251 ^{+/- 13722}

AMD A10-7850K APU

8th

96699 ^{+/- 6657}

AMD Ryzen 3 3200U

7th

103280 ^{+/- 3062}

AMD EPYC 7601 32-Core

6th

107071

Intel Core i7-2700K

3rd

121367 ^{+/- 4283}

AMD EPYC 7551 32-Core

3rd

124930 ^{+/- 1779}

Intel Core i3-4130

2nd

127752 ^{+/- 382}

Intel Core i5-2520M

1st

151504 ^{+/- 48}

Based on OpenBenchmarking.org data, the selected test / test configuration (Caffe 2020-02-13 - Model: AlexNet - Acceleration: CPU - Iterations: 100) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

Recent Test Results

User Comments

Update for new CuDNN libraries?

I recently ran this test and found I had to use v5.1 or earlier to compile and couldn't get v6 or v7 to compile as there was an enumeration case not handled. Have I missed something?

v/r,
LabUserBen

Post by labuserben on 19 September 2017, 09.32.

Ryzen 3 2200G 2021 3 Systems - 191 Benchmark Results	AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1
xps13-caffe-ultraperfbios-wayland-20210113-1 1 System - 2 Benchmark Results	Intel Core i7-1165G7 - Dell 08607K - Intel Device a0ef Ubuntu 20.04 - 5.6.0-1042-oem - GNOME Shell 3.36.4
POWER9 44c 176t 2021 4 Systems - 210 Benchmark Results	POWER9 - PowerNV T2P9D01 REV 1.01 - 64GB Ubuntu 20.10 - 5.9.10-050910-generic - X Server
AMD FX-8370 2021 2 Systems - 183 Benchmark Results	AMD FX-8370 Eight-Core - MSI 970 GAMING - AMD RD9x0 Ubuntu 20.10 - 5.8.0-33-generic - GNOME Shell 3.38.1
Core i7 5960X 2021 3 Systems - 313 Benchmark Results	Intel Core i7-5960X - ASRock X99 Extreme3 - Intel Xeon E7 v3 Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4
AMD FX-8150 Featured Graphics Comparison	AMD FirePro V5800 - AMD FirePro V5800 1GB
AMD EPYC 7F52 Featured Kernel Comparison	5.10.3-051003-generic - 5.11.0-rc1-phx
AMD EPYC 7F52 Featured Kernel Comparison	5.8.0-050800rc6daily20200721-generic - 5.10.3-051003-generic
TR 3970X Linux 5.11 Featured Kernel Comparison	5.10.3-051003-generic - 5.11.0-rc1-phx
Core i7 5775C EOY 2020 3 Systems - 122 Benchmark Results	Intel Core i7-5775C - MSI Z97-G45 GAMING - Intel Broadwell-U DMI Ubuntu 18.10 - 5.0.0-999-generic - GNOME Shell 3.30.2
Core i7 7740X Xmas 3 Systems - 142 Benchmark Results	Intel Core i7-7740K - Gigabyte X299 AORUS Gaming-CF - Intel Xeon E3-1200 v6 Ubuntu 18.10 - 4.18.0-25-generic - GNOME Shell 3.30.2
Ryzen 9 5950X Linux 5.11 Regression Schedutil Featured Kernel Comparison	5.10.2-051002-generic - 5.10.0-phx

Sandy 3 Systems - 268 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 32 - 5.8.11-200.fc32.x86_64 - GNOME Shell 3.36.6
Pre 10.0 Xeon 3 Systems - 40 Benchmark Results	2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4
Core i9 10900K - Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 403 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 3 Systems - 406 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Core i5 10600K October 3 Systems - 131 Benchmark Results	Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900daily20201012-generic - GNOME Shell 3.36.4
Ryzen 5 3600X 10.0 L 3 Systems - 31 Benchmark Results	AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4
7700K Intel 2020 3 Systems - 202 Benchmark Results	Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4
TR 3990X Okt 3 Systems - 100 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
Ryzen 9 3900X Pre 10.0 3 Systems - 32 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4
Intel Xeon On Ubuntu 20.10 Featured Processor Comparison	Intel Xeon Gold 5217 - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0
Ryzen 7 1800X Okt 3 Systems - 25 Benchmark Results	AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD 17h Debian 10 - 4.19.0-11-amd64 - X Server 1.20.4

Caffe AlexNet

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

Caffe 2020-02-13

Model: AlexNet - Acceleration: CPU - Iterations: 100

Recent Test Results

Most Popular Test Results

User Comments

Update for new CuDNN libraries?