CUDA Caffe NVIDIA Comparison

CUDA 8.0 + cuDNN Caffe deep learning benchmarks with many different GPUs. Tests by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1702028-TA-1611066TA46

Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Only show results where is faster than

Only show results matching title/arguments (delimit multiple options with a comma):

Do not show results matching title/arguments (delimit multiple options with a comma):

CUDA Caffe NVIDIA Comparison CUDA 8.0 + cuDNN Caffe deep learning benchmarks with many different GPUs. Tests by Michael Larabel. ,,"GTX 680","GTX 760","GTX 780 Ti","GTX 950","GTX 960","GTX 970","GTX 980","GTX 980 Ti","GTX 1050","GTX 1050 Ti","GTX 1060","GTX 1070","GTX 1080","ubu_ml2","ubu_ml_375.26" Processor,,Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores),2 x Intel 0000 @ 3.00GHz (48 Cores),2 x Intel 0000 @ 3.00GHz (48 Cores) Motherboard,,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,MSI C236A WORKSTATION (MS-7998) v1.0,Supermicro X10DRi-LN4+ v1.01,Supermicro X10DRi-LN4+ v1.01 Chipset,,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Sky Lake,Intel Xeon E7 v4/Xeon,Intel Xeon E7 v4/Xeon Memory,,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,16384MB,64512MB,64512MB Disk,,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,256GB INTEL SSDPEKKW256G7,1000GB My Passport 0820,1000GB My Passport 0820 Graphics,,NVIDIA GeForce GTX 680 2048MB (1006/3004MHz),NVIDIA GeForce GTX 760 2048MB (980/3004MHz),NVIDIA GeForce GTX 780 Ti 3072MB (875/3500MHz),eVGA NVIDIA GeForce GTX 950 2048MB (1201/3304MHz),eVGA NVIDIA GeForce GTX 960 2048MB (1277/3505MHz),eVGA NVIDIA GeForce GTX 970 4096MB (1163/3505MHz),NVIDIA GeForce GTX 980 4096MB (135/324MHz),NVIDIA GeForce GTX 980 Ti 6144MB (999/3505MHz),Zotac NVIDIA GeForce GTX 1050 2048MB (1316/3504MHz),eVGA NVIDIA GeForce GTX 1050 Ti 4096MB (1341/3504MHz),NVIDIA GeForce GTX 1060 6GB 6144MB (1506/4006MHz),NVIDIA GeForce GTX 1070 8192MB (1505/4006MHz),NVIDIA GeForce GTX 1080 8192MB (1615/5005MHz),, Audio,,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,Realtek ALC1150,NVIDIA Device 10f0,NVIDIA Device 10f0 Network,,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel Connection,Intel I350 Gigabit Connection,Intel I350 Gigabit Connection OS,,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04,Ubuntu 16.04 Kernel,,4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.8.4-040804-generic (x86_64),4.4.0-59-generic (x86_64),4.4.0-59-generic (x86_64) Desktop,,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,Unity 7.4.0,, Display Server,,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,X Server 1.18.4,, Display Driver,,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,NVIDIA 375.10,, OpenGL,,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,4.5.0,, Vulkan,,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.8,1.0.24 Compiler,,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + LLVM 3.8.0 + CUDA 8.0,GCC 5.4.0 20160609 + CUDA 8.0,GCC 5.4.0 20160609 + CUDA 8.0 File-System,,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4,ext4 Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,3840x2160,1024x768,1024x768 ,,"GTX 680","GTX 760","GTX 780 Ti","GTX 950","GTX 960","GTX 970","GTX 980","GTX 980 Ti","GTX 1050","GTX 1050 Ti","GTX 1060","GTX 1070","GTX 1080","ubu_ml2","ubu_ml_375.26" "Caffe AlexNet - Build: CUDA AlexNet (ms)",LIB,54520.37,66711.23,28177.90,30783.13,27512.80,16987.30,15013.43,11652.17,30970.00,27452.53,16184.70,11438.00,9630.36,9452.12,9781.05 "Caffe AlexNet - GPU Temperature Monitor (Celsius)",LIB,68.04,72.38,61.67,57.46,53.55,45.86,51.43,52.67,42,45.31,41.29,43,42.6,, "Caffe AlexNet - System Power Consumption Monitor (Watts)",LIB,190.05,190.92,256.14,129.66,129.82,162.51,186.13,210.6,98.84,94.01,134.46,149.37,188.6,, "Caffe AlexNet - Build: CUDA Googlenet (ms)",LIB,138342,164643,65152.00,69528.20,60318.23,40193.77,36217.23,31349.83,70347.70,61541.57,37604.73,27661.90,24019.97,25975.07,25979.53 "Caffe AlexNet - GPU Temperature Monitor (Celsius)",LIB,76.94,78.92,75.4,68.12,68.64,55.05,68.25,72.07,49.79,55.69,51.89,57.69,56.27,, "Caffe AlexNet - System Power Consumption Monitor (Watts)",LIB,200.58,204.65,263.36,137.23,150.46,181.07,197.86,225.77,101.99,95.11,144.81,164.62,182.39,, "GPU Temperature Monitor - Phoronix Test Suite System Monitoring (Celsius)",,73.59,76.14,70.44,63.23,62.53,50.28,61.1,64.35,46.2,51.15,47.83,52.08,50.95,, "System Power Consumption Monitor - Phoronix Test Suite System Monitoring (Watts)",,193.35,196.96,241.86,127.39,136.19,161.86,177.58,194.02,96.75,90.28,126.82,146.82,165.2,,