GCC 4.9 vs. LLVM Clang 3.5 Linux Compiler Benchmarks

Some early compiler benchmarks of LLVM Clang 3.5 SVN against GCC 4.9.0 RC1 on Ubuntu 14.04 LTS with the Linux 3.13 kernel and using an Intel Core i7 4770K Haswell system. Benchmarks by Michael Larabel for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1404144-KH-CLANG359076
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Audio Encoding 2 Tests
Timed Code Compilation 3 Tests
C/C++ Compiler Tests 9 Tests
CPU Massive 10 Tests
Creator Workloads 6 Tests
Encoding 3 Tests
Multi-Core 8 Tests
Programmer / Developer System Benchmarks 3 Tests
Renderers 2 Tests
Server 2 Tests
Server CPU Tests 3 Tests
Single-Threaded 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
GCC 4.8.2
April 12 2014
 
GCC 4.9.0 RC1
April 12 2014
 
LLVM Clang 3.5 20140413
April 13 2014
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

GCC 4.8.2

Processor: Intel Core i7-4770K @ 3.50GHz (8 Cores), Motherboard: ECS Z87H3-A2X EXTREME v1.0, Chipset: Intel 4th Gen Core DRAM, Memory: 16384MB, Disk: 120GB Samsung SSD 840, Graphics: ECS NVIDIA GeForce GTX 460 768MB (675/1804MHz), Audio: Realtek ALC1150, Monitor: Samsung SyncMaster, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 14.04, Kernel: 3.13.0-22-generic (x86_64), Desktop: Unity 7.2.0, Display Server: X Server 1.15.0, Display Driver: NVIDIA 337.12, OpenGL: 4.3.0, Compiler: GCC 4.8.2, File-System: ext4, Screen Resolution: 2560x1600

Compiler Notes: --enable-checking=release
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

GCC 4.9.0 RC1

OS: Ubuntu 14.04, Kernel: 3.13.0-22-generic (x86_64), Desktop: Unity 7.2.0, Display Server: X Server 1.15.0, Display Driver: NVIDIA 337.12, OpenGL: 4.3.0, Compiler: GCC 4.9.0 20140411, File-System: ext4, Screen Resolution: 2560x1600

LLVM Clang 3.5 20140413

OS: Ubuntu 14.04, Kernel: 3.13.0-22-generic (x86_64), Desktop: Unity 7.2.0, Display Server: X Server 1.15.0, Display Driver: NVIDIA 337.12, OpenGL: 4.3.0, Compiler: Clang 3.5.0-1~exp1, File-System: ext4, Screen Resolution: 2560x1600

Processor Notes: Scaling Governor: acpi-cpufreq ondemand

GCC 4.9 vs. LLVM Clang 3.5 Linux Compiler BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-4770K @ 3.50GHz (8 Cores)ECS Z87H3-A2X EXTREME v1.0Intel 4th Gen Core DRAM16384MB120GB Samsung SSD 840ECS NVIDIA GeForce GTX 460 768MB (675/1804MHz)Realtek ALC1150Samsung SyncMasterRealtek RTL8111/8168/8411Ubuntu 14.043.13.0-22-generic (x86_64)Unity 7.2.0X Server 1.15.0NVIDIA 337.124.3.0GCC 4.8.2GCC 4.9.0 20140411Clang 3.5.0-1~exp1ext42560x1600ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilersFile-SystemScreen ResolutionGCC 4.9 Vs. LLVM Clang 3.5 Linux Compiler Benchmarks PerformanceSystem Logs- GCC 4.8.2, GCC 4.9.0 RC1: --enable-checking=release- Scaling Governor: acpi-cpufreq ondemand

GCC 4.8.2GCC 4.9.0 RC1LLVM Clang 3.5 20140413Result OverviewPhoronix Test Suite100%126%152%179%Timed ImageMagick CompilationGraphicsMagickTimed PHP CompilationHierarchical INTegrationTimed Apache CompilationC-RayFLAC Audio EncodingLAME MP3 EncodingHimeno BenchmarkApache BenchmarkFFmpegebizzy

GCC 4.9 vs. LLVM Clang 3.5 Linux Compiler Benchmarksgraphics-magick: Blurgraphics-magick: Sharpengraphics-magick: Resizinggraphics-magick: HWB Color Spacegraphics-magick: Local Adaptive Thresholdinghimeno: Poisson Pressure Solverbuild-apache: Time To Compilebuild-imagemagick: Time To Compilebuild-php: Time To Compilec-ray: Total Timeebizzy: Records/ssmallpt: Global Illumination Renderer; 100 Samplesencode-flac: WAV To FLACencode-mp3: WAV To MP3ffmpeg: H.264 HD To NTSC DVhint: FLOATapache: Static Web Page ServingGCC 4.8.2GCC 4.9.0 RC1LLVM Clang 3.5 20140413170140198216971810.1027.1460.3526.2716.9842849244.8212.4213.99367476347.0035904.531661401992141021828.1527.8860.5927.0517.09429503.7010.8713.80373674384.8335953.73876195155941954.2618.0029.6116.2525.84432021344.2313.4913.89237448328.6736432.04OpenBenchmarking.org

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests to stress the system's CPU. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: BlurGCC 4.8.2GCC 4.9.0 RC1LLVM Clang 3.5 201404134080120160200SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 317016687-std=gnu99 -fopenmp-std=gnu99 -fopenmp1. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lX11 -llzma -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: SharpenGCC 4.9.0 RC1GCC 4.8.2LLVM Clang 3.5 20140413306090120150SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 314014061-std=gnu99 -fopenmp-std=gnu99 -fopenmp1. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lX11 -llzma -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: ResizingGCC 4.9.0 RC1GCC 4.8.2LLVM Clang 3.5 201404134080120160200SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 319919895-std=gnu99 -fopenmp-std=gnu99 -fopenmp1. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lX11 -llzma -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: HWB Color SpaceGCC 4.8.2GCC 4.9.0 RC1LLVM Clang 3.5 2014041350100150200250SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3216214155-std=gnu99 -fopenmp-std=gnu99 -fopenmp1. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lX11 -llzma -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: Local Adaptive ThresholdingGCC 4.9.0 RC1GCC 4.8.2LLVM Clang 3.5 2014041320406080100SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 31029794-std=gnu99 -fopenmp-std=gnu99 -fopenmp1. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lX11 -llzma -lxml2 -lz -lm -lpthread

Himeno Benchmark

The Himeno benchmark is a linear solver of pressure Poisson using a point-Jacobi method. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLLVM Clang 3.5 20140413GCC 4.9.0 RC1GCC 4.8.2400800120016002000SE +/- 12.20, N = 3SE +/- 1.31, N = 3SE +/- 3.93, N = 31954.261828.151810.101. (CC) gcc options: -O3 -march=native

Timed Apache Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.7Time To CompileLLVM Clang 3.5 20140413GCC 4.8.2GCC 4.9.0 RC1714212835SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 318.0027.1427.88

Timed ImageMagick Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.8.1-10Time To CompileLLVM Clang 3.5 20140413GCC 4.8.2GCC 4.9.0 RC11428425670SE +/- 0.14, N = 3SE +/- 0.36, N = 3SE +/- 0.04, N = 329.6160.3560.59

Timed PHP Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 5.2.9Time To CompileLLVM Clang 3.5 20140413GCC 4.8.2GCC 4.9.0 RC1612182430SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 316.2526.2727.051. (CC) gcc options: -O3 -march=native -pedantic -ldl -lz -lm

C-Ray

This is a test of C-Ray, a simple raytracer designed to test the floating-point CPU performance. This test is multi-threaded (16 threads per core), will shoot 8 rays per pixel for anti-aliasing, and will generate a 1600 x 1200 image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeGCC 4.8.2GCC 4.9.0 RC1LLVM Clang 3.5 20140413612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 316.9817.0925.841. (CC) gcc options: -lm -lpthread -O3 -march=native

ebizzy

OpenBenchmarking.orgSeconds, More Is Betterebizzy 0.3Records/sLLVM Clang 3.5 20140413GCC 4.9.0 RC1GCC 4.8.29K18K27K36K45KSE +/- 53.03, N = 3SE +/- 44.08, N = 3SE +/- 109.85, N = 34320242950428491. (CC) gcc options: -pthread -lpthread -O3 -march=native

Smallpt

Smallpt is a C++ global illumination renderer written in less than 100 lines of code. Global illumination is done via unbiased Monte Carlo path tracing and there is multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesGCC 4.8.2LLVM Clang 3.5 20140413306090120150SE +/- 0.00, N = 3SE +/- 0.67, N = 3241341. (CXX) g++ options: -fopenmp -O3 -march=native

FLAC Audio Encoding

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.0WAV To FLACGCC 4.9.0 RC1LLVM Clang 3.5 20140413GCC 4.8.21.08452.1693.25354.3385.4225SE +/- 0.09, N = 10SE +/- 0.01, N = 5SE +/- 0.06, N = 73.704.234.821. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

LAME MP3 Encoding

LAME is an MP3 encoder licensed under the LGPL. This test measures the time required to encode a WAV file to MP3 format. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3GCC 4.9.0 RC1GCC 4.8.2LLVM Clang 3.5 201404133691215SE +/- 0.01, N = 5SE +/- 0.04, N = 5SE +/- 0.04, N = 510.8712.4213.491. (CC) gcc options: -pipe -O3 -march=native -lm

FFmpeg

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 2.1.1H.264 HD To NTSC DVGCC 4.9.0 RC1LLVM Clang 3.5 20140413GCC 4.8.248121620SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 313.8013.8913.99-fno-tree-vectorize -MF -MT-Qunused-arguments-fno-tree-vectorize -MF -MT1. (CC) gcc options: -lavdevice -lavfilter -lavformat -lavcodec -lswresample -lswscale -lavutil -ldl -lasound -lSDL -lm -pthread -O3 -march=native -std=c99 -fomit-frame-pointer -fno-math-errno -fno-signed-zeros -MMD

Hierarchical INTegration

This test runs the U.S. Department of Energy's Ames Laboratory Hierarchical INTegration (HINT) benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQUIPs, More Is BetterHierarchical INTegration 1.0Test: FLOATGCC 4.9.0 RC1GCC 4.8.2LLVM Clang 3.5 2014041380M160M240M320M400MSE +/- 362392.17, N = 3SE +/- 103032.27, N = 3SE +/- 938522.38, N = 3373674384.83367476347.00237448328.671. (CC) gcc options: -O3 -march=native -lm

Apache Benchmark

This is a test of ab, which is the Apache benchmark program. This test profile measures how many requests per second a given system can sustain when carrying out 1,000,000 requests with 100 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingLLVM Clang 3.5 20140413GCC 4.9.0 RC1GCC 4.8.28K16K24K32K40KSE +/- 73.90, N = 3SE +/- 76.61, N = 3SE +/- 136.25, N = 336432.0435953.7335904.531. (CC) gcc options: -shared -fPIC -pthread -O3 -march=native

GCC 4.8.2

Processor: Intel Core i7-4770K @ 3.50GHz (8 Cores), Motherboard: ECS Z87H3-A2X EXTREME v1.0, Chipset: Intel 4th Gen Core DRAM, Memory: 16384MB, Disk: 120GB Samsung SSD 840, Graphics: ECS NVIDIA GeForce GTX 460 768MB (675/1804MHz), Audio: Realtek ALC1150, Monitor: Samsung SyncMaster, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 14.04, Kernel: 3.13.0-22-generic (x86_64), Desktop: Unity 7.2.0, Display Server: X Server 1.15.0, Display Driver: NVIDIA 337.12, OpenGL: 4.3.0, Compiler: GCC 4.8.2, File-System: ext4, Screen Resolution: 2560x1600

Compiler Notes: --enable-checking=release
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

Testing initiated at 12 April 2014 10:03 by user pts.

GCC 4.9.0 RC1

Processor: Intel Core i7-4770K @ 3.50GHz (8 Cores), Motherboard: ECS Z87H3-A2X EXTREME v1.0, Chipset: Intel 4th Gen Core DRAM, Memory: 16384MB, Disk: 120GB Samsung SSD 840, Graphics: ECS NVIDIA GeForce GTX 460 768MB (675/1804MHz), Audio: Realtek ALC1150, Monitor: Samsung SyncMaster, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 14.04, Kernel: 3.13.0-22-generic (x86_64), Desktop: Unity 7.2.0, Display Server: X Server 1.15.0, Display Driver: NVIDIA 337.12, OpenGL: 4.3.0, Compiler: GCC 4.9.0 20140411, File-System: ext4, Screen Resolution: 2560x1600

Compiler Notes: --enable-checking=release
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

Testing initiated at 12 April 2014 15:27 by user pts.

LLVM Clang 3.5 20140413

Processor: Intel Core i7-4770K @ 3.50GHz (8 Cores), Motherboard: ECS Z87H3-A2X EXTREME v1.0, Chipset: Intel 4th Gen Core DRAM, Memory: 16384MB, Disk: 120GB Samsung SSD 840, Graphics: ECS NVIDIA GeForce GTX 460 768MB (675/1804MHz), Audio: Realtek ALC1150, Monitor: Samsung SyncMaster, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 14.04, Kernel: 3.13.0-22-generic (x86_64), Desktop: Unity 7.2.0, Display Server: X Server 1.15.0, Display Driver: NVIDIA 337.12, OpenGL: 4.3.0, Compiler: Clang 3.5.0-1~exp1, File-System: ext4, Screen Resolution: 2560x1600

Processor Notes: Scaling Governor: acpi-cpufreq ondemand

Testing initiated at 13 April 2014 21:03 by user phoronix.