LLVM 3.5 RC4 Benchmarking

Benchmarks by Michael Larabel for a future article on Phoronix.com reviewing the LLVM Clang compiler performance.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1408312-PTS-LLVM35RC08
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
LLVM Clang 3.4
August 31 2014
 
LLVM Clang 3.5 RC4
August 31 2014
 
Invert Behavior (Only Show Selected Data)
 
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

LLVM Clang 3.4

Processor: Intel Core i7-3517UE @ 2.80GHz (4 Cores), Motherboard: CompuLab Intense-PC, Chipset: Intel 3rd Gen Core DRAM, Memory: 8192MB, Disk: 500GB Hitachi HCC54755, Graphics: Intel HD 4000 (1000MHz), Audio: Intel 7 /C210, Monitor: MX279, Network: Intel 82579LM Gigabit Connection + Realtek RTL8188CE 802.11b/g/n

OS: Ubuntu 14.04, Kernel: 3.17.0-999-generic (x86_64), Desktop: Unity 7.2.2, Display Server: X Server 1.15.1, Display Driver: intel 2.99.914, OpenGL: 3.3 Mesa 10.4.0-devel (git-eb4541e 2014-08-21 trusty-oibaf-ppa+gallium-nine), Compiler: Clang 3.4 + LLVM 3.4, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Aug 31 2014 (14:41:12); Default target: x86_64-unknown-linux-gnu; Host CPU: core-avx-i
Processor Notes: Scaling Governor: intel_pstate performance

LLVM Clang 3.5 RC4

OS: Ubuntu 14.04, Kernel: 3.17.0-999-generic (x86_64), Desktop: Unity 7.2.2, Display Server: X Server 1.15.1, Display Driver: intel 2.99.914, OpenGL: 3.3 Mesa 10.4.0-devel (git-eb4541e 2014-08-21 trusty-oibaf-ppa+gallium-nine), Compiler: Clang 3.5.0 + LLVM 3.5.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Aug 31 2014 (14:18:02); Default target: x86_64-unknown-linux-gnu; Host CPU: core-avx-i
Processor Notes: Scaling Governor: intel_pstate performance

LLVM 3.5 RC4 BenchmarkingOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-3517UE @ 2.80GHz (4 Cores)CompuLab Intense-PCIntel 3rd Gen Core DRAM8192MB500GB Hitachi HCC54755Intel HD 4000 (1000MHz)Intel 7 /C210MX279Intel 82579LM Gigabit Connection + Realtek RTL8188CE 802.11b/g/nUbuntu 14.043.17.0-999-generic (x86_64)Unity 7.2.2X Server 1.15.1intel 2.99.9143.3 Mesa 10.4.0-devel (git-eb4541e 2014-08-21 trusty-oibaf-ppa+gallium-nine)Clang 3.4 + LLVM 3.4Clang 3.5.0 + LLVM 3.5.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilersFile-SystemScreen ResolutionLLVM 3.5 RC4 Benchmarking PerformanceSystem Logs- LLVM Clang 3.4: Optimized build; Built Aug 31 2014 (14:41:12); Default target: x86_64-unknown-linux-gnu; Host CPU: core-avx-i - LLVM Clang 3.5 RC4: Optimized build; Built Aug 31 2014 (14:18:02); Default target: x86_64-unknown-linux-gnu; Host CPU: core-avx-i - Scaling Governor: intel_pstate performance

LLVM Clang 3.4 vs. LLVM Clang 3.5 RC4 ComparisonPhoronix Test SuiteBaseline+19.3%+19.3%+38.6%+38.6%+57.9%+57.9%+77.2%+77.2%77.3%8.4%6.1%4.3%4.1%3%SharpenWAV To MP324.8%Time To Compile10.5%S.M.MTotal TimeResizing4.6%Monte CarloP.P.S4.2%CompositeTime To Compile3.8%WAV To FLAC3.6%D.L.M.FGraphicsMagickLAME MP3 EncodingTimed PHP CompilationSciMarkC-RayGraphicsMagickSciMarkHimeno BenchmarkSciMarkTimed Apache CompilationFLAC Audio EncodingSciMarkLLVM Clang 3.4LLVM Clang 3.5 RC4

LLVM 3.5 RC4 Benchmarkingapache: Static Web Page Servingencode-mp3: WAV To MP3encode-flac: WAV To FLACc-ray: Total Timebuild-php: Time To Compilebuild-apache: Time To Compilehimeno: Poisson Pressure Solvergraphics-magick: Local Adaptive Thresholdinggraphics-magick: HWB Color Spacegraphics-magick: Resizinggraphics-magick: Sharpengraphics-magick: Blurscimark2: Jacobi Successive Over-Relaxationscimark2: Dense LU Matrix Factorizationscimark2: Sparse Matrix Multiplyscimark2: Fast Fourier Transformscimark2: Monte Carloscimark2: CompositeLLVM Clang 3.4LLVM Clang 3.5 RC417819.6516.917.1893.1741.6545.751202.31631066822601176.702309.721652.57194.93426.231152.0321.107.4487.8246.0447.491153.76631056539591191.082378.161791.41193.31444.581199.70OpenBenchmarking.org

Apache Benchmark

This is a test of ab, which is the Apache benchmark program. This test profile measures how many requests per second a given system can sustain when carrying out 1,000,000 requests with 100 requests being carried out concurrently. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.7Static Web Page ServingLLVM Clang 3.44K8K12K16K20KSE +/- 43.80, N = 317819.651. (CC) gcc options: -shared -fPIC -pthread -O3 -march=native

LAME MP3 Encoding

LAME is an MP3 encoder licensed under the LGPL. This test measures the time required to encode a WAV file to MP3 format. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.99.3WAV To MP3LLVM Clang 3.4LLVM Clang 3.5 RC4510152025SE +/- 0.05, N = 5SE +/- 0.01, N = 516.9121.101. (CC) gcc options: -pipe -O3 -march=native -lncurses -lm

FLAC Audio Encoding

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.0WAV To FLACLLVM Clang 3.4LLVM Clang 3.5 RC4246810SE +/- 0.02, N = 5SE +/- 0.00, N = 57.187.441. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

C-Ray

This is a test of C-Ray, a simple raytracer designed to test the floating-point CPU performance. This test is multi-threaded (16 threads per core), will shoot 8 rays per pixel for anti-aliasing, and will generate a 1600 x 1200 image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeLLVM Clang 3.4LLVM Clang 3.5 RC420406080100SE +/- 0.03, N = 3SE +/- 0.00, N = 393.1787.821. (CC) gcc options: -lm -lpthread -O3 -march=native

Timed PHP Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 5.2.9Time To CompileLLVM Clang 3.4LLVM Clang 3.5 RC41020304050SE +/- 0.02, N = 3SE +/- 0.08, N = 341.6546.041. (CC) gcc options: -O3 -march=native -pedantic -ldl -lz -lm

Timed Apache Compilation

This test times how long it takes to build the Apache HTTP Server. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.7Time To CompileLLVM Clang 3.4LLVM Clang 3.5 RC41122334455SE +/- 0.19, N = 3SE +/- 0.25, N = 345.7547.49

Himeno Benchmark

The Himeno benchmark is a linear solver of pressure Poisson using a point-Jacobi method. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLLVM Clang 3.4LLVM Clang 3.5 RC430060090012001500SE +/- 0.97, N = 3SE +/- 2.98, N = 31202.311153.761. (CC) gcc options: -O3 -march=native

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests to stress the system's CPU. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: Local Adaptive ThresholdingLLVM Clang 3.4LLVM Clang 3.5 RC41428425670SE +/- 0.00, N = 3SE +/- 0.00, N = 363631. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lSM -lICE -lX11 -llzma -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: HWB Color SpaceLLVM Clang 3.4LLVM Clang 3.5 RC420406080100SE +/- 0.00, N = 3SE +/- 0.33, N = 31061051. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lSM -lICE -lX11 -llzma -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: ResizingLLVM Clang 3.4LLVM Clang 3.5 RC41530456075SE +/- 0.33, N = 3SE +/- 0.00, N = 368651. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lSM -lICE -lX11 -llzma -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: SharpenLLVM Clang 3.4LLVM Clang 3.5 RC4918273645SE +/- 0.00, N = 3SE +/- 0.00, N = 322391. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lSM -lICE -lX11 -llzma -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: BlurLLVM Clang 3.4LLVM Clang 3.5 RC41326395265SE +/- 0.33, N = 3SE +/- 0.00, N = 360591. (CC) gcc options: -O3 -march=native -pthread -ljbig -lwebp -ljpeg -lXext -lSM -lICE -lX11 -llzma -lz -lm -lpthread

SciMark

This test runs the ANSI C version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This test is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Jacobi Successive Over-RelaxationLLVM Clang 3.4LLVM Clang 3.5 RC430060090012001500SE +/- 2.57, N = 4SE +/- 0.17, N = 41176.701191.081. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Dense LU Matrix FactorizationLLVM Clang 3.4LLVM Clang 3.5 RC45001000150020002500SE +/- 22.69, N = 4SE +/- 36.75, N = 42309.722378.161. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Sparse Matrix MultiplyLLVM Clang 3.4LLVM Clang 3.5 RC4400800120016002000SE +/- 40.26, N = 4SE +/- 9.48, N = 41652.571791.411. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Fast Fourier TransformLLVM Clang 3.4LLVM Clang 3.5 RC44080120160200SE +/- 2.94, N = 4SE +/- 0.56, N = 4194.93193.311. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Monte CarloLLVM Clang 3.4LLVM Clang 3.5 RC4100200300400500SE +/- 9.80, N = 4SE +/- 0.03, N = 4426.23444.581. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: CompositeLLVM Clang 3.4LLVM Clang 3.5 RC430060090012001500SE +/- 11.44, N = 4SE +/- 7.88, N = 41152.031199.701. (CXX) g++ options: -O3 -march=native

LLVM Clang 3.4

Processor: Intel Core i7-3517UE @ 2.80GHz (4 Cores), Motherboard: CompuLab Intense-PC, Chipset: Intel 3rd Gen Core DRAM, Memory: 8192MB, Disk: 500GB Hitachi HCC54755, Graphics: Intel HD 4000 (1000MHz), Audio: Intel 7 /C210, Monitor: MX279, Network: Intel 82579LM Gigabit Connection + Realtek RTL8188CE 802.11b/g/n

OS: Ubuntu 14.04, Kernel: 3.17.0-999-generic (x86_64), Desktop: Unity 7.2.2, Display Server: X Server 1.15.1, Display Driver: intel 2.99.914, OpenGL: 3.3 Mesa 10.4.0-devel (git-eb4541e 2014-08-21 trusty-oibaf-ppa+gallium-nine), Compiler: Clang 3.4 + LLVM 3.4, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Aug 31 2014 (14:41:12); Default target: x86_64-unknown-linux-gnu; Host CPU: core-avx-i
Processor Notes: Scaling Governor: intel_pstate performance

Testing initiated at 31 August 2014 16:20 by user pts.

LLVM Clang 3.5 RC4

Processor: Intel Core i7-3517UE @ 2.80GHz (4 Cores), Motherboard: CompuLab Intense-PC, Chipset: Intel 3rd Gen Core DRAM, Memory: 8192MB, Disk: 500GB Hitachi HCC54755, Graphics: Intel HD 4000 (1000MHz), Audio: Intel 7 /C210, Monitor: MX279, Network: Intel 82579LM Gigabit Connection + Realtek RTL8188CE 802.11b/g/n

OS: Ubuntu 14.04, Kernel: 3.17.0-999-generic (x86_64), Desktop: Unity 7.2.2, Display Server: X Server 1.15.1, Display Driver: intel 2.99.914, OpenGL: 3.3 Mesa 10.4.0-devel (git-eb4541e 2014-08-21 trusty-oibaf-ppa+gallium-nine), Compiler: Clang 3.5.0 + LLVM 3.5.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Aug 31 2014 (14:18:02); Default target: x86_64-unknown-linux-gnu; Host CPU: core-avx-i
Processor Notes: Scaling Governor: intel_pstate performance

Testing initiated at 31 August 2014 19:06 by user pts.