LLVM 3.4 Compiler Benchmarking Comparison

Intel Core i7 990XGulftown processor testing of LLVM 3.2, 3.3, and 3.4 SVN. Benchmarking by Michael Larabel for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1307158-SO-LLVM34COM27
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
LLVM Clang 3.2
July 15 2013
 
LLVM Clang 3.3
July 15 2013
 
LLVM Clang 3.4 SVN 20130715
July 15 2013
 
Invert Behavior (Only Show Selected Data)
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

LLVM Clang 3.2

Processor: Intel Core i7 990X @ 3.47GHz (12 Cores), Motherboard: MSI X58M (MS-7593) v1.0, Chipset: Intel 5520/5500/X58 + ICH10R, Memory: 12288MB, Disk: 1000GB Western Digital WD1003FBYX-0, Graphics: NVIDIA GeForce 8400 GS 512MB (500/333MHz), Audio: Realtek ALC889, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 13.10, Kernel: 3.10.0-2-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.1, Display Driver: NVIDIA 304.88, OpenGL: 3.3.0 NVIDIA 304.88, Compiler: Clang 3.2 + LLVM 3.2svn, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Jul 15 2013 (09:25:52); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

LLVM Clang 3.3

OS: Ubuntu 13.10, Kernel: 3.10.0-2-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.1, Display Driver: NVIDIA 304.88, OpenGL: 3.3.0 NVIDIA 304.88, Compiler: Clang 3.3 + LLVM 3.3, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Jul 15 2013 (09:12:51); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

LLVM Clang 3.4 SVN 20130715

OS: Ubuntu 13.10, Kernel: 3.10.0-2-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.1, Display Driver: NVIDIA 304.88, OpenGL: 3.3.0 NVIDIA 304.88, Compiler: Clang 3.4 (SVN 186320) + LLVM 3.4svn, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Jul 15 2013 (09:43:39); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

LLVM 3.4 Compiler Benchmarking ComparisonOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7 990X @ 3.47GHz (12 Cores)MSI X58M (MS-7593) v1.0Intel 5520/5500/X58 + ICH10R12288MB1000GB Western Digital WD1003FBYX-0NVIDIA GeForce 8400 GS 512MB (500/333MHz)Realtek ALC889Realtek RTL8111/8168/8411Ubuntu 13.103.10.0-2-generic (x86_64)Xfce 4.10X Server 1.14.1NVIDIA 304.883.3.0 NVIDIA 304.88Clang 3.2 + LLVM 3.2svnClang 3.3 + LLVM 3.3Clang 3.4 (SVN 186320) + LLVM 3.4svnext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilersFile-SystemScreen ResolutionLLVM 3.4 Compiler Benchmarking Comparison PerformanceSystem Logs- LLVM Clang 3.2: Optimized build; Built Jul 15 2013 (09:25:52); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7 - LLVM Clang 3.3: Optimized build; Built Jul 15 2013 (09:12:51); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7 - LLVM Clang 3.4 SVN 20130715: Optimized build; Built Jul 15 2013 (09:43:39); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7 - Scaling Governor: acpi-cpufreq ondemand

LLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715Result OverviewPhoronix Test Suite100%104%107%111%114%SciMarkTimed HMMer SearchTimed ImageMagick CompilationTimed PHP CompilationTimed MAFFT AlignmentApache BenchmarkHimeno BenchmarkC-RayFFmpegSmallptBLAKE2GraphicsMagickx264N-Queens

LLVM 3.4 Compiler Benchmarking Comparisonapache: Static Web Page Servingblake2: Phoronix Test Suite v4.8.0m2c-ray: Total Timeffmpeg: H.264 HD To NTSC DVencode-flac: WAV To FLACgraphics-magick: Blurgraphics-magick: Sharpengraphics-magick: Resizinggraphics-magick: HWB Color Spacegraphics-magick: Local Adaptive Thresholdinghimeno: Poisson Pressure Solvern-queens: Elapsed Timepgbench: TPC-B Transactions Per Secondprimesieve: 1e12 Prime Number Generationscimark2: Monte Carloscimark2: Fast Fourier Transformscimark2: Sparse Matrix Multiplyscimark2: Dense LU Matrix Factorizationscimark2: Jacobi Successive Over-Relaxationsmallpt: Global Illumination Renderer; 100 Sampleshmmer: Pfam Database Searchbuild-imagemagick: Time To Compilemafft: Multiple Sequence Alignmentbuild-php: Time To Compilex264: H.264 Video EncodingLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071518271.827.2823.7620.92664482100401393.66274.20477.75289.811694.321628.511385.7123111.2423.286.1218.96177.4217678.967.4023.7621.058.14674483101391413.54274.20276.47443.31478.82289.321701.361628.511385.7122710.0124.856.4820.58176.1518491.407.3923.2521.337.08674484101401438.19274.76275.12432.84477.23288.101701.373137.251392.0023010.1325.896.0620.74177.77OpenBenchmarking.org

Apache Benchmark

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.3Static Web Page ServingLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 201307154K8K12K16K20KSE +/- 285.79, N = 3SE +/- 263.14, N = 4SE +/- 28.55, N = 318271.8217678.9618491.401. (CC) gcc options: -shared -fPIC -pthread -O3 -march=native

BLAKE2

OpenBenchmarking.orgCycles Per Byte, Fewer Is BetterBLAKE2 20121223Phoronix Test Suite v4.8.0m2LLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715246810SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 37.287.407.391. (CC) gcc options: -std=gnu99 -O3 -march=native -lcrypto -lz

C-Ray

This is a test of C-Ray, a simple raytracer designed to test the floating-point CPU performance. This test is multi-threaded (16 threads per core), will shoot 8 rays per pixel for anti-aliasing, and will generate a 1600 x 1200 image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 323.7623.7623.251. (CC) gcc options: -lm -lpthread -O3 -march=native

FFmpeg

OpenBenchmarking.orgSeconds, Fewer Is BetterFFmpeg 2.0H.264 HD To NTSC DVLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715510152025SE +/- 0.09, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 320.9221.0521.331. (CC) gcc options: -lavdevice -lavfilter -lavformat -lavcodec -lswresample -lswscale -lavutil -ldl -lXv -lX11 -lXext -lasound -lSDL -lm -pthread -O3 -march=native -std=c99 -fomit-frame-pointer -fno-math-errno -fno-signed-zeros -Qunused-arguments -MMD

FLAC Audio Encoding

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.0WAV To FLACLLVM Clang 3.3LLVM Clang 3.4 SVN 20130715246810SE +/- 0.01, N = 5SE +/- 0.00, N = 58.147.081. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

GraphicsMagick

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: BlurLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 201307151530456075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36667671. (CC) gcc options: -O3 -march=native -pthread -lXext -lSM -lICE -lX11 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: SharpenLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 201307151020304050SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34444441. (CC) gcc options: -O3 -march=native -pthread -lXext -lSM -lICE -lX11 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: ResizingLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071520406080100SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 38283841. (CC) gcc options: -O3 -march=native -pthread -lXext -lSM -lICE -lX11 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: HWB Color SpaceLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071520406080100SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31001011011. (CC) gcc options: -O3 -march=native -pthread -lXext -lSM -lICE -lX11 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: Local Adaptive ThresholdingLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715918273645SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34039401. (CC) gcc options: -O3 -march=native -pthread -lXext -lSM -lICE -lX11 -lz -lm -lpthread

Himeno Benchmark

The Himeno benchmark is a linear solver of pressure Poisson using a point-Jacobi method. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071530060090012001500SE +/- 0.98, N = 3SE +/- 1.32, N = 3SE +/- 0.56, N = 31393.661413.541438.191. (CC) gcc options: -O3 -march=native

N-Queens

This is a test of the OpenMP version of a test that solves the N-queens problem. The board problem size is 18. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0Elapsed TimeLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071560120180240300SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3274.20274.20274.761. (CC) gcc options: -static -fopenmp -O3 -march=native

PostgreSQL pgbench

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 8.4.11TPC-B Transactions Per SecondLLVM Clang 3.3LLVM Clang 3.4 SVN 2013071560120180240300SE +/- 1.02, N = 3276.47275.121. (CC) gcc options: -O3 -march=native -fno-strict-aliasing -fwrapv -lpgport -lpq -lcrypt -ldl -lm

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 4.21e12 Prime Number GenerationLLVM Clang 3.3LLVM Clang 3.4 SVN 20130715100200300400500SE +/- 0.24, N = 3SE +/- 0.27, N = 3443.31432.841. (CXX) g++ options: -O2

SciMark

This test runs the ANSI C version of SciMark 2.0, which is a benchmark for scientific and numerical computing developed by programmers at the National Institute of Standards and Technology. This test is made up of Fast Foruier Transform, Jacobi Successive Over-relaxation, Monte Carlo, Sparse Matrix Multiply, and dense LU matrix factorization benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Monte CarloLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715100200300400500SE +/- 0.53, N = 4SE +/- 0.53, N = 4SE +/- 0.87, N = 4477.75478.82477.231. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Fast Fourier TransformLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071560120180240300SE +/- 0.25, N = 4SE +/- 0.47, N = 4SE +/- 0.69, N = 4289.81289.32288.101. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Sparse Matrix MultiplyLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715400800120016002000SE +/- 1.76, N = 4SE +/- 1.77, N = 4SE +/- 3.38, N = 41694.321701.361701.371. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Dense LU Matrix FactorizationLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 201307157001400210028003500SE +/- 1.43, N = 4SE +/- 1.43, N = 4SE +/- 0.00, N = 41628.511628.513137.251. (CXX) g++ options: -O3 -march=native

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: Jacobi Successive Over-RelaxationLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071530060090012001500SE +/- 1.56, N = 4SE +/- 1.56, N = 4SE +/- 1.57, N = 41385.711385.711392.001. (CXX) g++ options: -O3 -march=native

Smallpt

Smallpt is a C++ global illumination renderer written in less than 100 lines of code. Global illumination is done via unbiased Monte Carlo path tracing and there is multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 100 SamplesLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 2013071550100150200250SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 32312272301. (CXX) g++ options: -fopenmp -O3 -march=native

Timed HMMer Search

This test searches through the Pfam database of profile hidden markov models. The search finds the domain structure of Drosophila Sevenless protein. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 201307153691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 311.2410.0110.131. (CC) gcc options: -O3 -march=native -pthread -lhmmer -lsquid -lm

Timed ImageMagick Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.8.1-10Time To CompileLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715612182430SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.20, N = 323.2824.8525.89

Timed MAFFT Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.864Multiple Sequence AlignmentLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715246810SE +/- 0.16, N = 6SE +/- 0.15, N = 6SE +/- 0.14, N = 66.126.486.061. (CC) gcc options: -O3 -lm -lpthread

Timed PHP Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 5.2.9Time To CompileLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 20130715510152025SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 318.9620.5820.74-lpthread1. (CC) gcc options: -O3 -march=native -pedantic -ldl -lz -lm

x264

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2013-06-08H.264 Video EncodingLLVM Clang 3.2LLVM Clang 3.3LLVM Clang 3.4 SVN 201307154080120160200SE +/- 0.51, N = 5SE +/- 0.20, N = 5SE +/- 0.52, N = 5177.42176.15177.771. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -march=native -std=gnu99 -fomit-frame-pointer -fno-tree-vectorize

LLVM Clang 3.2

Processor: Intel Core i7 990X @ 3.47GHz (12 Cores), Motherboard: MSI X58M (MS-7593) v1.0, Chipset: Intel 5520/5500/X58 + ICH10R, Memory: 12288MB, Disk: 1000GB Western Digital WD1003FBYX-0, Graphics: NVIDIA GeForce 8400 GS 512MB (500/333MHz), Audio: Realtek ALC889, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 13.10, Kernel: 3.10.0-2-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.1, Display Driver: NVIDIA 304.88, OpenGL: 3.3.0 NVIDIA 304.88, Compiler: Clang 3.2 + LLVM 3.2svn, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Jul 15 2013 (09:25:52); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

Testing initiated at 15 July 2013 14:42 by user phoronix.

LLVM Clang 3.3

Processor: Intel Core i7 990X @ 3.47GHz (12 Cores), Motherboard: MSI X58M (MS-7593) v1.0, Chipset: Intel 5520/5500/X58 + ICH10R, Memory: 12288MB, Disk: 1000GB Western Digital WD1003FBYX-0, Graphics: NVIDIA GeForce 8400 GS 512MB (500/333MHz), Audio: Realtek ALC889, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 13.10, Kernel: 3.10.0-2-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.1, Display Driver: NVIDIA 304.88, OpenGL: 3.3.0 NVIDIA 304.88, Compiler: Clang 3.3 + LLVM 3.3, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Jul 15 2013 (09:12:51); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

Testing initiated at 15 July 2013 12:49 by user phoronix.

LLVM Clang 3.4 SVN 20130715

Processor: Intel Core i7 990X @ 3.47GHz (12 Cores), Motherboard: MSI X58M (MS-7593) v1.0, Chipset: Intel 5520/5500/X58 + ICH10R, Memory: 12288MB, Disk: 1000GB Western Digital WD1003FBYX-0, Graphics: NVIDIA GeForce 8400 GS 512MB (500/333MHz), Audio: Realtek ALC889, Network: Realtek RTL8111/8168/8411

OS: Ubuntu 13.10, Kernel: 3.10.0-2-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.1, Display Driver: NVIDIA 304.88, OpenGL: 3.3.0 NVIDIA 304.88, Compiler: Clang 3.4 (SVN 186320) + LLVM 3.4svn, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: Optimized build; Built Jul 15 2013 (09:43:39); Default target: x86_64-unknown-linux-gnu; Host CPU: corei7
Processor Notes: Scaling Governor: acpi-cpufreq ondemand

Testing initiated at 15 July 2013 10:10 by user phoronix.