Ubuntu 16.04 LTS Compiler Benchmarks GCC 5.3.1, GCC 6.0, LLVM Clang 3.7, and LLVM Clang 3.8 compiler benchmarks using the Xenial Xerus packages for Ubuntu 16.04 LTS. Benchmarks by Michael Larabel for a future article on Phoronix.com
HTML result view exported from: https://openbenchmarking.org/result/1602255-GA-UBUNTU16057&rdt&grs .
Ubuntu 16.04 LTS Compiler Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores) MSI C236A WORKSTATION (MS-7998) v1.0 Intel Sky Lake 16384MB 120GB Samsung SSD 850 MSI AMD Radeon R7 370 / R9 270/370 OEM 4096MB Realtek ALC1150 DELL P2415Q Intel Connection Ubuntu 16.04 4.4.0-7-generic (x86_64) Unity 7.4.0 X Server 1.17.3 radeon 7.6.1 4.1 Mesa 11.1.2 Gallium 0.4 Clang 3.8.0-+rc2-1~exp1ubuntu2 ext4 3840x2160 Clang 3.7.1-1ubuntu4 GCC 5.3.1 20160222 + clang (Ubuntu 5.3.1-9ubuntu3) 5.3.1 20160222 GCC 6.0.0 20160125 OpenBenchmarking.org Processor Details - Scaling Governor: intel_pstate powersave Compiler Details - GCC 5.3.1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - GCC 6.0.0 20160125: --build=x86_64-linux-gnu --disable-browser-plugin --disable-nls --disable-vtable-verify --disable-werror --enable-checking=yes --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-objc-gc --enable-plugin --enable-shared --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Ubuntu 16.04 LTS Compiler Benchmarks scimark2: Monte Carlo scimark2: Dense LU Matrix Factorization build-php: Time To Compile build-apache: Time To Compile c-ray: Total Time scimark2: Composite himeno: Poisson Pressure Solver scimark2: Jacobi Successive Over-Relaxation bullet: 1000 Stack bullet: 3000 Fall smallpt: Global Illumination Renderer; 100 Samples encode-mp3: WAV To MP3 bullet: Raytests bullet: Prim Trimesh bullet: 1000 Convex encode-flac: WAV To FLAC bullet: Convex Trimesh pgbench: Buffer Test - Single Thread - Read Write hmmer: Pfam Database Search stockfish: Total Time scimark2: Sparse Matrix Multiply redis: SET compress-7zip: Compress Speed Test pgbench: Buffer Test - Normal Load - Read Write openssl: RSA 4096-bit Performance apache: Static Web Page Serving scimark2: Fast Fourier Transform pgbench: Buffer Test - Heavy Contention - Read Write redis: GET bullet: 136 Ragdolls LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 284.07 7604.30 18.69 22.24 25.94 2433.58 1890.25 1429.85 5.41 4.61 24 12.09 2.77 1.01 4.69 5.32 1.18 592.32 8.71 3292 2538.51 2088730.67 24057 6598.18 677.23 48579.46 311.18 7902.49 2823390.21 3.27 627.96 7731.92 16.79 19.87 25.72 2531.78 2236.78 1446.61 5.13 4.51 23 11.47 2.70 1.00 4.58 5.31 1.17 600.24 8.73 3324 2538.56 2146299.50 23666 6637.61 678.53 48798.85 313.85 7911.95 3096524.92 3.05 735.64 3058.37 21.96 23.64 14.67 1581.41 2628.81 1129.46 4.61 4.12 21 10.86 2.54 0.94 4.27 4.95 1.13 573.40 8.29 3210 2667.00 2076119.06 23056 6431.46 694.00 49743.62 316.56 7922.13 3112531.88 2.78 737.18 3077.51 41.05 43.58 14.83 1573.84 2604.81 1127.68 4.50 4.01 21 10.61 2.49 0.91 4.32 4.86 1.09 559.29 8.22 3148 2610.33 2178042.15 23715 6421.59 693.40 49584.51 316.53 7950.75 3021227.58 2.74 OpenBenchmarking.org
SciMark Computational Test: Monte Carlo OpenBenchmarking.org Mflops, More Is Better SciMark 2.0 Computational Test: Monte Carlo LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 160 320 480 640 800 SE +/- 1.94, N = 4 SE +/- 1.44, N = 4 SE +/- 2.36, N = 4 SE +/- 1.66, N = 4 284.07 627.96 735.64 737.18 1. (CXX) g++ options: -O3 -march=native
SciMark Computational Test: Dense LU Matrix Factorization OpenBenchmarking.org Mflops, More Is Better SciMark 2.0 Computational Test: Dense LU Matrix Factorization LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 1700 3400 5100 6800 8500 SE +/- 37.88, N = 4 SE +/- 21.73, N = 4 SE +/- 4.62, N = 4 SE +/- 6.30, N = 4 7604.30 7731.92 3058.37 3077.51 1. (CXX) g++ options: -O3 -march=native
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 5.2.9 Time To Compile LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 9 18 27 36 45 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 18.69 16.79 21.96 41.05 -lpthread 1. (CC) gcc options: -O3 -march=native -pedantic -ldl -lm
Timed Apache Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Apache Compilation 2.4.7 Time To Compile LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 10 20 30 40 50 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 22.24 19.87 23.64 43.58
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 6 12 18 24 30 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 25.94 25.72 14.67 14.83 1. (CC) gcc options: -lm -lpthread -O3 -march=native
SciMark Computational Test: Composite OpenBenchmarking.org Mflops, More Is Better SciMark 2.0 Computational Test: Composite LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 500 1000 1500 2000 2500 SE +/- 6.89, N = 4 SE +/- 1.81, N = 4 SE +/- 1.60, N = 4 SE +/- 1.20, N = 4 2433.58 2531.78 1581.41 1573.84 1. (CXX) g++ options: -O3 -march=native
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 600 1200 1800 2400 3000 SE +/- 0.86, N = 3 SE +/- 7.01, N = 3 SE +/- 15.39, N = 3 SE +/- 10.87, N = 3 1890.25 2236.78 2628.81 2604.81 1. (CC) gcc options: -O3 -march=native -mavx2
SciMark Computational Test: Jacobi Successive Over-Relaxation OpenBenchmarking.org Mflops, More Is Better SciMark 2.0 Computational Test: Jacobi Successive Over-Relaxation LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 300 600 900 1200 1500 SE +/- 5.76, N = 4 SE +/- 9.02, N = 4 SE +/- 3.14, N = 4 SE +/- 1.05, N = 4 1429.85 1446.61 1129.46 1127.68 1. (CXX) g++ options: -O3 -march=native
Bullet Physics Engine Test: 1000 Stack OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: 1000 Stack LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 1.2173 2.4346 3.6519 4.8692 6.0865 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 5.41 5.13 4.61 4.50 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
Bullet Physics Engine Test: 3000 Fall OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: 3000 Fall LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 1.0373 2.0746 3.1119 4.1492 5.1865 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 4.61 4.51 4.12 4.01 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
Smallpt Global Illumination Renderer; 100 Samples OpenBenchmarking.org Seconds, Fewer Is Better Smallpt 1.0 Global Illumination Renderer; 100 Samples LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 24 23 21 21 1. (CXX) g++ options: -fopenmp -O3 -march=native
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.99.3 WAV To MP3 LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 3 6 9 12 15 SE +/- 0.04, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 12.09 11.47 10.86 10.61 1. (CC) gcc options: -pipe -O3 -march=native -lm
Bullet Physics Engine Test: Raytests OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: Raytests LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 0.6233 1.2466 1.8699 2.4932 3.1165 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 2.77 2.70 2.54 2.49 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
Bullet Physics Engine Test: Prim Trimesh OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: Prim Trimesh LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 0.2273 0.4546 0.6819 0.9092 1.1365 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 1.01 1.00 0.94 0.91 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
Bullet Physics Engine Test: 1000 Convex OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: 1000 Convex LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 1.0553 2.1106 3.1659 4.2212 5.2765 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 4.69 4.58 4.27 4.32 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
FLAC Audio Encoding WAV To FLAC OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.3.1 WAV To FLAC LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 1.197 2.394 3.591 4.788 5.985 SE +/- 0.00, N = 5 SE +/- 0.02, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 5.31 5.31 4.95 4.86 -fvisibility=hidden -fvisibility=hidden 1. (CXX) g++ options: -O3 -march=native -lm
Bullet Physics Engine Test: Convex Trimesh OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: Convex Trimesh LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 0.2655 0.531 0.7965 1.062 1.3275 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.18 1.17 1.13 1.09 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
PostgreSQL pgbench Scaling: Buffer Test - Test: Single Thread - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.4.3 Scaling: Buffer Test - Test: Single Thread - Mode: Read Write LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 130 260 390 520 650 SE +/- 2.91, N = 3 SE +/- 10.18, N = 4 SE +/- 6.79, N = 3 SE +/- 4.20, N = 3 592.32 600.24 573.40 559.29 -pthreads -mthreads -pthreads -mthreads 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -march=native -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Timed HMMer Search Pfam Database Search OpenBenchmarking.org Seconds, Fewer Is Better Timed HMMer Search 2.3.2 Pfam Database Search LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 2 4 6 8 10 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 8.71 8.73 8.29 8.22 1. (CC) gcc options: -O3 -march=native -pthread -lhmmer -lsquid -lm
Stockfish Total Time OpenBenchmarking.org ms, Fewer Is Better Stockfish 2014-11-26 Total Time LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 700 1400 2100 2800 3500 SE +/- 5.36, N = 3 SE +/- 5.13, N = 3 SE +/- 4.36, N = 3 SE +/- 9.94, N = 3 3292 3324 3210 3148 -flto -flto 1. (CXX) g++ options: -lpthread -O3 -march=native -fno-exceptions -fno-rtti -ansi -pedantic -msse -msse3 -mpopcnt
SciMark Computational Test: Sparse Matrix Multiply OpenBenchmarking.org Mflops, More Is Better SciMark 2.0 Computational Test: Sparse Matrix Multiply LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 600 1200 1800 2400 3000 SE +/- 12.26, N = 4 SE +/- 5.98, N = 4 SE +/- 3.08, N = 4 SE +/- 2.94, N = 4 2538.51 2538.56 2667.00 2610.33 1. (CXX) g++ options: -O3 -march=native
Redis Test: SET OpenBenchmarking.org Requests Per Second, More Is Better Redis 3.0.1 Test: SET LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 500K 1000K 1500K 2000K 2500K SE +/- 32867.27, N = 3 SE +/- 20142.16, N = 3 SE +/- 31524.64, N = 4 SE +/- 45034.71, N = 6 2088730.67 2146299.50 2076119.06 2178042.15 -std=gnu99 -pipe -g3 -O3 -funroll-loops -march=native 1. (CC) gcc options: -ggdb -rdynamic -lm -pthread -ldl
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.20.1 Compress Speed Test LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 5K 10K 15K 20K 25K SE +/- 110.79, N = 3 SE +/- 178.26, N = 3 SE +/- 229.23, N = 3 SE +/- 56.53, N = 3 24057 23666 23056 23715 1. (CXX) g++ options: -pipe -lpthread
PostgreSQL pgbench Scaling: Buffer Test - Test: Normal Load - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.4.3 Scaling: Buffer Test - Test: Normal Load - Mode: Read Write LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 1400 2800 4200 5600 7000 SE +/- 66.57, N = 3 SE +/- 117.87, N = 3 SE +/- 75.13, N = 3 SE +/- 93.15, N = 3 6598.18 6637.61 6431.46 6421.59 -pthreads -mthreads -pthreads -mthreads 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -march=native -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.1g RSA 4096-bit Performance LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 150 300 450 600 750 SE +/- 0.69, N = 3 SE +/- 0.72, N = 3 SE +/- 0.10, N = 3 SE +/- 0.15, N = 3 677.23 678.53 694.00 693.40 1. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.7 Static Web Page Serving LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 11K 22K 33K 44K 55K SE +/- 283.69, N = 3 SE +/- 247.92, N = 3 SE +/- 33.52, N = 3 SE +/- 78.30, N = 3 48579.46 48798.85 49743.62 49584.51 1. (CC) gcc options: -shared -fPIC -pthread -O3 -march=native
SciMark Computational Test: Fast Fourier Transform OpenBenchmarking.org Mflops, More Is Better SciMark 2.0 Computational Test: Fast Fourier Transform LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 70 140 210 280 350 SE +/- 1.25, N = 4 SE +/- 1.32, N = 4 SE +/- 0.64, N = 4 SE +/- 0.71, N = 4 311.18 313.85 316.56 316.53 1. (CXX) g++ options: -O3 -march=native
PostgreSQL pgbench Scaling: Buffer Test - Test: Heavy Contention - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.4.3 Scaling: Buffer Test - Test: Heavy Contention - Mode: Read Write LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 2K 4K 6K 8K 10K SE +/- 35.36, N = 3 SE +/- 39.32, N = 3 SE +/- 61.24, N = 3 SE +/- 38.92, N = 3 7902.49 7911.95 7922.13 7950.75 -pthreads -mthreads -pthreads -mthreads 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O3 -march=native -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
Redis Test: GET OpenBenchmarking.org Requests Per Second, More Is Better Redis 3.0.1 Test: GET LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 700K 1400K 2100K 2800K 3500K SE +/- 97365.18, N = 6 SE +/- 29057.84, N = 3 SE +/- 133050.46, N = 6 SE +/- 108149.76, N = 6 2823390.21 3096524.92 3112531.88 3021227.58 -std=gnu99 -pipe -g3 -O3 -funroll-loops -march=native 1. (CC) gcc options: -ggdb -rdynamic -lm -pthread -ldl
Bullet Physics Engine Test: 136 Ragdolls OpenBenchmarking.org Seconds, Fewer Is Better Bullet Physics Engine 2.81 Test: 136 Ragdolls LLVM Clang 3.8 LLVM Clang 3.7.1 GCC 5.3.1 GCC 6.0.0 20160125 0.7358 1.4716 2.2074 2.9432 3.679 SE +/- 0.21, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 3.27 3.05 2.78 2.74 1. (CXX) g++ options: -O3 -march=native -rdynamic -lglut -lGL -lGLU
Phoronix Test Suite v10.8.4