Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks Linux 3.3 to Linux 3.13 kernel benchmarks by Michael Larabel for a future article on Phoronix.com then now in 2016 tested with Ubuntu 16.10 plus Linux 4.9 kernel. Fun retrospective.
HTML result view exported from: https://openbenchmarking.org/result/1610234-PTS-1610219L89&grr&sro .
Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 Intel Core i5-2520M @ 2.50GHz (4 Cores) HP 161C Intel 2nd Generation Core Family DRAM 4096MB 160GB INTEL SSDSA2M160 LLVMpipe IDT 92HD81B1X5 Intel 82579LM Gigabit Connection + Intel Centrino Advanced-N 6205 Ubuntu 13.10 3.3.0-030300-generic (x86_64) Unity 7.1.2 X Server 1.14.5 intel 2.99.907 2.1 Mesa 10.1.0-devel (git-07149f0 saucy-oibaf-ppa+curaga) Gallium 0.4 GCC 4.8 ext4 1600x900 3.4.0-030400-generic (x86_64) 3.5.0-030500-generic (x86_64) Intel HD 3000 3.6.0-030600-generic (x86_64) 3.1 Mesa 10.1.0-devel (git-07149f0 saucy-oibaf-ppa+curaga) Intel HD 3000 (1300MHz) 3.7.0-030700-generic (x86_64) 3.8.0-030800-generic (x86_64) Intel Core i5-2520M @ 3.20GHz (4 Cores) 3.9.0-030900-generic (x86_64) 3.10.0-031000-generic (x86_64) 3.11.0-031100-generic (x86_64) 3.12.0-031200-generic (x86_64) 3.13.0-031300-generic (x86_64) Intel 2nd Generation Core Family IGP Ubuntu 16.10 4.8.0-22-generic (x86_64) Unity 7.5.0 X Server 1.18.4 modesetting 1.18.4 3.3 Mesa 12.0.3 GCC 6.2.0 20161005 4.9.0-999-generic (x86_64) 20161020 OpenBenchmarking.org Environment Details - Linux 3.3, Linux 3.4, Linux 3.5: LIBGL_ALWAYS_SOFTWARE=1 Compiler Details - Linux 3.3: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.4: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.7: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.9: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.11: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.12: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.13: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu 16.10 Linux 4.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu 16.10 Linux 4.9: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details - Linux 3.3: CFQ / barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr - Linux 3.4: CFQ / data=ordered,errors=remount-ro,relatime,rw - Linux 3.5: CFQ / data=ordered,errors=remount-ro,relatime,rw - Linux 3.6: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.7: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.8: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.9: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.10: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.11: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.12: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.13: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Ubuntu 16.10 Linux 4.8: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Ubuntu 16.10 Linux 4.9: DEADLINE / data=ordered,errors=remount-ro,relatime,rw Processor Details - Linux 3.3: Scaling Governor: acpi-cpufreq ondemand - Linux 3.4: Scaling Governor: acpi-cpufreq ondemand - Linux 3.5: Scaling Governor: acpi-cpufreq ondemand - Linux 3.6: Scaling Governor: acpi-cpufreq ondemand - Linux 3.7: Scaling Governor: acpi-cpufreq ondemand - Linux 3.8: Scaling Governor: acpi-cpufreq ondemand - Linux 3.9: Scaling Governor: intel_pstate powersave - Linux 3.10: Scaling Governor: intel_pstate powersave - Linux 3.11: Scaling Governor: intel_pstate powersave - Linux 3.12: Scaling Governor: intel_pstate powersave - Linux 3.13: Scaling Governor: intel_pstate performance - Ubuntu 16.10 Linux 4.8: Scaling Governor: intel_pstate powersave - Ubuntu 16.10 Linux 4.9: Scaling Governor: intel_pstate powersave System Details - Linux 3.3: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.4: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.5: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.6: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.7: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.8: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.9: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.10: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.11: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.12: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.13: Disk Scheduler: DEADLINE. Python 2.7.5+. - Ubuntu 16.10 Linux 4.8: Python 2.7.12+. - Ubuntu 16.10 Linux 4.9: Python 2.7.12+. Graphics Details - Linux 3.5, Linux 3.6, Linux 3.7, Linux 3.8, Linux 3.9, Linux 3.10, Linux 3.11, Linux 3.12, Linux 3.13: SNA
Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks apache: Static Web Page Serving hint: FLOAT encode-flac: WAV To FLAC open-porous-media: Upscale-Relperm c-ray: Total Time himeno: Poisson Pressure Solver tscp: AI Chess Performance mrbayes: Primate Phylogeny Analysis polybench-c: 3 Matrix Multiplications hpcc: Max Ping Pong Bandwidth hpcc: Rand Ring Bandwidth hpcc: Rand Ring Latency hpcc: G-Rand Access hpcc: EP-STREAM Triad hpcc: G-Ptrans hpcc: EP-DGEMM hpcc: G-Ffte hpcc: G-HPL xonotic: 1600 x 900 - High xonotic: 1600 x 900 - Low unigine-sanctuary: 1024 x 768 openarena: 1600 x 900 postmark: Disk Transaction Performance compilebench: Initial Create compilebench: Compile dbench: 1 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 19372.45 256549866.52 7.45 132.66 70.22 1285.93 909181 25.42 33.35 4756.541 0.76677 0.55916 0.02019 1.91326 0.37226 4.57413 1.41432 16.86447 1637 93.42 105.49 209.16 19829.62 256863781.01 7.45 132.51 69.99 1289.82 914011 25.44 32.99 4676.835 0.76847 0.55286 0.02003 1.82648 0.36738 4.57506 1.41559 16.83193 1648 96.36 106.04 211.15 19867.65 254643172.98 7.44 131.66 70.30 1292.16 906059 25.34 32.36 4744.799 0.78239 0.56350 0.02035 1.85094 0.37476 4.57913 1.43874 16.89897 1637 97.72 105.91 210.42 18676.07 257621036.78 7.35 132.95 69.79 1291.80 920418 25.14 33.33 4675.720 0.76691 0.55530 0.02044 2.01190 0.36835 4.57446 1.41145 16.89153 48.69 91.40 2.74 27.30 1685 104.08 106.99 209.88 18039.02 257485642.98 7.36 134.29 70.82 1290.87 921342 25.52 33.06 4555.803 0.76805 0.61911 0.02006 1.80922 0.36655 4.09877 1.41259 14.76670 48.87 91.59 2.69 27.33 1644 100.73 107.25 432.02 17907.21 256953351.09 7.34 133.12 69.73 1290.34 920728 25.30 32.83 4623.472 0.76348 0.57234 0.01985 1.77692 0.37046 4.56999 1.41601 16.84943 48.90 91.64 2.65 27.33 1619 101.49 106.03 193.16 17489.16 257448930.45 7.38 132.63 69.75 1292.85 920420 25.23 32.84 4617.706 0.76400 0.55730 0.01781 1.80114 0.37024 4.57681 1.40779 16.91637 49.40 94.03 2.75 27.43 1524 98.20 105.65 184.84 16039.66 257015556.14 7.35 130.77 69.77 1293.17 922267 25.68 33.65 4606.189 0.76495 0.57061 0.01715 1.87469 0.36755 4.57247 1.40943 16.82943 49.35 93.28 2.79 27.33 1428 95.13 108.63 316.59 16293.98 257145686.34 7.39 134.59 69.78 1291.16 922576 25.66 33.02 4610.011 0.76371 0.57507 0.02006 1.83853 0.36669 4.57203 1.39361 16.81867 49.37 93.44 2.73 27.40 1386 98.62 106.10 291.94 18751.24 258105597.56 7.37 133.72 69.73 1295.39 921959 25.30 31.62 4635.295 0.76887 0.55178 0.02010 1.96953 0.36681 4.57484 1.39475 16.87890 49.27 93.72 2.75 27.40 1530 94.78 105.63 349.05 15877.41 204750569.74 9.27 133.09 69.81 1091.93 781412 26.12 30.05 4622.673 0.76856 0.55938 0.02521 3.14201 0.39936 4.55708 1.35914 16.82127 49.31 93.90 2.75 27.33 1409 92.32 107.75 345.47 16386.47 256909840.66 5.67 75.20 1246.17 854162 42.51 30.56 4347.153 0.78758 1.00173 0.00643 3.60799 0.36120 4.18174 1.44437 14.83573 46.97 91.24 15.51 26.60 2788 105.35 112.39 311.78 18568.72 261683201.29 5.38 70.21 1287.10 871209 37.19 29.80 4449.465 0.81029 0.47972 0.00825 1.88799 0.36189 4.56809 1.45107 16.40487 47.98 96.15 15.62 27.10 4032 112.72 117.53 274.26 OpenBenchmarking.org
OpenArena Resolution: 1600 x 900 - Total Frame Time OpenBenchmarking.org Milliseconds, Fewer Is Better OpenArena 0.8.8 Resolution: 1600 x 900 - Total Frame Time Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 16 32 48 64 80 Min: 6 / Avg: 37.5 / Max: 87 Min: 6 / Avg: 36.76 / Max: 84
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.7 Static Web Page Serving Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4K 8K 12K 16K 20K SE +/- 32.48, N = 3 SE +/- 50.19, N = 3 SE +/- 8.86, N = 3 SE +/- 33.27, N = 3 SE +/- 48.41, N = 3 SE +/- 52.67, N = 3 SE +/- 112.16, N = 3 SE +/- 210.98, N = 3 SE +/- 83.24, N = 3 SE +/- 104.70, N = 3 SE +/- 215.05, N = 3 SE +/- 71.94, N = 3 SE +/- 90.07, N = 3 16039.66 16293.98 18751.24 15877.41 19372.45 19829.62 19867.65 18676.07 18039.02 17907.21 17489.16 16386.47 18568.72 -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O2 -O2 1. (CC) gcc options: -shared -fPIC -pthread
Hierarchical INTegration Test: FLOAT OpenBenchmarking.org QUIPs, More Is Better Hierarchical INTegration 1.0 Test: FLOAT Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 60M 120M 180M 240M 300M SE +/- 760613.83, N = 3 SE +/- 493437.07, N = 3 SE +/- 111632.79, N = 3 SE +/- 3244431.09, N = 6 SE +/- 267421.48, N = 3 SE +/- 305141.93, N = 3 SE +/- 2418422.68, N = 3 SE +/- 350119.63, N = 3 SE +/- 296755.72, N = 3 SE +/- 420127.65, N = 3 SE +/- 133746.65, N = 3 SE +/- 1101584.69, N = 3 SE +/- 302330.93, N = 3 257015556.14 257145686.34 258105597.56 204750569.74 256549866.52 256863781.01 254643172.98 257621036.78 257485642.98 256953351.09 257448930.45 256909840.66 261683201.29 1. (CC) gcc options: -O3 -march=native -lm
FLAC Audio Encoding WAV To FLAC OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.3.0 WAV To FLAC Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 3 6 9 12 15 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.00, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.07, N = 10 SE +/- 0.02, N = 5 7.35 7.39 7.37 9.27 7.45 7.45 7.44 7.35 7.36 7.34 7.38 5.67 5.38 -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O2 -O2 1. (CXX) g++ options: -fvisibility=hidden -logg -lm
Open Porous Media OPM Benchmark: Upscale-Relperm OpenBenchmarking.org Seconds, Fewer Is Better Open Porous Media 2013-11-26 OPM Benchmark: Upscale-Relperm Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 30 60 90 120 150 SE +/- 2.19, N = 3 SE +/- 0.48, N = 3 SE +/- 0.38, N = 3 SE +/- 1.00, N = 3 SE +/- 0.51, N = 3 SE +/- 0.47, N = 3 SE +/- 0.55, N = 3 SE +/- 0.93, N = 3 SE +/- 0.74, N = 3 SE +/- 0.95, N = 3 SE +/- 1.14, N = 3 130.77 134.59 133.72 133.09 132.66 132.51 131.66 132.95 134.29 133.12 132.63 1. (F9X) gfortran options: -rdynamic
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.46, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 69.77 69.78 69.73 69.81 70.22 69.99 70.30 69.79 70.82 69.73 69.75 75.20 70.21 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -lm -lpthread -O3
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 300 600 900 1200 1500 SE +/- 0.60, N = 3 SE +/- 1.22, N = 3 SE +/- 0.32, N = 3 SE +/- 42.28, N = 6 SE +/- 0.94, N = 3 SE +/- 0.89, N = 3 SE +/- 0.77, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.57, N = 3 SE +/- 0.54, N = 3 SE +/- 5.88, N = 3 SE +/- 0.43, N = 3 1293.17 1291.16 1295.39 1091.93 1285.93 1289.82 1292.16 1291.80 1290.87 1290.34 1292.85 1246.17 1287.10 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -O3
TSCP AI Chess Performance OpenBenchmarking.org Nodes Per Second, More Is Better TSCP 1.81 AI Chess Performance Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 200K 400K 600K 800K 1000K SE +/- 308.60, N = 5 SE +/- 0.00, N = 5 SE +/- 377.96, N = 5 SE +/- 30804.53, N = 10 SE +/- 1200.65, N = 5 SE +/- 1412.07, N = 5 SE +/- 6276.93, N = 5 SE +/- 376.73, N = 5 SE +/- 308.60, N = 5 SE +/- 752.97, N = 5 SE +/- 783.98, N = 5 SE +/- 7174.61, N = 5 SE +/- 275.40, N = 5 922267 922576 921959 781412 909181 914011 906059 920418 921342 920728 920420 854162 871209 1. (CC) gcc options: -O3 -march=native
Timed MrBayes Analysis Primate Phylogeny Analysis OpenBenchmarking.org Seconds, Fewer Is Better Timed MrBayes Analysis 3.1.2 Primate Phylogeny Analysis Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.35, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 25.68 25.66 25.30 26.12 25.42 25.44 25.34 25.14 25.52 25.30 25.23 42.51 37.19
PolyBench-C Test: 3 Matrix Multiplications OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: 3 Matrix Multiplications Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 8 16 24 32 40 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.48, N = 4 SE +/- 0.10, N = 3 SE +/- 0.47, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.26, N = 3 SE +/- 0.02, N = 3 33.65 33.02 31.62 30.05 33.35 32.99 32.36 33.33 33.06 32.83 32.84 30.56 29.80 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -O3
HPC Challenge Test / Class: Max Ping Pong Bandwidth OpenBenchmarking.org MB/s, More Is Better HPC Challenge 1.4.3 Test / Class: Max Ping Pong Bandwidth Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 1000 2000 3000 4000 5000 SE +/- 6.09, N = 3 SE +/- 9.73, N = 3 SE +/- 25.42, N = 3 SE +/- 1.70, N = 3 SE +/- 21.59, N = 3 SE +/- 9.95, N = 3 SE +/- 16.27, N = 3 SE +/- 68.19, N = 3 SE +/- 13.39, N = 3 SE +/- 42.87, N = 3 SE +/- 16.89, N = 3 SE +/- 72.74, N = 3 SE +/- 13.12, N = 3 4606.19 4610.01 4635.30 4622.67 4756.54 4676.84 4744.80 4675.72 4555.80 4623.47 4617.71 4347.15 4449.47 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Random Ring Bandwidth OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: Random Ring Bandwidth Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.1823 0.3646 0.5469 0.7292 0.9115 SE +/- 0.00092, N = 3 SE +/- 0.00090, N = 3 SE +/- 0.00067, N = 3 SE +/- 0.00176, N = 3 SE +/- 0.00205, N = 3 SE +/- 0.00121, N = 3 SE +/- 0.00282, N = 3 SE +/- 0.00057, N = 3 SE +/- 0.00143, N = 3 SE +/- 0.00149, N = 3 SE +/- 0.00150, N = 3 SE +/- 0.00803, N = 3 SE +/- 0.00141, N = 3 0.76495 0.76371 0.76887 0.76856 0.76677 0.76847 0.78239 0.76691 0.76805 0.76348 0.76400 0.78758 0.81029 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Random Ring Latency OpenBenchmarking.org usecs, Fewer Is Better HPC Challenge 1.4.3 Test / Class: Random Ring Latency Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.2254 0.4508 0.6762 0.9016 1.127 SE +/- 0.00655, N = 3 SE +/- 0.01850, N = 3 SE +/- 0.00238, N = 3 SE +/- 0.00796, N = 3 SE +/- 0.00578, N = 3 SE +/- 0.00156, N = 3 SE +/- 0.01092, N = 3 SE +/- 0.00454, N = 3 SE +/- 0.01141, N = 3 SE +/- 0.01167, N = 3 SE +/- 0.00937, N = 3 SE +/- 0.53971, N = 3 SE +/- 0.01253, N = 3 0.57061 0.57507 0.55178 0.55938 0.55916 0.55286 0.56350 0.55530 0.61911 0.57234 0.55730 1.00173 0.47972 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Random Access OpenBenchmarking.org GUP/s, More Is Better HPC Challenge 1.4.3 Test / Class: G-Random Access Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.0057 0.0114 0.0171 0.0228 0.0285 SE +/- 0.00270, N = 3 SE +/- 0.00004, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00072, N = 3 SE +/- 0.00007, N = 3 SE +/- 0.00011, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00001, N = 3 SE +/- 0.00008, N = 3 SE +/- 0.00034, N = 3 SE +/- 0.00223, N = 3 SE +/- 0.00003, N = 3 SE +/- 0.00005, N = 3 0.01715 0.02006 0.02010 0.02521 0.02019 0.02003 0.02035 0.02044 0.02006 0.01985 0.01781 0.00643 0.00825 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: EP-STREAM Triad OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: EP-STREAM Triad Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.8118 1.6236 2.4354 3.2472 4.059 SE +/- 0.06195, N = 3 SE +/- 0.00604, N = 3 SE +/- 0.06504, N = 3 SE +/- 0.73548, N = 3 SE +/- 0.07601, N = 3 SE +/- 0.04706, N = 3 SE +/- 0.00617, N = 3 SE +/- 0.19836, N = 3 SE +/- 0.03006, N = 3 SE +/- 0.00276, N = 3 SE +/- 0.01084, N = 3 SE +/- 0.15886, N = 3 SE +/- 0.05819, N = 3 1.87469 1.83853 1.96953 3.14201 1.91326 1.82648 1.85094 2.01190 1.80922 1.77692 1.80114 3.60799 1.88799 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Ptrans OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: G-Ptrans Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.0899 0.1798 0.2697 0.3596 0.4495 SE +/- 0.00207, N = 3 SE +/- 0.00217, N = 3 SE +/- 0.00115, N = 3 SE +/- 0.01615, N = 3 SE +/- 0.00019, N = 3 SE +/- 0.00354, N = 3 SE +/- 0.00232, N = 3 SE +/- 0.00314, N = 3 SE +/- 0.00363, N = 3 SE +/- 0.00108, N = 3 SE +/- 0.00086, N = 3 SE +/- 0.00818, N = 3 SE +/- 0.00153, N = 3 0.36755 0.36669 0.36681 0.39936 0.37226 0.36738 0.37476 0.36835 0.36655 0.37046 0.37024 0.36120 0.36189 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: EP-DGEMM OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: EP-DGEMM Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 1.0303 2.0606 3.0909 4.1212 5.1515 SE +/- 0.00050, N = 3 SE +/- 0.00091, N = 3 SE +/- 0.00429, N = 3 SE +/- 0.00430, N = 3 SE +/- 0.00140, N = 3 SE +/- 0.00198, N = 3 SE +/- 0.00284, N = 3 SE +/- 0.00085, N = 3 SE +/- 0.00108, N = 3 SE +/- 0.00056, N = 3 SE +/- 0.00151, N = 3 SE +/- 0.00588, N = 3 SE +/- 0.00462, N = 3 4.57247 4.57203 4.57484 4.55708 4.57413 4.57506 4.57913 4.57446 4.09877 4.56999 4.57681 4.18174 4.56809 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Ffte OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: G-Ffte Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.3265 0.653 0.9795 1.306 1.6325 SE +/- 0.00916, N = 3 SE +/- 0.00161, N = 3 SE +/- 0.00694, N = 3 SE +/- 0.00292, N = 3 SE +/- 0.00370, N = 3 SE +/- 0.00891, N = 3 SE +/- 0.00532, N = 3 SE +/- 0.00233, N = 3 SE +/- 0.00691, N = 3 SE +/- 0.00448, N = 3 SE +/- 0.00671, N = 3 SE +/- 0.03349, N = 3 SE +/- 0.00501, N = 3 1.40943 1.39361 1.39475 1.35914 1.41432 1.41559 1.43874 1.41145 1.41259 1.41601 1.40779 1.44437 1.45107 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-HPL OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: G-HPL Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.83 16.82 16.88 16.82 16.86 16.83 16.90 16.89 14.77 16.85 16.92 14.84 16.40 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
Xonotic Resolution: 1600 x 900 - Effects Quality: High OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.7 Resolution: 1600 x 900 - Effects Quality: High Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 49.35 49.37 49.27 49.31 48.69 48.87 48.90 49.40 46.97 47.98 MIN: 29 / MAX: 63 MIN: 29 / MAX: 63 MIN: 28 / MAX: 63 MIN: 29 / MAX: 63 MIN: 28 / MAX: 63 MIN: 28 / MAX: 63 MIN: 28 / MAX: 63 MIN: 29 / MAX: 64 MIN: 28 / MAX: 61 MIN: 28 / MAX: 62
Xonotic Resolution: 1600 x 900 - Effects Quality: Low OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.7 Resolution: 1600 x 900 - Effects Quality: Low Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.27, N = 3 SE +/- 0.05, N = 3 93.28 93.44 93.72 93.90 91.40 91.59 91.64 94.03 91.24 96.15 MIN: 55 / MAX: 133 MIN: 54 / MAX: 134 MIN: 55 / MAX: 133 MIN: 55 / MAX: 134 MIN: 54 / MAX: 129 MIN: 57 / MAX: 130 MIN: 57 / MAX: 130 MIN: 55 / MAX: 134 MIN: 54 / MAX: 132 MIN: 61 / MAX: 136
Unigine Sanctuary Resolution: 1024 x 768 OpenBenchmarking.org Frames Per Second, More Is Better Unigine Sanctuary 2.3 Resolution: 1024 x 768 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 6 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.79 2.73 2.75 2.75 2.74 2.69 2.65 2.75 15.51 15.62
OpenArena Resolution: 1600 x 900 - Total Frame Time OpenBenchmarking.org Milliseconds, Fewer Is Better OpenArena 0.8.8 Resolution: 1600 x 900 - Total Frame Time Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 15 30 45 60 75 Min: 6 / Avg: 36.46 / Max: 77 Min: 6 / Avg: 36.47 / Max: 78 Min: 5 / Avg: 36.39 / Max: 78 Min: 6 / Avg: 36.47 / Max: 77 Min: 6 / Avg: 36.48 / Max: 78 Min: 6 / Avg: 36.44 / Max: 77 Min: 6 / Avg: 36.49 / Max: 77 Min: 5 / Avg: 36.28 / Max: 78
OpenArena Resolution: 1600 x 900 OpenBenchmarking.org Frames Per Second, More Is Better OpenArena 0.8.8 Resolution: 1600 x 900 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 27.33 27.40 27.40 27.33 27.30 27.33 27.33 27.43 26.60 27.10 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 5 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 5 / MAX: 78 MIN: 6 / MAX: 87 MIN: 6 / MAX: 85
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 900 1800 2700 3600 4500 SE +/- 0.00, N = 3 SE +/- 2.33, N = 3 SE +/- 6.33, N = 3 SE +/- 2.67, N = 3 SE +/- 3.67, N = 3 SE +/- 9.70, N = 3 SE +/- 3.67, N = 3 SE +/- 4.00, N = 3 SE +/- 11.00, N = 3 SE +/- 3.67, N = 3 SE +/- 0.00, N = 3 SE +/- 36.84, N = 3 SE +/- 0.00, N = 3 1428 1386 1530 1409 1637 1648 1637 1685 1644 1619 1524 2788 4032 1. (CC) gcc options: -O3
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 30 60 90 120 150 SE +/- 6.31, N = 3 SE +/- 6.31, N = 3 SE +/- 4.02, N = 3 SE +/- 2.13, N = 3 SE +/- 5.25, N = 3 SE +/- 3.67, N = 3 SE +/- 2.30, N = 3 SE +/- 5.40, N = 3 SE +/- 4.44, N = 3 SE +/- 6.95, N = 3 SE +/- 7.88, N = 3 SE +/- 1.89, N = 3 SE +/- 1.07, N = 3 95.13 98.62 94.78 92.32 93.42 96.36 97.72 104.08 100.73 101.49 98.20 105.35 112.72
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 30 60 90 120 150 SE +/- 1.07, N = 3 SE +/- 0.19, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.67, N = 3 SE +/- 0.63, N = 3 SE +/- 0.83, N = 3 SE +/- 0.44, N = 3 SE +/- 1.12, N = 3 SE +/- 0.45, N = 3 SE +/- 0.43, N = 3 SE +/- 0.55, N = 3 SE +/- 1.96, N = 3 108.63 106.10 105.63 107.75 105.49 106.04 105.91 106.99 107.25 106.03 105.65 112.39 117.53
Dbench Client Count: 1 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 1 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 90 180 270 360 450 SE +/- 0.76, N = 3 SE +/- 0.53, N = 3 SE +/- 1.74, N = 3 SE +/- 0.11, N = 3 SE +/- 0.62, N = 3 SE +/- 0.58, N = 3 SE +/- 0.57, N = 3 SE +/- 0.44, N = 3 SE +/- 0.26, N = 3 SE +/- 0.37, N = 3 SE +/- 2.96, N = 3 SE +/- 1.64, N = 3 SE +/- 0.70, N = 3 316.59 291.94 349.05 345.47 209.16 211.15 210.42 209.88 432.02 193.16 184.84 311.78 274.26 -O2 -O2 1. (CC) gcc options: -lpopt
Phoronix Test Suite v10.8.5