Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks Linux 3.3 to Linux 3.13 kernel benchmarks by Michael Larabel for a future article on Phoronix.com then now in 2016 tested with Ubuntu 16.10 plus Linux 4.9 kernel. Fun retrospective.
HTML result view exported from: https://openbenchmarking.org/result/1610234-PTS-1610219L89&export=txt&sro&grt .
Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 Intel Core i5-2520M @ 2.50GHz (4 Cores) HP 161C Intel 2nd Generation Core Family DRAM 4096MB 160GB INTEL SSDSA2M160 LLVMpipe IDT 92HD81B1X5 Intel 82579LM Gigabit Connection + Intel Centrino Advanced-N 6205 Ubuntu 13.10 3.3.0-030300-generic (x86_64) Unity 7.1.2 X Server 1.14.5 intel 2.99.907 2.1 Mesa 10.1.0-devel (git-07149f0 saucy-oibaf-ppa+curaga) Gallium 0.4 GCC 4.8 ext4 1600x900 3.4.0-030400-generic (x86_64) 3.5.0-030500-generic (x86_64) Intel HD 3000 3.6.0-030600-generic (x86_64) 3.1 Mesa 10.1.0-devel (git-07149f0 saucy-oibaf-ppa+curaga) Intel HD 3000 (1300MHz) 3.7.0-030700-generic (x86_64) 3.8.0-030800-generic (x86_64) Intel Core i5-2520M @ 3.20GHz (4 Cores) 3.9.0-030900-generic (x86_64) 3.10.0-031000-generic (x86_64) 3.11.0-031100-generic (x86_64) 3.12.0-031200-generic (x86_64) 3.13.0-031300-generic (x86_64) Intel 2nd Generation Core Family IGP Ubuntu 16.10 4.8.0-22-generic (x86_64) Unity 7.5.0 X Server 1.18.4 modesetting 1.18.4 3.3 Mesa 12.0.3 GCC 6.2.0 20161005 4.9.0-999-generic (x86_64) 20161020 OpenBenchmarking.org Environment Details - Linux 3.3, Linux 3.4, Linux 3.5: LIBGL_ALWAYS_SOFTWARE=1 Compiler Details - Linux 3.3: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.4: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.7: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.9: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.11: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.12: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.13: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu 16.10 Linux 4.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu 16.10 Linux 4.9: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details - Linux 3.3: CFQ / barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr - Linux 3.4: CFQ / data=ordered,errors=remount-ro,relatime,rw - Linux 3.5: CFQ / data=ordered,errors=remount-ro,relatime,rw - Linux 3.6: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.7: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.8: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.9: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.10: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.11: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.12: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.13: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Ubuntu 16.10 Linux 4.8: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Ubuntu 16.10 Linux 4.9: DEADLINE / data=ordered,errors=remount-ro,relatime,rw Processor Details - Linux 3.3: Scaling Governor: acpi-cpufreq ondemand - Linux 3.4: Scaling Governor: acpi-cpufreq ondemand - Linux 3.5: Scaling Governor: acpi-cpufreq ondemand - Linux 3.6: Scaling Governor: acpi-cpufreq ondemand - Linux 3.7: Scaling Governor: acpi-cpufreq ondemand - Linux 3.8: Scaling Governor: acpi-cpufreq ondemand - Linux 3.9: Scaling Governor: intel_pstate powersave - Linux 3.10: Scaling Governor: intel_pstate powersave - Linux 3.11: Scaling Governor: intel_pstate powersave - Linux 3.12: Scaling Governor: intel_pstate powersave - Linux 3.13: Scaling Governor: intel_pstate performance - Ubuntu 16.10 Linux 4.8: Scaling Governor: intel_pstate powersave - Ubuntu 16.10 Linux 4.9: Scaling Governor: intel_pstate powersave System Details - Linux 3.3: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.4: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.5: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.6: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.7: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.8: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.9: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.10: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.11: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.12: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.13: Disk Scheduler: DEADLINE. Python 2.7.5+. - Ubuntu 16.10 Linux 4.8: Python 2.7.12+. - Ubuntu 16.10 Linux 4.9: Python 2.7.12+. Graphics Details - Linux 3.5, Linux 3.6, Linux 3.7, Linux 3.8, Linux 3.9, Linux 3.10, Linux 3.11, Linux 3.12, Linux 3.13: SNA
Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks apache: Static Web Page Serving c-ray: Total Time compilebench: Compile compilebench: Initial Create dbench: 1 encode-flac: WAV To FLAC hint: FLOAT himeno: Poisson Pressure Solver hpcc: G-HPL hpcc: G-Ffte hpcc: EP-DGEMM hpcc: G-Ptrans hpcc: EP-STREAM Triad hpcc: G-Rand Access hpcc: Rand Ring Latency hpcc: Rand Ring Bandwidth hpcc: Max Ping Pong Bandwidth open-porous-media: Upscale-Relperm openarena: 1600 x 900 polybench-c: 3 Matrix Multiplications postmark: Disk Transaction Performance mrbayes: Primate Phylogeny Analysis tscp: AI Chess Performance unigine-sanctuary: 1024 x 768 xonotic: 1600 x 900 - Low xonotic: 1600 x 900 - High Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 19372.45 70.22 105.49 93.42 209.16 7.45 256549866.52 1285.93 16.86447 1.41432 4.57413 0.37226 1.91326 0.02019 0.55916 0.76677 4756.541 132.66 33.35 1637 25.42 909181 19829.62 69.99 106.04 96.36 211.15 7.45 256863781.01 1289.82 16.83193 1.41559 4.57506 0.36738 1.82648 0.02003 0.55286 0.76847 4676.835 132.51 32.99 1648 25.44 914011 19867.65 70.30 105.91 97.72 210.42 7.44 254643172.98 1292.16 16.89897 1.43874 4.57913 0.37476 1.85094 0.02035 0.56350 0.78239 4744.799 131.66 32.36 1637 25.34 906059 18676.07 69.79 106.99 104.08 209.88 7.35 257621036.78 1291.80 16.89153 1.41145 4.57446 0.36835 2.01190 0.02044 0.55530 0.76691 4675.720 132.95 27.30 33.33 1685 25.14 920418 2.74 91.40 48.69 18039.02 70.82 107.25 100.73 432.02 7.36 257485642.98 1290.87 14.76670 1.41259 4.09877 0.36655 1.80922 0.02006 0.61911 0.76805 4555.803 134.29 27.33 33.06 1644 25.52 921342 2.69 91.59 48.87 17907.21 69.73 106.03 101.49 193.16 7.34 256953351.09 1290.34 16.84943 1.41601 4.56999 0.37046 1.77692 0.01985 0.57234 0.76348 4623.472 133.12 27.33 32.83 1619 25.30 920728 2.65 91.64 48.90 17489.16 69.75 105.65 98.20 184.84 7.38 257448930.45 1292.85 16.91637 1.40779 4.57681 0.37024 1.80114 0.01781 0.55730 0.76400 4617.706 132.63 27.43 32.84 1524 25.23 920420 2.75 94.03 49.40 16039.66 69.77 108.63 95.13 316.59 7.35 257015556.14 1293.17 16.82943 1.40943 4.57247 0.36755 1.87469 0.01715 0.57061 0.76495 4606.189 130.77 27.33 33.65 1428 25.68 922267 2.79 93.28 49.35 16293.98 69.78 106.10 98.62 291.94 7.39 257145686.34 1291.16 16.81867 1.39361 4.57203 0.36669 1.83853 0.02006 0.57507 0.76371 4610.011 134.59 27.40 33.02 1386 25.66 922576 2.73 93.44 49.37 18751.24 69.73 105.63 94.78 349.05 7.37 258105597.56 1295.39 16.87890 1.39475 4.57484 0.36681 1.96953 0.02010 0.55178 0.76887 4635.295 133.72 27.40 31.62 1530 25.30 921959 2.75 93.72 49.27 15877.41 69.81 107.75 92.32 345.47 9.27 204750569.74 1091.93 16.82127 1.35914 4.55708 0.39936 3.14201 0.02521 0.55938 0.76856 4622.673 133.09 27.33 30.05 1409 26.12 781412 2.75 93.90 49.31 16386.47 75.20 112.39 105.35 311.78 5.67 256909840.66 1246.17 14.83573 1.44437 4.18174 0.36120 3.60799 0.00643 1.00173 0.78758 4347.153 26.60 30.56 2788 42.51 854162 15.51 91.24 46.97 18568.72 70.21 117.53 112.72 274.26 5.38 261683201.29 1287.10 16.40487 1.45107 4.56809 0.36189 1.88799 0.00825 0.47972 0.81029 4449.465 27.10 29.80 4032 37.19 871209 15.62 96.15 47.98 OpenBenchmarking.org
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.7 Static Web Page Serving Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4K 8K 12K 16K 20K SE +/- 32.48, N = 3 SE +/- 50.19, N = 3 SE +/- 8.86, N = 3 SE +/- 33.27, N = 3 SE +/- 48.41, N = 3 SE +/- 52.67, N = 3 SE +/- 112.16, N = 3 SE +/- 210.98, N = 3 SE +/- 83.24, N = 3 SE +/- 104.70, N = 3 SE +/- 215.05, N = 3 SE +/- 71.94, N = 3 SE +/- 90.07, N = 3 16039.66 16293.98 18751.24 15877.41 19372.45 19829.62 19867.65 18676.07 18039.02 17907.21 17489.16 16386.47 18568.72 -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O2 -O2 1. (CC) gcc options: -shared -fPIC -pthread
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.46, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 69.77 69.78 69.73 69.81 70.22 69.99 70.30 69.79 70.82 69.73 69.75 75.20 70.21 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -lm -lpthread -O3
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 30 60 90 120 150 SE +/- 1.07, N = 3 SE +/- 0.19, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.67, N = 3 SE +/- 0.63, N = 3 SE +/- 0.83, N = 3 SE +/- 0.44, N = 3 SE +/- 1.12, N = 3 SE +/- 0.45, N = 3 SE +/- 0.43, N = 3 SE +/- 0.55, N = 3 SE +/- 1.96, N = 3 108.63 106.10 105.63 107.75 105.49 106.04 105.91 106.99 107.25 106.03 105.65 112.39 117.53
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 30 60 90 120 150 SE +/- 6.31, N = 3 SE +/- 6.31, N = 3 SE +/- 4.02, N = 3 SE +/- 2.13, N = 3 SE +/- 5.25, N = 3 SE +/- 3.67, N = 3 SE +/- 2.30, N = 3 SE +/- 5.40, N = 3 SE +/- 4.44, N = 3 SE +/- 6.95, N = 3 SE +/- 7.88, N = 3 SE +/- 1.89, N = 3 SE +/- 1.07, N = 3 95.13 98.62 94.78 92.32 93.42 96.36 97.72 104.08 100.73 101.49 98.20 105.35 112.72
Dbench Client Count: 1 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 1 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 90 180 270 360 450 SE +/- 0.76, N = 3 SE +/- 0.53, N = 3 SE +/- 1.74, N = 3 SE +/- 0.11, N = 3 SE +/- 0.62, N = 3 SE +/- 0.58, N = 3 SE +/- 0.57, N = 3 SE +/- 0.44, N = 3 SE +/- 0.26, N = 3 SE +/- 0.37, N = 3 SE +/- 2.96, N = 3 SE +/- 1.64, N = 3 SE +/- 0.70, N = 3 316.59 291.94 349.05 345.47 209.16 211.15 210.42 209.88 432.02 193.16 184.84 311.78 274.26 -O2 -O2 1. (CC) gcc options: -lpopt
FLAC Audio Encoding WAV To FLAC OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.3.0 WAV To FLAC Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 3 6 9 12 15 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.00, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.07, N = 10 SE +/- 0.02, N = 5 7.35 7.39 7.37 9.27 7.45 7.45 7.44 7.35 7.36 7.34 7.38 5.67 5.38 -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O2 -O2 1. (CXX) g++ options: -fvisibility=hidden -logg -lm
Hierarchical INTegration Test: FLOAT OpenBenchmarking.org QUIPs, More Is Better Hierarchical INTegration 1.0 Test: FLOAT Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 60M 120M 180M 240M 300M SE +/- 760613.83, N = 3 SE +/- 493437.07, N = 3 SE +/- 111632.79, N = 3 SE +/- 3244431.09, N = 6 SE +/- 267421.48, N = 3 SE +/- 305141.93, N = 3 SE +/- 2418422.68, N = 3 SE +/- 350119.63, N = 3 SE +/- 296755.72, N = 3 SE +/- 420127.65, N = 3 SE +/- 133746.65, N = 3 SE +/- 1101584.69, N = 3 SE +/- 302330.93, N = 3 257015556.14 257145686.34 258105597.56 204750569.74 256549866.52 256863781.01 254643172.98 257621036.78 257485642.98 256953351.09 257448930.45 256909840.66 261683201.29 1. (CC) gcc options: -O3 -march=native -lm
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 300 600 900 1200 1500 SE +/- 0.60, N = 3 SE +/- 1.22, N = 3 SE +/- 0.32, N = 3 SE +/- 42.28, N = 6 SE +/- 0.94, N = 3 SE +/- 0.89, N = 3 SE +/- 0.77, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.57, N = 3 SE +/- 0.54, N = 3 SE +/- 5.88, N = 3 SE +/- 0.43, N = 3 1293.17 1291.16 1295.39 1091.93 1285.93 1289.82 1292.16 1291.80 1290.87 1290.34 1292.85 1246.17 1287.10 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -O3
HPC Challenge Test / Class: G-HPL OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: G-HPL Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.83 16.82 16.88 16.82 16.86 16.83 16.90 16.89 14.77 16.85 16.92 14.84 16.40 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Ffte OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: G-Ffte Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.3265 0.653 0.9795 1.306 1.6325 SE +/- 0.00916, N = 3 SE +/- 0.00161, N = 3 SE +/- 0.00694, N = 3 SE +/- 0.00292, N = 3 SE +/- 0.00370, N = 3 SE +/- 0.00891, N = 3 SE +/- 0.00532, N = 3 SE +/- 0.00233, N = 3 SE +/- 0.00691, N = 3 SE +/- 0.00448, N = 3 SE +/- 0.00671, N = 3 SE +/- 0.03349, N = 3 SE +/- 0.00501, N = 3 1.40943 1.39361 1.39475 1.35914 1.41432 1.41559 1.43874 1.41145 1.41259 1.41601 1.40779 1.44437 1.45107 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: EP-DGEMM OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: EP-DGEMM Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 1.0303 2.0606 3.0909 4.1212 5.1515 SE +/- 0.00050, N = 3 SE +/- 0.00091, N = 3 SE +/- 0.00429, N = 3 SE +/- 0.00430, N = 3 SE +/- 0.00140, N = 3 SE +/- 0.00198, N = 3 SE +/- 0.00284, N = 3 SE +/- 0.00085, N = 3 SE +/- 0.00108, N = 3 SE +/- 0.00056, N = 3 SE +/- 0.00151, N = 3 SE +/- 0.00588, N = 3 SE +/- 0.00462, N = 3 4.57247 4.57203 4.57484 4.55708 4.57413 4.57506 4.57913 4.57446 4.09877 4.56999 4.57681 4.18174 4.56809 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Ptrans OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: G-Ptrans Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.0899 0.1798 0.2697 0.3596 0.4495 SE +/- 0.00207, N = 3 SE +/- 0.00217, N = 3 SE +/- 0.00115, N = 3 SE +/- 0.01615, N = 3 SE +/- 0.00019, N = 3 SE +/- 0.00354, N = 3 SE +/- 0.00232, N = 3 SE +/- 0.00314, N = 3 SE +/- 0.00363, N = 3 SE +/- 0.00108, N = 3 SE +/- 0.00086, N = 3 SE +/- 0.00818, N = 3 SE +/- 0.00153, N = 3 0.36755 0.36669 0.36681 0.39936 0.37226 0.36738 0.37476 0.36835 0.36655 0.37046 0.37024 0.36120 0.36189 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: EP-STREAM Triad OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: EP-STREAM Triad Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.8118 1.6236 2.4354 3.2472 4.059 SE +/- 0.06195, N = 3 SE +/- 0.00604, N = 3 SE +/- 0.06504, N = 3 SE +/- 0.73548, N = 3 SE +/- 0.07601, N = 3 SE +/- 0.04706, N = 3 SE +/- 0.00617, N = 3 SE +/- 0.19836, N = 3 SE +/- 0.03006, N = 3 SE +/- 0.00276, N = 3 SE +/- 0.01084, N = 3 SE +/- 0.15886, N = 3 SE +/- 0.05819, N = 3 1.87469 1.83853 1.96953 3.14201 1.91326 1.82648 1.85094 2.01190 1.80922 1.77692 1.80114 3.60799 1.88799 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Random Access OpenBenchmarking.org GUP/s, More Is Better HPC Challenge 1.4.3 Test / Class: G-Random Access Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.0057 0.0114 0.0171 0.0228 0.0285 SE +/- 0.00270, N = 3 SE +/- 0.00004, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00072, N = 3 SE +/- 0.00007, N = 3 SE +/- 0.00011, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00001, N = 3 SE +/- 0.00008, N = 3 SE +/- 0.00034, N = 3 SE +/- 0.00223, N = 3 SE +/- 0.00003, N = 3 SE +/- 0.00005, N = 3 0.01715 0.02006 0.02010 0.02521 0.02019 0.02003 0.02035 0.02044 0.02006 0.01985 0.01781 0.00643 0.00825 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Random Ring Latency OpenBenchmarking.org usecs, Fewer Is Better HPC Challenge 1.4.3 Test / Class: Random Ring Latency Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.2254 0.4508 0.6762 0.9016 1.127 SE +/- 0.00655, N = 3 SE +/- 0.01850, N = 3 SE +/- 0.00238, N = 3 SE +/- 0.00796, N = 3 SE +/- 0.00578, N = 3 SE +/- 0.00156, N = 3 SE +/- 0.01092, N = 3 SE +/- 0.00454, N = 3 SE +/- 0.01141, N = 3 SE +/- 0.01167, N = 3 SE +/- 0.00937, N = 3 SE +/- 0.53971, N = 3 SE +/- 0.01253, N = 3 0.57061 0.57507 0.55178 0.55938 0.55916 0.55286 0.56350 0.55530 0.61911 0.57234 0.55730 1.00173 0.47972 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Random Ring Bandwidth OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: Random Ring Bandwidth Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.1823 0.3646 0.5469 0.7292 0.9115 SE +/- 0.00092, N = 3 SE +/- 0.00090, N = 3 SE +/- 0.00067, N = 3 SE +/- 0.00176, N = 3 SE +/- 0.00205, N = 3 SE +/- 0.00121, N = 3 SE +/- 0.00282, N = 3 SE +/- 0.00057, N = 3 SE +/- 0.00143, N = 3 SE +/- 0.00149, N = 3 SE +/- 0.00150, N = 3 SE +/- 0.00803, N = 3 SE +/- 0.00141, N = 3 0.76495 0.76371 0.76887 0.76856 0.76677 0.76847 0.78239 0.76691 0.76805 0.76348 0.76400 0.78758 0.81029 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Max Ping Pong Bandwidth OpenBenchmarking.org MB/s, More Is Better HPC Challenge 1.4.3 Test / Class: Max Ping Pong Bandwidth Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 1000 2000 3000 4000 5000 SE +/- 6.09, N = 3 SE +/- 9.73, N = 3 SE +/- 25.42, N = 3 SE +/- 1.70, N = 3 SE +/- 21.59, N = 3 SE +/- 9.95, N = 3 SE +/- 16.27, N = 3 SE +/- 68.19, N = 3 SE +/- 13.39, N = 3 SE +/- 42.87, N = 3 SE +/- 16.89, N = 3 SE +/- 72.74, N = 3 SE +/- 13.12, N = 3 4606.19 4610.01 4635.30 4622.67 4756.54 4676.84 4744.80 4675.72 4555.80 4623.47 4617.71 4347.15 4449.47 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
Open Porous Media OPM Benchmark: Upscale-Relperm OpenBenchmarking.org Seconds, Fewer Is Better Open Porous Media 2013-11-26 OPM Benchmark: Upscale-Relperm Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 30 60 90 120 150 SE +/- 2.19, N = 3 SE +/- 0.48, N = 3 SE +/- 0.38, N = 3 SE +/- 1.00, N = 3 SE +/- 0.51, N = 3 SE +/- 0.47, N = 3 SE +/- 0.55, N = 3 SE +/- 0.93, N = 3 SE +/- 0.74, N = 3 SE +/- 0.95, N = 3 SE +/- 1.14, N = 3 130.77 134.59 133.72 133.09 132.66 132.51 131.66 132.95 134.29 133.12 132.63 1. (F9X) gfortran options: -rdynamic
OpenArena Resolution: 1600 x 900 OpenBenchmarking.org Frames Per Second, More Is Better OpenArena 0.8.8 Resolution: 1600 x 900 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 27.33 27.40 27.40 27.33 27.30 27.33 27.33 27.43 26.60 27.10 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 5 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 5 / MAX: 78 MIN: 6 / MAX: 87 MIN: 6 / MAX: 85
OpenArena Resolution: 1600 x 900 - Total Frame Time OpenBenchmarking.org Milliseconds, Fewer Is Better OpenArena 0.8.8 Resolution: 1600 x 900 - Total Frame Time Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 15 30 45 60 75 Min: 6 / Avg: 36.46 / Max: 77 Min: 6 / Avg: 36.47 / Max: 78 Min: 5 / Avg: 36.39 / Max: 78 Min: 6 / Avg: 36.47 / Max: 77 Min: 6 / Avg: 36.48 / Max: 78 Min: 6 / Avg: 36.44 / Max: 77 Min: 6 / Avg: 36.49 / Max: 77 Min: 5 / Avg: 36.28 / Max: 78
OpenArena Resolution: 1600 x 900 - Total Frame Time OpenBenchmarking.org Milliseconds, Fewer Is Better OpenArena 0.8.8 Resolution: 1600 x 900 - Total Frame Time Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 16 32 48 64 80 Min: 6 / Avg: 37.5 / Max: 87 Min: 6 / Avg: 36.76 / Max: 84
PolyBench-C Test: 3 Matrix Multiplications OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: 3 Matrix Multiplications Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 8 16 24 32 40 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.48, N = 4 SE +/- 0.10, N = 3 SE +/- 0.47, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.26, N = 3 SE +/- 0.02, N = 3 33.65 33.02 31.62 30.05 33.35 32.99 32.36 33.33 33.06 32.83 32.84 30.56 29.80 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -O3
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 900 1800 2700 3600 4500 SE +/- 0.00, N = 3 SE +/- 2.33, N = 3 SE +/- 6.33, N = 3 SE +/- 2.67, N = 3 SE +/- 3.67, N = 3 SE +/- 9.70, N = 3 SE +/- 3.67, N = 3 SE +/- 4.00, N = 3 SE +/- 11.00, N = 3 SE +/- 3.67, N = 3 SE +/- 0.00, N = 3 SE +/- 36.84, N = 3 SE +/- 0.00, N = 3 1428 1386 1530 1409 1637 1648 1637 1685 1644 1619 1524 2788 4032 1. (CC) gcc options: -O3
Timed MrBayes Analysis Primate Phylogeny Analysis OpenBenchmarking.org Seconds, Fewer Is Better Timed MrBayes Analysis 3.1.2 Primate Phylogeny Analysis Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.35, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 25.68 25.66 25.30 26.12 25.42 25.44 25.34 25.14 25.52 25.30 25.23 42.51 37.19
TSCP AI Chess Performance OpenBenchmarking.org Nodes Per Second, More Is Better TSCP 1.81 AI Chess Performance Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 200K 400K 600K 800K 1000K SE +/- 308.60, N = 5 SE +/- 0.00, N = 5 SE +/- 377.96, N = 5 SE +/- 30804.53, N = 10 SE +/- 1200.65, N = 5 SE +/- 1412.07, N = 5 SE +/- 6276.93, N = 5 SE +/- 376.73, N = 5 SE +/- 308.60, N = 5 SE +/- 752.97, N = 5 SE +/- 783.98, N = 5 SE +/- 7174.61, N = 5 SE +/- 275.40, N = 5 922267 922576 921959 781412 909181 914011 906059 920418 921342 920728 920420 854162 871209 1. (CC) gcc options: -O3 -march=native
Unigine Sanctuary Resolution: 1024 x 768 OpenBenchmarking.org Frames Per Second, More Is Better Unigine Sanctuary 2.3 Resolution: 1024 x 768 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 6 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.79 2.73 2.75 2.75 2.74 2.69 2.65 2.75 15.51 15.62
Xonotic Resolution: 1600 x 900 - Effects Quality: Low OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.7 Resolution: 1600 x 900 - Effects Quality: Low Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.27, N = 3 SE +/- 0.05, N = 3 93.28 93.44 93.72 93.90 91.40 91.59 91.64 94.03 91.24 96.15 MIN: 55 / MAX: 133 MIN: 54 / MAX: 134 MIN: 55 / MAX: 133 MIN: 55 / MAX: 134 MIN: 54 / MAX: 129 MIN: 57 / MAX: 130 MIN: 57 / MAX: 130 MIN: 55 / MAX: 134 MIN: 54 / MAX: 132 MIN: 61 / MAX: 136
Xonotic Resolution: 1600 x 900 - Effects Quality: High OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.7 Resolution: 1600 x 900 - Effects Quality: High Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 49.35 49.37 49.27 49.31 48.69 48.87 48.90 49.40 46.97 47.98 MIN: 29 / MAX: 63 MIN: 29 / MAX: 63 MIN: 28 / MAX: 63 MIN: 29 / MAX: 63 MIN: 28 / MAX: 63 MIN: 28 / MAX: 63 MIN: 28 / MAX: 63 MIN: 29 / MAX: 64 MIN: 28 / MAX: 61 MIN: 28 / MAX: 62
Phoronix Test Suite v10.8.5