Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks Linux 3.3 to Linux 3.13 kernel benchmarks by Michael Larabel for a future article on Phoronix.com then now in 2016 tested with Ubuntu 16.10 plus Linux 4.9 kernel. Fun retrospective.
HTML result view exported from: https://openbenchmarking.org/result/1610234-PTS-1610219L89&sro&grw&export=pdf .
Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 Intel Core i5-2520M @ 2.50GHz (4 Cores) HP 161C Intel 2nd Generation Core Family DRAM 4096MB 160GB INTEL SSDSA2M160 LLVMpipe IDT 92HD81B1X5 Intel 82579LM Gigabit Connection + Intel Centrino Advanced-N 6205 Ubuntu 13.10 3.3.0-030300-generic (x86_64) Unity 7.1.2 X Server 1.14.5 intel 2.99.907 2.1 Mesa 10.1.0-devel (git-07149f0 saucy-oibaf-ppa+curaga) Gallium 0.4 GCC 4.8 ext4 1600x900 3.4.0-030400-generic (x86_64) 3.5.0-030500-generic (x86_64) Intel HD 3000 3.6.0-030600-generic (x86_64) 3.1 Mesa 10.1.0-devel (git-07149f0 saucy-oibaf-ppa+curaga) Intel HD 3000 (1300MHz) 3.7.0-030700-generic (x86_64) 3.8.0-030800-generic (x86_64) Intel Core i5-2520M @ 3.20GHz (4 Cores) 3.9.0-030900-generic (x86_64) 3.10.0-031000-generic (x86_64) 3.11.0-031100-generic (x86_64) 3.12.0-031200-generic (x86_64) 3.13.0-031300-generic (x86_64) Intel 2nd Generation Core Family IGP Ubuntu 16.10 4.8.0-22-generic (x86_64) Unity 7.5.0 X Server 1.18.4 modesetting 1.18.4 3.3 Mesa 12.0.3 GCC 6.2.0 20161005 4.9.0-999-generic (x86_64) 20161020 OpenBenchmarking.org Environment Details - Linux 3.3, Linux 3.4, Linux 3.5: LIBGL_ALWAYS_SOFTWARE=1 Compiler Details - Linux 3.3: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.4: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.7: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.9: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.11: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.12: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Linux 3.13: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu 16.10 Linux 4.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Ubuntu 16.10 Linux 4.9: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details - Linux 3.3: CFQ / barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr - Linux 3.4: CFQ / data=ordered,errors=remount-ro,relatime,rw - Linux 3.5: CFQ / data=ordered,errors=remount-ro,relatime,rw - Linux 3.6: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.7: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.8: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.9: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.10: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.11: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.12: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Linux 3.13: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Ubuntu 16.10 Linux 4.8: DEADLINE / data=ordered,errors=remount-ro,relatime,rw - Ubuntu 16.10 Linux 4.9: DEADLINE / data=ordered,errors=remount-ro,relatime,rw Processor Details - Linux 3.3: Scaling Governor: acpi-cpufreq ondemand - Linux 3.4: Scaling Governor: acpi-cpufreq ondemand - Linux 3.5: Scaling Governor: acpi-cpufreq ondemand - Linux 3.6: Scaling Governor: acpi-cpufreq ondemand - Linux 3.7: Scaling Governor: acpi-cpufreq ondemand - Linux 3.8: Scaling Governor: acpi-cpufreq ondemand - Linux 3.9: Scaling Governor: intel_pstate powersave - Linux 3.10: Scaling Governor: intel_pstate powersave - Linux 3.11: Scaling Governor: intel_pstate powersave - Linux 3.12: Scaling Governor: intel_pstate powersave - Linux 3.13: Scaling Governor: intel_pstate performance - Ubuntu 16.10 Linux 4.8: Scaling Governor: intel_pstate powersave - Ubuntu 16.10 Linux 4.9: Scaling Governor: intel_pstate powersave System Details - Linux 3.3: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.4: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.5: Disk Scheduler: CFQ. Python 2.7.5+. - Linux 3.6: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.7: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.8: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.9: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.10: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.11: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.12: Disk Scheduler: DEADLINE. Python 2.7.5+. - Linux 3.13: Disk Scheduler: DEADLINE. Python 2.7.5+. - Ubuntu 16.10 Linux 4.8: Python 2.7.12+. - Ubuntu 16.10 Linux 4.9: Python 2.7.12+. Graphics Details - Linux 3.5, Linux 3.6, Linux 3.7, Linux 3.8, Linux 3.9, Linux 3.10, Linux 3.11, Linux 3.12, Linux 3.13: SNA
Intel Linux 3.3 To Linux 3.13 then Linux 4.8/4.8 Kernel Benchmarks tscp: AI Chess Performance compilebench: Compile compilebench: Initial Create hint: FLOAT encode-flac: WAV To FLAC openarena: 1600 x 900 xonotic: 1600 x 900 - Low xonotic: 1600 x 900 - High dbench: 1 mrbayes: Primate Phylogeny Analysis himeno: Poisson Pressure Solver hpcc: G-HPL hpcc: G-Ffte hpcc: EP-DGEMM open-porous-media: Upscale-Relperm hpcc: G-Ptrans hpcc: EP-STREAM Triad hpcc: G-Rand Access hpcc: Rand Ring Latency hpcc: Rand Ring Bandwidth hpcc: Max Ping Pong Bandwidth postmark: Disk Transaction Performance c-ray: Total Time unigine-sanctuary: 1024 x 768 apache: Static Web Page Serving polybench-c: 3 Matrix Multiplications Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 909181 105.49 93.42 256549866.52 7.45 209.16 25.42 1285.93 16.86447 1.41432 4.57413 132.66 0.37226 1.91326 0.02019 0.55916 0.76677 4756.541 1637 70.22 19372.45 33.35 914011 106.04 96.36 256863781.01 7.45 211.15 25.44 1289.82 16.83193 1.41559 4.57506 132.51 0.36738 1.82648 0.02003 0.55286 0.76847 4676.835 1648 69.99 19829.62 32.99 906059 105.91 97.72 254643172.98 7.44 210.42 25.34 1292.16 16.89897 1.43874 4.57913 131.66 0.37476 1.85094 0.02035 0.56350 0.78239 4744.799 1637 70.30 19867.65 32.36 920418 106.99 104.08 257621036.78 7.35 27.30 91.40 48.69 209.88 25.14 1291.80 16.89153 1.41145 4.57446 132.95 0.36835 2.01190 0.02044 0.55530 0.76691 4675.720 1685 69.79 2.74 18676.07 33.33 921342 107.25 100.73 257485642.98 7.36 27.33 91.59 48.87 432.02 25.52 1290.87 14.76670 1.41259 4.09877 134.29 0.36655 1.80922 0.02006 0.61911 0.76805 4555.803 1644 70.82 2.69 18039.02 33.06 920728 106.03 101.49 256953351.09 7.34 27.33 91.64 48.90 193.16 25.30 1290.34 16.84943 1.41601 4.56999 133.12 0.37046 1.77692 0.01985 0.57234 0.76348 4623.472 1619 69.73 2.65 17907.21 32.83 920420 105.65 98.20 257448930.45 7.38 27.43 94.03 49.40 184.84 25.23 1292.85 16.91637 1.40779 4.57681 132.63 0.37024 1.80114 0.01781 0.55730 0.76400 4617.706 1524 69.75 2.75 17489.16 32.84 922267 108.63 95.13 257015556.14 7.35 27.33 93.28 49.35 316.59 25.68 1293.17 16.82943 1.40943 4.57247 130.77 0.36755 1.87469 0.01715 0.57061 0.76495 4606.189 1428 69.77 2.79 16039.66 33.65 922576 106.10 98.62 257145686.34 7.39 27.40 93.44 49.37 291.94 25.66 1291.16 16.81867 1.39361 4.57203 134.59 0.36669 1.83853 0.02006 0.57507 0.76371 4610.011 1386 69.78 2.73 16293.98 33.02 921959 105.63 94.78 258105597.56 7.37 27.40 93.72 49.27 349.05 25.30 1295.39 16.87890 1.39475 4.57484 133.72 0.36681 1.96953 0.02010 0.55178 0.76887 4635.295 1530 69.73 2.75 18751.24 31.62 781412 107.75 92.32 204750569.74 9.27 27.33 93.90 49.31 345.47 26.12 1091.93 16.82127 1.35914 4.55708 133.09 0.39936 3.14201 0.02521 0.55938 0.76856 4622.673 1409 69.81 2.75 15877.41 30.05 854162 112.39 105.35 256909840.66 5.67 26.60 91.24 46.97 311.78 42.51 1246.17 14.83573 1.44437 4.18174 0.36120 3.60799 0.00643 1.00173 0.78758 4347.153 2788 75.20 15.51 16386.47 30.56 871209 117.53 112.72 261683201.29 5.38 27.10 96.15 47.98 274.26 37.19 1287.10 16.40487 1.45107 4.56809 0.36189 1.88799 0.00825 0.47972 0.81029 4449.465 4032 70.21 15.62 18568.72 29.80 OpenBenchmarking.org
TSCP AI Chess Performance OpenBenchmarking.org Nodes Per Second, More Is Better TSCP 1.81 AI Chess Performance Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 200K 400K 600K 800K 1000K SE +/- 308.60, N = 5 SE +/- 0.00, N = 5 SE +/- 377.96, N = 5 SE +/- 30804.53, N = 10 SE +/- 1200.65, N = 5 SE +/- 1412.07, N = 5 SE +/- 6276.93, N = 5 SE +/- 376.73, N = 5 SE +/- 308.60, N = 5 SE +/- 752.97, N = 5 SE +/- 783.98, N = 5 SE +/- 7174.61, N = 5 SE +/- 275.40, N = 5 922267 922576 921959 781412 909181 914011 906059 920418 921342 920728 920420 854162 871209 1. (CC) gcc options: -O3 -march=native
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 30 60 90 120 150 SE +/- 1.07, N = 3 SE +/- 0.19, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.67, N = 3 SE +/- 0.63, N = 3 SE +/- 0.83, N = 3 SE +/- 0.44, N = 3 SE +/- 1.12, N = 3 SE +/- 0.45, N = 3 SE +/- 0.43, N = 3 SE +/- 0.55, N = 3 SE +/- 1.96, N = 3 108.63 106.10 105.63 107.75 105.49 106.04 105.91 106.99 107.25 106.03 105.65 112.39 117.53
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 30 60 90 120 150 SE +/- 6.31, N = 3 SE +/- 6.31, N = 3 SE +/- 4.02, N = 3 SE +/- 2.13, N = 3 SE +/- 5.25, N = 3 SE +/- 3.67, N = 3 SE +/- 2.30, N = 3 SE +/- 5.40, N = 3 SE +/- 4.44, N = 3 SE +/- 6.95, N = 3 SE +/- 7.88, N = 3 SE +/- 1.89, N = 3 SE +/- 1.07, N = 3 95.13 98.62 94.78 92.32 93.42 96.36 97.72 104.08 100.73 101.49 98.20 105.35 112.72
Hierarchical INTegration Test: FLOAT OpenBenchmarking.org QUIPs, More Is Better Hierarchical INTegration 1.0 Test: FLOAT Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 60M 120M 180M 240M 300M SE +/- 760613.83, N = 3 SE +/- 493437.07, N = 3 SE +/- 111632.79, N = 3 SE +/- 3244431.09, N = 6 SE +/- 267421.48, N = 3 SE +/- 305141.93, N = 3 SE +/- 2418422.68, N = 3 SE +/- 350119.63, N = 3 SE +/- 296755.72, N = 3 SE +/- 420127.65, N = 3 SE +/- 133746.65, N = 3 SE +/- 1101584.69, N = 3 SE +/- 302330.93, N = 3 257015556.14 257145686.34 258105597.56 204750569.74 256549866.52 256863781.01 254643172.98 257621036.78 257485642.98 256953351.09 257448930.45 256909840.66 261683201.29 1. (CC) gcc options: -O3 -march=native -lm
FLAC Audio Encoding WAV To FLAC OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.3.0 WAV To FLAC Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 3 6 9 12 15 SE +/- 0.00, N = 5 SE +/- 0.01, N = 5 SE +/- 0.00, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.01, N = 5 SE +/- 0.07, N = 10 SE +/- 0.02, N = 5 7.35 7.39 7.37 9.27 7.45 7.45 7.44 7.35 7.36 7.34 7.38 5.67 5.38 -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O2 -O2 1. (CXX) g++ options: -fvisibility=hidden -logg -lm
OpenArena Resolution: 1600 x 900 OpenBenchmarking.org Frames Per Second, More Is Better OpenArena 0.8.8 Resolution: 1600 x 900 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 6 12 18 24 30 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 27.33 27.40 27.40 27.33 27.30 27.33 27.33 27.43 26.60 27.10 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 5 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 6 / MAX: 78 MIN: 5 / MAX: 78 MIN: 6 / MAX: 87 MIN: 6 / MAX: 85
Xonotic Resolution: 1600 x 900 - Effects Quality: Low OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.7 Resolution: 1600 x 900 - Effects Quality: Low Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 20 40 60 80 100 SE +/- 0.10, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.27, N = 3 SE +/- 0.05, N = 3 93.28 93.44 93.72 93.90 91.40 91.59 91.64 94.03 91.24 96.15 MIN: 55 / MAX: 133 MIN: 54 / MAX: 134 MIN: 55 / MAX: 133 MIN: 55 / MAX: 134 MIN: 54 / MAX: 129 MIN: 57 / MAX: 130 MIN: 57 / MAX: 130 MIN: 55 / MAX: 134 MIN: 54 / MAX: 132 MIN: 61 / MAX: 136
Xonotic Resolution: 1600 x 900 - Effects Quality: High OpenBenchmarking.org Frames Per Second, More Is Better Xonotic 0.7 Resolution: 1600 x 900 - Effects Quality: High Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 49.35 49.37 49.27 49.31 48.69 48.87 48.90 49.40 46.97 47.98 MIN: 29 / MAX: 63 MIN: 29 / MAX: 63 MIN: 28 / MAX: 63 MIN: 29 / MAX: 63 MIN: 28 / MAX: 63 MIN: 28 / MAX: 63 MIN: 28 / MAX: 63 MIN: 29 / MAX: 64 MIN: 28 / MAX: 61 MIN: 28 / MAX: 62
Dbench Client Count: 1 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 1 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 90 180 270 360 450 SE +/- 0.76, N = 3 SE +/- 0.53, N = 3 SE +/- 1.74, N = 3 SE +/- 0.11, N = 3 SE +/- 0.62, N = 3 SE +/- 0.58, N = 3 SE +/- 0.57, N = 3 SE +/- 0.44, N = 3 SE +/- 0.26, N = 3 SE +/- 0.37, N = 3 SE +/- 2.96, N = 3 SE +/- 1.64, N = 3 SE +/- 0.70, N = 3 316.59 291.94 349.05 345.47 209.16 211.15 210.42 209.88 432.02 193.16 184.84 311.78 274.26 -O2 -O2 1. (CC) gcc options: -lpopt
Timed MrBayes Analysis Primate Phylogeny Analysis OpenBenchmarking.org Seconds, Fewer Is Better Timed MrBayes Analysis 3.1.2 Primate Phylogeny Analysis Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 10 20 30 40 50 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.35, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 25.68 25.66 25.30 26.12 25.42 25.44 25.34 25.14 25.52 25.30 25.23 42.51 37.19
Himeno Benchmark Poisson Pressure Solver OpenBenchmarking.org MFLOPS, More Is Better Himeno Benchmark 3.0 Poisson Pressure Solver Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 300 600 900 1200 1500 SE +/- 0.60, N = 3 SE +/- 1.22, N = 3 SE +/- 0.32, N = 3 SE +/- 42.28, N = 6 SE +/- 0.94, N = 3 SE +/- 0.89, N = 3 SE +/- 0.77, N = 3 SE +/- 0.32, N = 3 SE +/- 0.28, N = 3 SE +/- 0.57, N = 3 SE +/- 0.54, N = 3 SE +/- 5.88, N = 3 SE +/- 0.43, N = 3 1293.17 1291.16 1295.39 1091.93 1285.93 1289.82 1292.16 1291.80 1290.87 1290.34 1292.85 1246.17 1287.10 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -O3
HPC Challenge Test / Class: G-HPL OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: G-HPL Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.83 16.82 16.88 16.82 16.86 16.83 16.90 16.89 14.77 16.85 16.92 14.84 16.40 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Ffte OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: G-Ffte Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.3265 0.653 0.9795 1.306 1.6325 SE +/- 0.00916, N = 3 SE +/- 0.00161, N = 3 SE +/- 0.00694, N = 3 SE +/- 0.00292, N = 3 SE +/- 0.00370, N = 3 SE +/- 0.00891, N = 3 SE +/- 0.00532, N = 3 SE +/- 0.00233, N = 3 SE +/- 0.00691, N = 3 SE +/- 0.00448, N = 3 SE +/- 0.00671, N = 3 SE +/- 0.03349, N = 3 SE +/- 0.00501, N = 3 1.40943 1.39361 1.39475 1.35914 1.41432 1.41559 1.43874 1.41145 1.41259 1.41601 1.40779 1.44437 1.45107 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: EP-DGEMM OpenBenchmarking.org GFLOPS, More Is Better HPC Challenge 1.4.3 Test / Class: EP-DGEMM Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 1.0303 2.0606 3.0909 4.1212 5.1515 SE +/- 0.00050, N = 3 SE +/- 0.00091, N = 3 SE +/- 0.00429, N = 3 SE +/- 0.00430, N = 3 SE +/- 0.00140, N = 3 SE +/- 0.00198, N = 3 SE +/- 0.00284, N = 3 SE +/- 0.00085, N = 3 SE +/- 0.00108, N = 3 SE +/- 0.00056, N = 3 SE +/- 0.00151, N = 3 SE +/- 0.00588, N = 3 SE +/- 0.00462, N = 3 4.57247 4.57203 4.57484 4.55708 4.57413 4.57506 4.57913 4.57446 4.09877 4.56999 4.57681 4.18174 4.56809 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
Open Porous Media OPM Benchmark: Upscale-Relperm OpenBenchmarking.org Seconds, Fewer Is Better Open Porous Media 2013-11-26 OPM Benchmark: Upscale-Relperm Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 30 60 90 120 150 SE +/- 2.19, N = 3 SE +/- 0.48, N = 3 SE +/- 0.38, N = 3 SE +/- 1.00, N = 3 SE +/- 0.51, N = 3 SE +/- 0.47, N = 3 SE +/- 0.55, N = 3 SE +/- 0.93, N = 3 SE +/- 0.74, N = 3 SE +/- 0.95, N = 3 SE +/- 1.14, N = 3 130.77 134.59 133.72 133.09 132.66 132.51 131.66 132.95 134.29 133.12 132.63 1. (F9X) gfortran options: -rdynamic
HPC Challenge Test / Class: G-Ptrans OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: G-Ptrans Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.0899 0.1798 0.2697 0.3596 0.4495 SE +/- 0.00207, N = 3 SE +/- 0.00217, N = 3 SE +/- 0.00115, N = 3 SE +/- 0.01615, N = 3 SE +/- 0.00019, N = 3 SE +/- 0.00354, N = 3 SE +/- 0.00232, N = 3 SE +/- 0.00314, N = 3 SE +/- 0.00363, N = 3 SE +/- 0.00108, N = 3 SE +/- 0.00086, N = 3 SE +/- 0.00818, N = 3 SE +/- 0.00153, N = 3 0.36755 0.36669 0.36681 0.39936 0.37226 0.36738 0.37476 0.36835 0.36655 0.37046 0.37024 0.36120 0.36189 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: EP-STREAM Triad OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: EP-STREAM Triad Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.8118 1.6236 2.4354 3.2472 4.059 SE +/- 0.06195, N = 3 SE +/- 0.00604, N = 3 SE +/- 0.06504, N = 3 SE +/- 0.73548, N = 3 SE +/- 0.07601, N = 3 SE +/- 0.04706, N = 3 SE +/- 0.00617, N = 3 SE +/- 0.19836, N = 3 SE +/- 0.03006, N = 3 SE +/- 0.00276, N = 3 SE +/- 0.01084, N = 3 SE +/- 0.15886, N = 3 SE +/- 0.05819, N = 3 1.87469 1.83853 1.96953 3.14201 1.91326 1.82648 1.85094 2.01190 1.80922 1.77692 1.80114 3.60799 1.88799 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: G-Random Access OpenBenchmarking.org GUP/s, More Is Better HPC Challenge 1.4.3 Test / Class: G-Random Access Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.0057 0.0114 0.0171 0.0228 0.0285 SE +/- 0.00270, N = 3 SE +/- 0.00004, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00072, N = 3 SE +/- 0.00007, N = 3 SE +/- 0.00011, N = 3 SE +/- 0.00009, N = 3 SE +/- 0.00001, N = 3 SE +/- 0.00008, N = 3 SE +/- 0.00034, N = 3 SE +/- 0.00223, N = 3 SE +/- 0.00003, N = 3 SE +/- 0.00005, N = 3 0.01715 0.02006 0.02010 0.02521 0.02019 0.02003 0.02035 0.02044 0.02006 0.01985 0.01781 0.00643 0.00825 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Random Ring Latency OpenBenchmarking.org usecs, Fewer Is Better HPC Challenge 1.4.3 Test / Class: Random Ring Latency Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.2254 0.4508 0.6762 0.9016 1.127 SE +/- 0.00655, N = 3 SE +/- 0.01850, N = 3 SE +/- 0.00238, N = 3 SE +/- 0.00796, N = 3 SE +/- 0.00578, N = 3 SE +/- 0.00156, N = 3 SE +/- 0.01092, N = 3 SE +/- 0.00454, N = 3 SE +/- 0.01141, N = 3 SE +/- 0.01167, N = 3 SE +/- 0.00937, N = 3 SE +/- 0.53971, N = 3 SE +/- 0.01253, N = 3 0.57061 0.57507 0.55178 0.55938 0.55916 0.55286 0.56350 0.55530 0.61911 0.57234 0.55730 1.00173 0.47972 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Random Ring Bandwidth OpenBenchmarking.org GB/s, More Is Better HPC Challenge 1.4.3 Test / Class: Random Ring Bandwidth Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 0.1823 0.3646 0.5469 0.7292 0.9115 SE +/- 0.00092, N = 3 SE +/- 0.00090, N = 3 SE +/- 0.00067, N = 3 SE +/- 0.00176, N = 3 SE +/- 0.00205, N = 3 SE +/- 0.00121, N = 3 SE +/- 0.00282, N = 3 SE +/- 0.00057, N = 3 SE +/- 0.00143, N = 3 SE +/- 0.00149, N = 3 SE +/- 0.00150, N = 3 SE +/- 0.00803, N = 3 SE +/- 0.00141, N = 3 0.76495 0.76371 0.76887 0.76856 0.76677 0.76847 0.78239 0.76691 0.76805 0.76348 0.76400 0.78758 0.81029 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
HPC Challenge Test / Class: Max Ping Pong Bandwidth OpenBenchmarking.org MB/s, More Is Better HPC Challenge 1.4.3 Test / Class: Max Ping Pong Bandwidth Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 1000 2000 3000 4000 5000 SE +/- 6.09, N = 3 SE +/- 9.73, N = 3 SE +/- 25.42, N = 3 SE +/- 1.70, N = 3 SE +/- 21.59, N = 3 SE +/- 9.95, N = 3 SE +/- 16.27, N = 3 SE +/- 68.19, N = 3 SE +/- 13.39, N = 3 SE +/- 42.87, N = 3 SE +/- 16.89, N = 3 SE +/- 72.74, N = 3 SE +/- 13.12, N = 3 4606.19 4610.01 4635.30 4622.67 4756.54 4676.84 4744.80 4675.72 4555.80 4623.47 4617.71 4347.15 4449.47 -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil -lopen-rte -lopen-pal -ldl -lnsl -lutil 1. (CC) gcc options: -lblas -lm -pthread -lmpi -fomit-frame-pointer -O3 -march=native -funroll-loops 2. Linux 3.10: BLAS + Open MPI 1.4.5 3. Linux 3.11: BLAS + Open MPI 1.4.5 4. Linux 3.12: BLAS + Open MPI 1.4.5 5. Linux 3.13: BLAS + Open MPI 1.4.5 6. Linux 3.3: BLAS + Open MPI 1.4.5 7. Linux 3.4: BLAS + Open MPI 1.4.5 8. Linux 3.5: BLAS + Open MPI 1.4.5 9. Linux 3.6: BLAS + Open MPI 1.4.5 10. Linux 3.7: BLAS + Open MPI 1.4.5 11. Linux 3.8: BLAS + Open MPI 1.4.5 12. Linux 3.9: BLAS + Open MPI 1.4.5 13. Ubuntu 16.10 Linux 4.8: BLAS + Open MPI 1.10.3 14. Ubuntu 16.10 Linux 4.9: BLAS + Open MPI 1.10.3
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 900 1800 2700 3600 4500 SE +/- 0.00, N = 3 SE +/- 2.33, N = 3 SE +/- 6.33, N = 3 SE +/- 2.67, N = 3 SE +/- 3.67, N = 3 SE +/- 9.70, N = 3 SE +/- 3.67, N = 3 SE +/- 4.00, N = 3 SE +/- 11.00, N = 3 SE +/- 3.67, N = 3 SE +/- 0.00, N = 3 SE +/- 36.84, N = 3 SE +/- 0.00, N = 3 1428 1386 1530 1409 1637 1648 1637 1685 1644 1619 1524 2788 4032 1. (CC) gcc options: -O3
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.46, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.17, N = 3 SE +/- 0.13, N = 3 69.77 69.78 69.73 69.81 70.22 69.99 70.30 69.79 70.82 69.73 69.75 75.20 70.21 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -lm -lpthread -O3
Unigine Sanctuary Resolution: 1024 x 768 OpenBenchmarking.org Frames Per Second, More Is Better Unigine Sanctuary 2.3 Resolution: 1024 x 768 Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 6 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.79 2.73 2.75 2.75 2.74 2.69 2.65 2.75 15.51 15.62
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.7 Static Web Page Serving Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 4K 8K 12K 16K 20K SE +/- 32.48, N = 3 SE +/- 50.19, N = 3 SE +/- 8.86, N = 3 SE +/- 33.27, N = 3 SE +/- 48.41, N = 3 SE +/- 52.67, N = 3 SE +/- 112.16, N = 3 SE +/- 210.98, N = 3 SE +/- 83.24, N = 3 SE +/- 104.70, N = 3 SE +/- 215.05, N = 3 SE +/- 71.94, N = 3 SE +/- 90.07, N = 3 16039.66 16293.98 18751.24 15877.41 19372.45 19829.62 19867.65 18676.07 18039.02 17907.21 17489.16 16386.47 18568.72 -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O3 -march=native -O2 -O2 1. (CC) gcc options: -shared -fPIC -pthread
PolyBench-C Test: 3 Matrix Multiplications OpenBenchmarking.org Seconds, Fewer Is Better PolyBench-C 3.2 Test: 3 Matrix Multiplications Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.3 Linux 3.4 Linux 3.5 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 8 16 24 32 40 SE +/- 0.13, N = 3 SE +/- 0.10, N = 3 SE +/- 0.48, N = 4 SE +/- 0.10, N = 3 SE +/- 0.47, N = 3 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 SE +/- 0.21, N = 3 SE +/- 0.09, N = 3 SE +/- 0.26, N = 3 SE +/- 0.02, N = 3 33.65 33.02 31.62 30.05 33.35 32.99 32.36 33.33 33.06 32.83 32.84 30.56 29.80 -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native -march=native 1. (CC) gcc options: -O3
OpenArena Resolution: 1600 x 900 - Total Frame Time OpenBenchmarking.org Milliseconds, Fewer Is Better OpenArena 0.8.8 Resolution: 1600 x 900 - Total Frame Time Linux 3.10 Linux 3.11 Linux 3.12 Linux 3.13 Linux 3.6 Linux 3.7 Linux 3.8 Linux 3.9 15 30 45 60 75 Min: 6 / Avg: 36.46 / Max: 77 Min: 6 / Avg: 36.47 / Max: 78 Min: 5 / Avg: 36.39 / Max: 78 Min: 6 / Avg: 36.47 / Max: 77 Min: 6 / Avg: 36.48 / Max: 78 Min: 6 / Avg: 36.44 / Max: 77 Min: 6 / Avg: 36.49 / Max: 77 Min: 5 / Avg: 36.28 / Max: 78
OpenArena Resolution: 1600 x 900 - Total Frame Time OpenBenchmarking.org Milliseconds, Fewer Is Better OpenArena 0.8.8 Resolution: 1600 x 900 - Total Frame Time Ubuntu 16.10 Linux 4.8 Ubuntu 16.10 Linux 4.9 16 32 48 64 80 Min: 6 / Avg: 37.5 / Max: 87 Min: 6 / Avg: 36.76 / Max: 84
Phoronix Test Suite v10.8.5