Debian 7.11 vs. 8.8 vs. 9.0 Benchmarks

Tests for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1706220-TR-DEBIAN47963.

Debian 7.11 vs. 8.8 vs. 9.0 BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionDebian 7.11Debian 8.8Debian 9.0Intel Core i5-2500K @ 3.30GHz (4 Cores)SAPPHIRE Pure Black P67 HydraIntel 2nd Generation Core Family DRAM3072MB120GB SanDisk SDSSDA12ASUS AMD Radeon HD 4890 1024MBRealtek ALC892DELL S2409WMarvell 88E8057 PCI-E GigabitDebian 7.113.2.0-4-amd64 (x86_64)GNOME Shell 3.4.2X Server 1.12.4radeon 6.14.992.1 Mesa 8.0.5 Gallium 0.4GCC 4.7.2ext41920x1080Intel Core i5-2500K @ 3.70GHz (4 Cores)Intel 6 /C200Debian 8.83.16.0-4-amd64 (x86_64)GNOME Shell 3.14.4X Server 1.16.4radeon 7.5.03.3 Mesa 10.3.2 Gallium 0.4GCC 4.9.2Realtek ALC892Debian 9.04.9.0-3-amd64 (x86_64)GNOME Shell 3.22.3modesetting 1.19.23.3 Mesa 13.0.6 Gallium 0.4 (LLVM 3.9.1)GCC 6.3.0 20170516OpenBenchmarking.orgEnvironment Details- GJS_DEBUG_TOPICS=JS ERROR;JS LOG GJS_DEBUG_OUTPUT=stderrCompiler Details- Debian 7.11: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v - Debian 8.8: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Debian 9.0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v Disk Details- Debian 7.11: CFQ / barrier=1,data=ordered,errors=remount-ro,relatime,rw,user_xattr- Debian 8.8: CFQ / data=ordered,errors=remount-ro,relatime,rw- Debian 9.0: CFQ / data=ordered,errors=remount-ro,relatime,rwProcessor Details- Debian 7.11: Scaling Governor: acpi-cpufreq ondemand- Debian 8.8: Scaling Governor: intel_pstate powersave- Debian 9.0: Scaling Governor: intel_pstate powersaveGraphics Details- Debian 7.11, Debian 8.8: EXASystem Details- Debian 7.11: Python 2.7.3.- Debian 8.8: Python 2.7.9.- Debian 9.0: Python 2.7.13.

Debian 7.11 vs. 8.8 vs. 9.0 Benchmarkssqlite: Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadscompilebench: Compilecompilebench: Initial Createetlegacy: Renderer2 - 1920 x 1080openarena: 1920 x 1080tesseract: 1920 x 1080xonotic: 1920 x 1080 - Lowxonotic: 1920 x 1080 - Highxonotic: 1920 x 1080 - Ultraglmark2: 1920 x 1080gputest: Triangle - 1920 x 1080 - Fullscreenclomp: Static OMP Speeduphmmer: Pfam Database Searchscimark2: Compositejohn-the-ripper: Blowfishttsiod-renderer: Phong Rendering With Soft-Shadow Mappinggraphics-magick: Resizinghimeno: Poisson Pressure Solverbuild-apache: Time To Compilebuild-linux-kernel: Time To Compilec-ray: Total Timecompress-pbzip2: 256MB File Compressionopenssl: RSA 4096-bit Performancetjbench: Decompression Throughputpgbench: Mostly RAM - Normal Load - Read Writepgbench: Mostly RAM - Heavy Contention - Read Writeredis: GETredis: SETDebian 7.11Debian 8.8Debian 9.046.86155.23294.03407.62272.5341.273.0414.561100.283233102.991271551.8139.63190.7839.9014.61424.20119.383116.865753.982098259.461517295.2938.59155.77290.97430.48292.4753.0360.2037.4761.3360.1353.5829636123.0414.331126.203182126.691581573.4840.03202.3135.2914.08421.43121.713995.256130.991988595.621446828.6338.25162.53301.17428.62282.6756.9360.2040.6760.1860.0455.3333436853.0314.211120.273192128.751601580.8717.12224.9335.6014.15422.20124.603923.135824.451995022.041463535.75OpenBenchmarking.org

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryDebian 7.11Debian 8.8Debian 9.01122334455SE +/- 0.07, N = 3SE +/- 0.25, N = 3SE +/- 0.10, N = 346.8638.5938.251. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeDebian 7.11Debian 8.8Debian 9.04080120160200SE +/- 0.30, N = 3SE +/- 1.49, N = 3SE +/- 0.66, N = 3155.23155.77162.531. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsDebian 7.11Debian 8.8Debian 9.070140210280350SE +/- 0.62, N = 3SE +/- 3.94, N = 3SE +/- 0.62, N = 3294.03290.97301.171. (CC) gcc options: -static

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileDebian 7.11Debian 8.8Debian 9.090180270360450SE +/- 2.23, N = 3SE +/- 2.66, N = 3SE +/- 3.66, N = 3407.62430.48428.62

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateDebian 7.11Debian 8.8Debian 9.060120180240300SE +/- 7.30, N = 3SE +/- 2.86, N = 3SE +/- 10.27, N = 3272.53292.47282.67

ET: Legacy

Renderer: Renderer2 - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is BetterET: Legacy 2.75Renderer: Renderer2 - Resolution: 1920 x 1080Debian 8.8Debian 9.01326395265SE +/- 0.38, N = 3SE +/- 0.18, N = 353.0356.93

OpenArena

Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is BetterOpenArena 0.8.8Resolution: 1920 x 1080Debian 7.11Debian 8.8Debian 9.01326395265SE +/- 0.07, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 341.2760.2060.20MIN: 5MIN: 10MIN: 11

OpenArena

Resolution: 1920 x 1080 - Total Frame Time

OpenBenchmarking.orgMilliseconds, Fewer Is BetterOpenArena 0.8.8Resolution: 1920 x 1080 - Total Frame TimeDebian 7.11Debian 8.8Debian 9.0816243240Min: 2 / Avg: 24.13 / Max: 37Min: 3 / Avg: 16.59 / Max: 31Min: 2 / Avg: 16.59 / Max: 24

Tesseract

Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is BetterTesseract 2014-05-12Resolution: 1920 x 1080Debian 8.8Debian 9.0918273645SE +/- 0.04, N = 3SE +/- 0.06, N = 337.4740.67

Xonotic

Resolution: 1920 x 1080 - Effects Quality: Low

OpenBenchmarking.orgFrames Per Second, More Is BetterXonotic 0.8.2Resolution: 1920 x 1080 - Effects Quality: LowDebian 8.8Debian 9.01428425670SE +/- 0.03, N = 3SE +/- 0.00, N = 361.3360.18MIN: 60 / MAX: 329MIN: 58 / MAX: 61

Xonotic

Resolution: 1920 x 1080 - Effects Quality: High

OpenBenchmarking.orgFrames Per Second, More Is BetterXonotic 0.8.2Resolution: 1920 x 1080 - Effects Quality: HighDebian 8.8Debian 9.01326395265SE +/- 0.04, N = 3SE +/- 0.02, N = 360.1360.04MIN: 46 / MAX: 187MIN: 53 / MAX: 62

Xonotic

Resolution: 1920 x 1080 - Effects Quality: Ultra

OpenBenchmarking.orgFrames Per Second, More Is BetterXonotic 0.8.2Resolution: 1920 x 1080 - Effects Quality: UltraDebian 8.8Debian 9.01224364860SE +/- 0.07, N = 3SE +/- 0.08, N = 353.5855.33MIN: 30 / MAX: 112MIN: 30 / MAX: 62

GLmark2

Resolution: 1920 x 1080

OpenBenchmarking.orgScore, More Is BetterGLmark2 276Resolution: 1920 x 1080Debian 8.8Debian 9.070140210280350296334

GpuTest

Test: Triangle - Resolution: 1920 x 1080 - Mode: Fullscreen

OpenBenchmarking.orgPoints, More Is BetterGpuTest 0.7.0Test: Triangle - Resolution: 1920 x 1080 - Mode: FullscreenDebian 8.8Debian 9.08001600240032004000SE +/- 15.28, N = 336123685

CLOMP

Static OMP Speedup

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 3.3Static OMP SpeedupDebian 7.11Debian 8.8Debian 9.00.6841.3682.0522.7363.42SE +/- 0.01, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 53.043.043.031. (CC) gcc options: --openmp -O3 -lm

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 2.3.2Pfam Database SearchDebian 7.11Debian 8.8Debian 9.048121620SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 314.5614.3314.211. (CC) gcc options: -O2 -pthread -lhmmer -lsquid -lm

SciMark

Computational Test: Composite

OpenBenchmarking.orgMflops, More Is BetterSciMark 2.0Computational Test: CompositeDebian 7.11Debian 8.8Debian 9.02004006008001000SE +/- 0.74, N = 4SE +/- 0.71, N = 4SE +/- 1.17, N = 41100.281126.201120.271. (CC) gcc options: -lm

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishDebian 7.11Debian 8.8Debian 9.07001400210028003500SE +/- 2.00, N = 33233318231921. (CC) gcc options: -fopenmp -lcrypt

TTSIOD 3D Renderer

Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3aPhong Rendering With Soft-Shadow MappingDebian 7.11Debian 8.8Debian 9.0306090120150SE +/- 0.16, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3102.99126.69128.751. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.19Operation: ResizingDebian 7.11Debian 8.8Debian 9.04080120160200SE +/- 0.33, N = 3127158160-std=gnu99-std=gnu99 -llzma-ltiff -llzma1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lgomp -lpthread

Himeno Benchmark

Poisson Pressure Solver

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverDebian 7.11Debian 8.8Debian 9.030060090012001500SE +/- 6.94, N = 3SE +/- 1.19, N = 3SE +/- 0.89, N = 31551.811573.481580.871. (CC) gcc options: -O3

Timed Apache Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.7Time To CompileDebian 7.11Debian 8.8Debian 9.0918273645SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 339.6340.0317.12

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.9Time To CompileDebian 7.11Debian 8.8Debian 9.050100150200250SE +/- 0.98, N = 3SE +/- 1.34, N = 3SE +/- 1.20, N = 3190.78202.31224.93

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeDebian 7.11Debian 8.8Debian 9.0918273645SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 339.9035.2935.601. (CC) gcc options: -lm -lpthread -O3

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.12256MB File CompressionDebian 7.11Debian 8.8Debian 9.048121620SE +/- 0.28, N = 6SE +/- 0.28, N = 6SE +/- 0.27, N = 614.6114.0814.151. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1gRSA 4096-bit PerformanceDebian 7.11Debian 8.8Debian 9.090180270360450SE +/- 0.12, N = 3SE +/- 1.28, N = 3SE +/- 0.00, N = 3424.20421.43422.201. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

libjpeg-turbo tjbench

Test: Decompression Throughput

OpenBenchmarking.orgMegapixels/sec, More Is Betterlibjpeg-turbo tjbench 1.5.1Test: Decompression ThroughputDebian 7.11Debian 8.8Debian 9.0306090120150SE +/- 0.35, N = 3SE +/- 0.35, N = 3SE +/- 0.66, N = 3119.38121.71124.601. (CC) gcc options: -O3 -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.6.3Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteDebian 7.11Debian 8.8Debian 9.09001800270036004500SE +/- 47.64, N = 5SE +/- 61.77, N = 6SE +/- 57.93, N = 53116.863995.253923.131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -fpic -lpgcommon -lpgport -lrt -lcrypt -ldl -lm

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Heavy Contention - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.6.3Scaling: Mostly RAM - Test: Heavy Contention - Mode: Read WriteDebian 7.11Debian 8.8Debian 9.013002600390052006500SE +/- 46.49, N = 3SE +/- 3.28, N = 3SE +/- 19.00, N = 35753.986130.995824.451. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -fpic -lpgcommon -lpgport -lrt -lcrypt -ldl -lm

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: GETDebian 7.11Debian 8.8Debian 9.0400K800K1200K1600K2000KSE +/- 19316.03, N = 3SE +/- 22829.90, N = 3SE +/- 18466.87, N = 32098259.461988595.621995022.041. (CC) gcc options: -ggdb -rdynamic -lm -pthread -ldl -std=gnu99 -pipe -g3 -O3 -funroll-loops

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: SETDebian 7.11Debian 8.8Debian 9.0300K600K900K1200K1500KSE +/- 21611.25, N = 3SE +/- 21428.10, N = 5SE +/- 24576.99, N = 31517295.291446828.631463535.751. (CC) gcc options: -ggdb -rdynamic -lm -pthread -ldl -std=gnu99 -pipe -g3 -O3 -funroll-loops

Phoronix Test Suite v10.8.4