openSUSE Tumbleweed before/after GCC 12 upgrade. Benchmarks by Michael Larabel for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2205149-NE-TUMBLEWEE25 openSUSE Tumbleweed GCC12 Benchmarks - Phoronix Test Suite openSUSE Tumbleweed GCC12 Benchmarks openSUSE Tumbleweed before/after GCC 12 upgrade. Benchmarks by Michael Larabel for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2205149-NE-TUMBLEWEE25&sor&grw .
openSUSE Tumbleweed GCC12 Benchmarks Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Compiler File-System Screen Resolution Tumbleweed 20220507 Tumbleweed 20220510 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads) Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) Intel Device 0998 512GB 800GB INTEL SSDPF21Q800GB ASPEED VE228 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP openSUSE Tumbleweed 20220507 5.17.4-1-default (x86_64) GCC 11.2.1 20220420 [revision 691af15031e00227ba6d5935c1d737026cda4129] btrfs 1920x1080 openSUSE 20220510 5.17.5-1-default (x86_64) GCC 12.1.0 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - Tumbleweed 20220507: --build=x86_64-suse-linux --disable-libcc1 --disable-libssp --disable-libstdcxx-pch --disable-libvtv --disable-werror --enable-cet=auto --enable-checking=release --enable-gnu-indirect-function --enable-host-shared --enable-languages=c,c++,objc,fortran,obj-c++,ada,go,d,jit --enable-libphobos --enable-libstdcxx-allocator=new --enable-link-mutex --enable-linux-futex --enable-multilib --enable-offload-targets=nvptx-none,amdgcn-amdhsa, --enable-plugin --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=x86-64 --with-build-config=bootstrap-lto-lean --with-gcc-major-version-only --with-slibdir=/lib64 --with-tune=generic --without-cuda-driver --without-system-libunwind - Tumbleweed 20220510: --build=x86_64-suse-linux --disable-libcc1 --disable-libssp --disable-libstdcxx-pch --disable-libvtv --disable-werror --enable-cet=auto --enable-checking=release --enable-gnu-indirect-function --enable-host-shared --enable-languages=c,c++,objc,fortran,obj-c++,ada,go,d,jit --enable-libphobos --enable-libstdcxx-allocator=new --enable-link-mutex --enable-linux-futex --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none,amdgcn-amdhsa, --enable-plugin --enable-ssp --enable-version-specific-runtime-libs --host=x86_64-suse-linux --mandir=/usr/share/man --with-arch-32=x86-64 --with-build-config=bootstrap-lto-lean --with-gcc-major-version-only --with-slibdir=/lib64 --with-tune=generic --without-cuda-driver --without-system-libunwind Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd000331 Java Details - Tumbleweed 20220507: OpenJDK Runtime Environment (IcedTea 3.22.0) (build 1.8.0_322-b06 suse-2.1-x86_64) - Tumbleweed 20220510: OpenJDK Runtime Environment (IcedTea 3.22.0) (build 1.8.0_322-b06 suse-2.2-x86_64) Python Details - Python 3.8.13 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Not affected
openSUSE Tumbleweed GCC12 Benchmarks stress-ng: MMAP stress-ng: Crypto stress-ng: Malloc stress-ng: Forking stress-ng: SENDFILE stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Vector Math stress-ng: Memory Copying stress-ng: Context Switching stress-ng: Glibc Qsort Data Sorting stress-ng: System V Message Passing dacapobench: H2 renaissance: Rand Forest renaissance: ALS Movie Lens renaissance: Apache Spark ALS renaissance: Apache Spark Bayes renaissance: Apache Spark PageRank compress-zstd: 3, Long Mode - Compression Speed renaissance: Finagle HTTP Requests compress-zstd: 3 - Decompression Speed compress-zstd: 19 - Compression Speed compress-zstd: 3 - Compression Speed renaissance: In-Memory Database Shootout renaissance: Akka Unbalanced Cobwebbed Tree compress-zstd: 19 - Decompression Speed compress-zstd: 19, Long Mode - Compression Speed renaissance: Genetic Algorithm Using Jenetics + Futures astcenc: Medium astcenc: Thorough astcenc: Exhaustive numpy: onnx: GPT-2 - CPU - Standard onnx: yolov4 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Standard onnx: super-resolution-10 - CPU - Standard gromacs: MPI CPU - water_GMX50_bare compress-zstd: 19, Long Mode - Decompression Speed lammps: 20k Atoms compress-zstd: 8, Long Mode - Decompression Speed compress-zstd: 8, Long Mode - Compression Speed compress-zstd: 3, Long Mode - Decompression Speed lammps: Rhodopsin Protein onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Recurrent Neural Network Training - u8s8f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU pennant: sedovbig amg: incompact3d: X3D-benchmarking input.i3d incompact3d: input.i3d 193 Cells Per Direction wireguard: stockfish: Total Time compress-zstd: 3 - Compression Speed compress-zstd: 19 - Compression Speed compress-zstd: 19 - Decompression Speed compress-zstd: 3, Long Mode - Compression Speed compress-zstd: 3, Long Mode - Decompression Speed compress-zstd: 8, Long Mode - Compression Speed compress-zstd: 19, Long Mode - Compression Speed compress-zstd: 19, Long Mode - Decompression Speed tachyon: Total Time svt-vp9: VMAF Optimized - Bosphorus 1080p svt-vp9: PSNR/SSIM Optimized - Bosphorus 1080p svt-vp9: Visual Quality Optimized - Bosphorus 1080p svt-av1: Preset 10 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-hevc: 1 - Bosphorus 1080p svt-hevc: 7 - Bosphorus 1080p svt-hevc: 10 - Bosphorus 1080p avifenc: 0 avifenc: 2 avifenc: 6 avifenc: 6, Lossless avifenc: 10, Lossless pyperformance: go pyperformance: 2to3 pyperformance: chaos pyperformance: float pyperformance: nbody pyperformance: pathlib pyperformance: json_loads pyperformance: crypto_pyaes pyperformance: regex_compile pyperformance: python_startup pyperformance: django_template pyperformance: pickle_pure_python liquid-dsp: 128 - 256 - 57 liquid-dsp: 160 - 256 - 57 nginx: 100 nginx: 200 nginx: 500 nginx: 1000 apache: 200 apache: 500 apache: 1000 phpbench: PHP Benchmark Suite pybench: Total For Average Test Times Tumbleweed 20220507 Tumbleweed 20220510 4664.62 85026.09 311705065.96 86555.94 1308526.97 136088.24 12219151.39 307118.55 324345.37 13248.44 20744069.17 934.51 6948990.47 13062 1503.2 18753.2 2978.4 1130.7 3586.2 278.6 5779.2 3062.5 84.3 6695.2 21253.2 34923.6 2576.2 43.1 6895.9 5.5042 7.0018 8.9358 392.96 9395 622 1820 12429 9.052 2674.2 34.102 3248.6 314.3 3251.9 24.607 678.302 430.983 688.678 431.517 705.397 424.347 15.70179 2159126667 294.412639 11.4217421 580.279 184534600 6426.1 85.8 2659.8 294.9 3232.9 323.6 47.7 2742.1 23.6253 221.22 214.71 175.65 80.048 92.525 29.83 174.38 264.92 85.511 47.816 5.878 9.789 7.097 328 558 208 205 219 31.1 37.5 194 295 26.5 85.7 790 1410166667 1458400000 79426.07 197968.99 208849.70 214270.04 197075.88 206530.83 213476.35 655272 1206 4758.63 88400.87 322581943.46 86425.70 1228020.63 139265.42 12156959.44 330917.14 308630.64 13258.18 20458137.33 937.17 6134754.47 13335 1507.3 18758.7 2964.9 1183.5 3455.4 292.3 5708.6 3000.5 85.4 6645.9 19686.6 34659.4 2515.7 42.1 7069.7 5.1969 7.1589 8.6924 386.05 9620 634 2132 12510 9.121 2626.5 35.255 3196.6 318.7 3215.4 25.850 676.385 435.588 658.221 436.172 695.647 437.885 15.56548 2158861667 293.188894 11.3398183 575.210 182150796 6509.6 88.1 2650.9 301.7 3226.6 337.8 46.8 2755.5 24.1966 217.89 213.09 178.91 80.182 91.807 30.09 175.95 266.83 85.034 47.938 6.060 10.070 7.315 313 525 180 187 189 28.6 36.9 170 272 25.5 76.5 691 1595800000 1715666667 79403.07 196528.56 206578.82 211423.33 194927.31 205683.86 210703.41 650951 1110 OpenBenchmarking.org
Stress-NG Test: MMAP OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: MMAP Tumbleweed 20220510 Tumbleweed 20220507 1000 2000 3000 4000 5000 SE +/- 39.04, N = 3 SE +/- 35.45, N = 3 4758.63 4664.62 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Crypto Tumbleweed 20220510 Tumbleweed 20220507 20K 40K 60K 80K 100K SE +/- 348.57, N = 3 SE +/- 631.01, N = 3 88400.87 85026.09 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Malloc Tumbleweed 20220510 Tumbleweed 20220507 70M 140M 210M 280M 350M SE +/- 630952.97, N = 3 SE +/- 999889.80, N = 3 322581943.46 311705065.96 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Forking Tumbleweed 20220507 Tumbleweed 20220510 20K 40K 60K 80K 100K SE +/- 1050.04, N = 3 SE +/- 781.93, N = 3 86555.94 86425.70 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: SENDFILE Tumbleweed 20220507 Tumbleweed 20220510 300K 600K 900K 1200K 1500K SE +/- 4804.43, N = 3 SE +/- 7676.13, N = 3 1308526.97 1228020.63 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: CPU Stress OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: CPU Stress Tumbleweed 20220510 Tumbleweed 20220507 30K 60K 90K 120K 150K SE +/- 404.23, N = 3 SE +/- 474.84, N = 3 139265.42 136088.24 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Semaphores Tumbleweed 20220507 Tumbleweed 20220510 3M 6M 9M 12M 15M SE +/- 6493.81, N = 3 SE +/- 9586.79, N = 3 12219151.39 12156959.44 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Matrix Math Tumbleweed 20220510 Tumbleweed 20220507 70K 140K 210K 280K 350K SE +/- 500.14, N = 3 SE +/- 211.97, N = 3 330917.14 307118.55 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Vector Math Tumbleweed 20220507 Tumbleweed 20220510 70K 140K 210K 280K 350K SE +/- 1007.62, N = 3 SE +/- 969.86, N = 3 324345.37 308630.64 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Memory Copying Tumbleweed 20220510 Tumbleweed 20220507 3K 6K 9K 12K 15K SE +/- 13.12, N = 3 SE +/- 7.33, N = 3 13258.18 13248.44 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Context Switching Tumbleweed 20220507 Tumbleweed 20220510 4M 8M 12M 16M 20M SE +/- 211441.81, N = 3 SE +/- 80641.32, N = 3 20744069.17 20458137.33 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Glibc Qsort Data Sorting OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: Glibc Qsort Data Sorting Tumbleweed 20220510 Tumbleweed 20220507 200 400 600 800 1000 SE +/- 3.85, N = 3 SE +/- 3.17, N = 3 937.17 934.51 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14 Test: System V Message Passing Tumbleweed 20220507 Tumbleweed 20220510 1.5M 3M 4.5M 6M 7.5M SE +/- 84690.67, N = 4 SE +/- 83162.42, N = 3 6948990.47 6134754.47 1. (CC) gcc options: -O2 -std=gnu99 -lm -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
DaCapo Benchmark Java Test: H2 OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 9.12-MR1 Java Test: H2 Tumbleweed 20220507 Tumbleweed 20220510 3K 6K 9K 12K 15K SE +/- 153.28, N = 4 SE +/- 128.87, N = 4 13062 13335
Renaissance Test: Random Forest OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Random Forest Tumbleweed 20220507 Tumbleweed 20220510 300 600 900 1200 1500 SE +/- 16.29, N = 3 SE +/- 15.97, N = 3 1503.2 1507.3 MIN: 1329.44 / MAX: 1908.05 MIN: 1376.07 / MAX: 2006.76
Renaissance Test: ALS Movie Lens OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: ALS Movie Lens Tumbleweed 20220507 Tumbleweed 20220510 4K 8K 12K 16K 20K SE +/- 181.53, N = 3 SE +/- 117.66, N = 3 18753.2 18758.7 MIN: 18390.55 / MAX: 21033.08 MIN: 18497.37 / MAX: 21352.15
Renaissance Test: Apache Spark ALS OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Apache Spark ALS Tumbleweed 20220510 Tumbleweed 20220507 600 1200 1800 2400 3000 SE +/- 4.56, N = 3 SE +/- 23.76, N = 3 2964.9 2978.4 MIN: 2728.19 / MAX: 3331.71 MIN: 2688.22 / MAX: 3561.27
Renaissance Test: Apache Spark Bayes OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Apache Spark Bayes Tumbleweed 20220507 Tumbleweed 20220510 300 600 900 1200 1500 SE +/- 26.13, N = 12 SE +/- 16.54, N = 15 1130.7 1183.5 MIN: 602.03 / MAX: 1997.71 MIN: 618.02 / MAX: 1647.68
Renaissance Test: Apache Spark PageRank OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Apache Spark PageRank Tumbleweed 20220510 Tumbleweed 20220507 800 1600 2400 3200 4000 SE +/- 29.12, N = 3 SE +/- 43.42, N = 3 3455.4 3586.2 MIN: 3005.61 / MAX: 4731.78 MIN: 3041.24 / MAX: 4391.89
Zstd Compression Compression Level: 3, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 3, Long Mode - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 60 120 180 240 300 SE +/- 3.53, N = 4 SE +/- 1.27, N = 3 292.3 278.6 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Renaissance Test: Finagle HTTP Requests OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Finagle HTTP Requests Tumbleweed 20220510 Tumbleweed 20220507 1200 2400 3600 4800 6000 SE +/- 149.97, N = 15 SE +/- 179.26, N = 15 5708.6 5779.2 MIN: 3401.45 / MAX: 8925.31 MIN: 3643.61 / MAX: 8878.75
Zstd Compression Compression Level: 3 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 3 - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 700 1400 2100 2800 3500 SE +/- 2.28, N = 3 SE +/- 1.91, N = 3 3062.5 3000.5 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 19 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19 - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 20 40 60 80 100 SE +/- 0.81, N = 15 SE +/- 0.58, N = 15 85.4 84.3 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 3 - Compression Speed Tumbleweed 20220507 Tumbleweed 20220510 1400 2800 4200 5600 7000 SE +/- 49.94, N = 3 SE +/- 72.01, N = 3 6695.2 6645.9 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Renaissance Test: In-Memory Database Shootout OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: In-Memory Database Shootout Tumbleweed 20220510 Tumbleweed 20220507 5K 10K 15K 20K 25K SE +/- 151.02, N = 3 SE +/- 201.25, N = 3 19686.6 21253.2 MIN: 19418.39 / MAX: 22255.62 MIN: 20240.05 / MAX: 24744
Renaissance Test: Akka Unbalanced Cobwebbed Tree OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Akka Unbalanced Cobwebbed Tree Tumbleweed 20220510 Tumbleweed 20220507 7K 14K 21K 28K 35K SE +/- 149.63, N = 3 SE +/- 184.63, N = 3 34659.4 34923.6 MIN: 27645.02 / MAX: 34954.13 MIN: 27025.46 / MAX: 35226.8
Zstd Compression Compression Level: 19 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19 - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 600 1200 1800 2400 3000 SE +/- 4.43, N = 15 SE +/- 2.92, N = 15 2576.2 2515.7 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 19, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19, Long Mode - Compression Speed Tumbleweed 20220507 Tumbleweed 20220510 10 20 30 40 50 SE +/- 0.46, N = 15 SE +/- 0.25, N = 3 43.1 42.1 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Renaissance Test: Genetic Algorithm Using Jenetics + Futures OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.12 Test: Genetic Algorithm Using Jenetics + Futures Tumbleweed 20220507 Tumbleweed 20220510 1500 3000 4500 6000 7500 SE +/- 44.24, N = 3 SE +/- 54.20, N = 3 6895.9 7069.7 MIN: 6518.54 / MAX: 7318.42 MIN: 6787.55 / MAX: 7755.21
ASTC Encoder Preset: Medium OpenBenchmarking.org Seconds, Fewer Is Better ASTC Encoder 3.2 Preset: Medium Tumbleweed 20220510 Tumbleweed 20220507 1.2384 2.4768 3.7152 4.9536 6.192 SE +/- 0.1298, N = 15 SE +/- 0.0533, N = 15 5.1969 5.5042 1. (CXX) g++ options: -O3 -flto -pthread
ASTC Encoder Preset: Thorough OpenBenchmarking.org Seconds, Fewer Is Better ASTC Encoder 3.2 Preset: Thorough Tumbleweed 20220507 Tumbleweed 20220510 2 4 6 8 10 SE +/- 0.0853, N = 4 SE +/- 0.0624, N = 15 7.0018 7.1589 1. (CXX) g++ options: -O3 -flto -pthread
ASTC Encoder Preset: Exhaustive OpenBenchmarking.org Seconds, Fewer Is Better ASTC Encoder 3.2 Preset: Exhaustive Tumbleweed 20220510 Tumbleweed 20220507 2 4 6 8 10 SE +/- 0.0186, N = 3 SE +/- 0.0119, N = 3 8.6924 8.9358 1. (CXX) g++ options: -O3 -flto -pthread
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark Tumbleweed 20220507 Tumbleweed 20220510 90 180 270 360 450 SE +/- 4.68, N = 3 SE +/- 3.07, N = 3 392.96 386.05
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard Tumbleweed 20220510 Tumbleweed 20220507 2K 4K 6K 8K 10K SE +/- 213.42, N = 12 SE +/- 110.66, N = 3 9620 9395 1. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: yolov4 - Device: CPU - Executor: Standard Tumbleweed 20220510 Tumbleweed 20220507 140 280 420 560 700 SE +/- 7.65, N = 12 SE +/- 7.13, N = 4 634 622 1. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Tumbleweed 20220510 Tumbleweed 20220507 500 1000 1500 2000 2500 SE +/- 23.47, N = 3 SE +/- 16.03, N = 12 2132 1820 1. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard Tumbleweed 20220510 Tumbleweed 20220507 3K 6K 9K 12K 15K SE +/- 25.63, N = 3 SE +/- 28.06, N = 3 12510 12429 1. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2021.2 Implementation: MPI CPU - Input: water_GMX50_bare Tumbleweed 20220510 Tumbleweed 20220507 3 6 9 12 15 SE +/- 0.026, N = 3 SE +/- 0.027, N = 3 9.121 9.052 1. (CXX) g++ options: -O3
Zstd Compression Compression Level: 19, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 19, Long Mode - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 600 1200 1800 2400 3000 SE +/- 1.22, N = 15 SE +/- 3.90, N = 3 2674.2 2626.5 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
LAMMPS Molecular Dynamics Simulator Model: 20k Atoms OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 29Oct2020 Model: 20k Atoms Tumbleweed 20220510 Tumbleweed 20220507 8 16 24 32 40 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 35.26 34.10 1. (CXX) g++ options: -O3 -lm
Zstd Compression Compression Level: 8, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 8, Long Mode - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 700 1400 2100 2800 3500 SE +/- 13.20, N = 3 SE +/- 13.36, N = 3 3248.6 3196.6 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 8, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 8, Long Mode - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 70 140 210 280 350 SE +/- 1.70, N = 3 SE +/- 1.64, N = 3 318.7 314.3 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
Zstd Compression Compression Level: 3, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression Compression Level: 3, Long Mode - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 700 1400 2100 2800 3500 SE +/- 17.69, N = 3 SE +/- 7.96, N = 4 3251.9 3215.4 1. *** zstd command line interface 64-bits v1.5.2, by Yann Collet ***
LAMMPS Molecular Dynamics Simulator Model: Rhodopsin Protein OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 29Oct2020 Model: Rhodopsin Protein Tumbleweed 20220510 Tumbleweed 20220507 6 12 18 24 30 SE +/- 0.57, N = 12 SE +/- 0.45, N = 15 25.85 24.61 1. (CXX) g++ options: -O3 -lm
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU Tumbleweed 20220510 Tumbleweed 20220507 150 300 450 600 750 SE +/- 8.40, N = 15 SE +/- 8.36, N = 4 676.39 678.30 MIN: 593.14 MIN: 627.42 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU Tumbleweed 20220507 Tumbleweed 20220510 90 180 270 360 450 SE +/- 6.92, N = 15 SE +/- 5.15, N = 15 430.98 435.59 MIN: 379.38 MIN: 370.6 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU Tumbleweed 20220510 Tumbleweed 20220507 150 300 450 600 750 SE +/- 6.86, N = 4 SE +/- 4.64, N = 3 658.22 688.68 MIN: 617.41 MIN: 653.48 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU Tumbleweed 20220507 Tumbleweed 20220510 90 180 270 360 450 SE +/- 8.37, N = 15 SE +/- 5.96, N = 15 431.52 436.17 MIN: 361.41 MIN: 385.48 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU Tumbleweed 20220510 Tumbleweed 20220507 150 300 450 600 750 SE +/- 3.41, N = 3 SE +/- 2.91, N = 3 695.65 705.40 MIN: 659.77 MIN: 672.82 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU Tumbleweed 20220507 Tumbleweed 20220510 90 180 270 360 450 SE +/- 8.22, N = 12 SE +/- 7.24, N = 12 424.35 437.89 MIN: 366.93 MIN: 370.22 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread
Pennant Test: sedovbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig Tumbleweed 20220510 Tumbleweed 20220507 4 8 12 16 20 SE +/- 0.17, N = 3 SE +/- 0.05, N = 3 15.57 15.70 1. (CXX) g++ options: -fopenmp -lmpi
Algebraic Multi-Grid Benchmark OpenBenchmarking.org Figure Of Merit, More Is Better Algebraic Multi-Grid Benchmark 1.2 Tumbleweed 20220507 Tumbleweed 20220510 500M 1000M 1500M 2000M 2500M SE +/- 1049155.59, N = 3 SE +/- 136645.93, N = 3 2159126667 2158861667 1. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Tumbleweed 20220510 Tumbleweed 20220507 60 120 180 240 300 SE +/- 0.25, N = 3 SE +/- 0.24, N = 3 293.19 294.41 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
Xcompact3d Incompact3d Input: input.i3d 193 Cells Per Direction OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Tumbleweed 20220510 Tumbleweed 20220507 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 11.34 11.42 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
WireGuard + Linux Networking Stack Stress Test OpenBenchmarking.org Seconds, Fewer Is Better WireGuard + Linux Networking Stack Stress Test Tumbleweed 20220510 Tumbleweed 20220507 130 260 390 520 650 SE +/- 8.32, N = 9 SE +/- 8.20, N = 3 575.21 580.28
Stockfish Total Time OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 13 Total Time Tumbleweed 20220507 Tumbleweed 20220510 40M 80M 120M 160M 200M SE +/- 1769551.70, N = 3 SE +/- 1359631.79, N = 15 184534600 182150796 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fprofile-use -fno-peel-loops -fno-tracer -pedantic -O3 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto=jobserver
Zstd Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 3 - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 1400 2800 4200 5600 7000 SE +/- 54.93, N = 15 SE +/- 80.06, N = 4 6509.6 6426.1 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 19 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 19 - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 20 40 60 80 100 SE +/- 0.24, N = 3 SE +/- 0.42, N = 3 88.1 85.8 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 19 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 19 - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 600 1200 1800 2400 3000 SE +/- 4.98, N = 3 SE +/- 8.47, N = 3 2659.8 2650.9 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 3, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 3, Long Mode - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 70 140 210 280 350 SE +/- 2.88, N = 3 SE +/- 0.56, N = 3 301.7 294.9 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 3, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 3, Long Mode - Decompression Speed Tumbleweed 20220507 Tumbleweed 20220510 700 1400 2100 2800 3500 SE +/- 7.60, N = 3 SE +/- 3.18, N = 3 3232.9 3226.6 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 8, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 8, Long Mode - Compression Speed Tumbleweed 20220510 Tumbleweed 20220507 70 140 210 280 350 SE +/- 2.40, N = 15 SE +/- 2.82, N = 3 337.8 323.6 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 19, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 19, Long Mode - Compression Speed Tumbleweed 20220507 Tumbleweed 20220510 11 22 33 44 55 SE +/- 0.50, N = 3 SE +/- 0.42, N = 15 47.7 46.8 1. (CC) gcc options: -O3 -pthread -lz
Zstd Compression Compression Level: 19, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.0 Compression Level: 19, Long Mode - Decompression Speed Tumbleweed 20220510 Tumbleweed 20220507 600 1200 1800 2400 3000 SE +/- 3.84, N = 15 SE +/- 1.47, N = 3 2755.5 2742.1 1. (CC) gcc options: -O3 -pthread -lz
Tachyon Total Time OpenBenchmarking.org Seconds, Fewer Is Better Tachyon 0.99.2 Total Time Tumbleweed 20220507 Tumbleweed 20220510 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 23.63 24.20 1. (CC) gcc options: -m64 -O3 -fomit-frame-pointer -ffast-math -ltachyon -lm -lpthread
SVT-VP9 Tuning: VMAF Optimized - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: VMAF Optimized - Input: Bosphorus 1080p Tumbleweed 20220507 Tumbleweed 20220510 50 100 150 200 250 SE +/- 1.95, N = 3 SE +/- 0.66, N = 3 221.22 217.89 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-VP9 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080p Tumbleweed 20220507 Tumbleweed 20220510 50 100 150 200 250 SE +/- 2.48, N = 3 SE +/- 1.50, N = 3 214.71 213.09 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-VP9 Tuning: Visual Quality Optimized - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-VP9 0.3 Tuning: Visual Quality Optimized - Input: Bosphorus 1080p Tumbleweed 20220510 Tumbleweed 20220507 40 80 120 160 200 SE +/- 0.79, N = 3 SE +/- 1.35, N = 15 178.91 175.65 1. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm
SVT-AV1 Encoder Mode: Preset 10 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.0 Encoder Mode: Preset 10 - Input: Bosphorus 4K Tumbleweed 20220510 Tumbleweed 20220507 20 40 60 80 100 SE +/- 0.85, N = 3 SE +/- 0.57, N = 3 80.18 80.05 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq -pie
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Tumbleweed 20220507 Tumbleweed 20220510 20 40 60 80 100 SE +/- 1.07, N = 3 SE +/- 0.47, N = 3 92.53 91.81 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq -pie
SVT-HEVC Tuning: 1 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 1 - Input: Bosphorus 1080p Tumbleweed 20220510 Tumbleweed 20220507 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 30.09 29.83 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-HEVC Tuning: 7 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 7 - Input: Bosphorus 1080p Tumbleweed 20220510 Tumbleweed 20220507 40 80 120 160 200 SE +/- 2.16, N = 3 SE +/- 1.95, N = 3 175.95 174.38 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
SVT-HEVC Tuning: 10 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-HEVC 1.5.0 Tuning: 10 - Input: Bosphorus 1080p Tumbleweed 20220510 Tumbleweed 20220507 60 120 180 240 300 SE +/- 3.03, N = 4 SE +/- 2.84, N = 3 266.83 264.92 1. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.10 Encoder Speed: 0 Tumbleweed 20220510 Tumbleweed 20220507 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.65, N = 3 85.03 85.51 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.10 Encoder Speed: 2 Tumbleweed 20220507 Tumbleweed 20220510 11 22 33 44 55 SE +/- 0.63, N = 3 SE +/- 0.09, N = 3 47.82 47.94 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.10 Encoder Speed: 6 Tumbleweed 20220507 Tumbleweed 20220510 2 4 6 8 10 SE +/- 0.064, N = 15 SE +/- 0.077, N = 3 5.878 6.060 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 6, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.10 Encoder Speed: 6, Lossless Tumbleweed 20220507 Tumbleweed 20220510 3 6 9 12 15 SE +/- 0.095, N = 15 SE +/- 0.107, N = 5 9.789 10.070 1. (CXX) g++ options: -O3 -fPIC -lm
libavif avifenc Encoder Speed: 10, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.10 Encoder Speed: 10, Lossless Tumbleweed 20220507 Tumbleweed 20220510 2 4 6 8 10 SE +/- 0.075, N = 3 SE +/- 0.070, N = 3 7.097 7.315 1. (CXX) g++ options: -O3 -fPIC -lm
PyPerformance Benchmark: go OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: go Tumbleweed 20220510 Tumbleweed 20220507 70 140 210 280 350 SE +/- 4.51, N = 3 SE +/- 2.85, N = 3 313 328
PyPerformance Benchmark: 2to3 OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: 2to3 Tumbleweed 20220510 Tumbleweed 20220507 120 240 360 480 600 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 525 558
PyPerformance Benchmark: chaos OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: chaos Tumbleweed 20220510 Tumbleweed 20220507 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 180 208
PyPerformance Benchmark: float OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: float Tumbleweed 20220510 Tumbleweed 20220507 40 80 120 160 200 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 187 205
PyPerformance Benchmark: nbody OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: nbody Tumbleweed 20220510 Tumbleweed 20220507 50 100 150 200 250 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 189 219
PyPerformance Benchmark: pathlib OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: pathlib Tumbleweed 20220510 Tumbleweed 20220507 7 14 21 28 35 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 28.6 31.1
PyPerformance Benchmark: json_loads OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: json_loads Tumbleweed 20220510 Tumbleweed 20220507 9 18 27 36 45 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 36.9 37.5
PyPerformance Benchmark: crypto_pyaes OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: crypto_pyaes Tumbleweed 20220510 Tumbleweed 20220507 40 80 120 160 200 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 170 194
PyPerformance Benchmark: regex_compile OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: regex_compile Tumbleweed 20220510 Tumbleweed 20220507 60 120 180 240 300 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 272 295
PyPerformance Benchmark: python_startup OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: python_startup Tumbleweed 20220510 Tumbleweed 20220507 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 25.5 26.5
PyPerformance Benchmark: django_template OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: django_template Tumbleweed 20220510 Tumbleweed 20220507 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 76.5 85.7
PyPerformance Benchmark: pickle_pure_python OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: pickle_pure_python Tumbleweed 20220510 Tumbleweed 20220507 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 691 790
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 2021.01.31 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Tumbleweed 20220510 Tumbleweed 20220507 300M 600M 900M 1200M 1500M SE +/- 10500000.00, N = 3 SE +/- 3735118.62, N = 3 1595800000 1410166667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 160 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 2021.01.31 Threads: 160 - Buffer Length: 256 - Filter Length: 57 Tumbleweed 20220510 Tumbleweed 20220507 400M 800M 1200M 1600M 2000M SE +/- 15460954.40, N = 3 SE +/- 7379927.73, N = 3 1715666667 1458400000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
nginx Concurrent Requests: 100 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.21.1 Concurrent Requests: 100 Tumbleweed 20220507 Tumbleweed 20220510 20K 40K 60K 80K 100K SE +/- 417.99, N = 3 SE +/- 303.63, N = 3 79426.07 79403.07 1. (CC) gcc options: -lcrypt -lz -O3 -march=native
nginx Concurrent Requests: 200 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.21.1 Concurrent Requests: 200 Tumbleweed 20220507 Tumbleweed 20220510 40K 80K 120K 160K 200K SE +/- 1923.63, N = 3 SE +/- 1519.46, N = 15 197968.99 196528.56 1. (CC) gcc options: -lcrypt -lz -O3 -march=native
nginx Concurrent Requests: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.21.1 Concurrent Requests: 500 Tumbleweed 20220507 Tumbleweed 20220510 40K 80K 120K 160K 200K SE +/- 2546.05, N = 4 SE +/- 1939.73, N = 6 208849.70 206578.82 1. (CC) gcc options: -lcrypt -lz -O3 -march=native
nginx Concurrent Requests: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.21.1 Concurrent Requests: 1000 Tumbleweed 20220507 Tumbleweed 20220510 50K 100K 150K 200K 250K SE +/- 822.90, N = 3 SE +/- 2147.64, N = 5 214270.04 211423.33 1. (CC) gcc options: -lcrypt -lz -O3 -march=native
Apache HTTP Server Concurrent Requests: 200 OpenBenchmarking.org Requests Per Second, More Is Better Apache HTTP Server 2.4.48 Concurrent Requests: 200 Tumbleweed 20220507 Tumbleweed 20220510 40K 80K 120K 160K 200K SE +/- 1210.47, N = 3 SE +/- 2234.54, N = 13 197075.88 194927.31 -lcrypt -lpthread -shared -fPIC 1. (CC) gcc options: -O2
Apache HTTP Server Concurrent Requests: 500 OpenBenchmarking.org Requests Per Second, More Is Better Apache HTTP Server 2.4.48 Concurrent Requests: 500 Tumbleweed 20220507 Tumbleweed 20220510 40K 80K 120K 160K 200K SE +/- 2654.22, N = 3 SE +/- 1501.57, N = 3 206530.83 205683.86 -lcrypt -lpthread -shared -fPIC 1. (CC) gcc options: -O2
Apache HTTP Server Concurrent Requests: 1000 OpenBenchmarking.org Requests Per Second, More Is Better Apache HTTP Server 2.4.48 Concurrent Requests: 1000 Tumbleweed 20220507 Tumbleweed 20220510 50K 100K 150K 200K 250K SE +/- 1527.83, N = 3 SE +/- 2186.63, N = 3 213476.35 210703.41 -lcrypt -lpthread -shared -fPIC 1. (CC) gcc options: -O2
PHPBench PHP Benchmark Suite OpenBenchmarking.org Score, More Is Better PHPBench 0.8.1 PHP Benchmark Suite Tumbleweed 20220507 Tumbleweed 20220510 140K 280K 420K 560K 700K SE +/- 118.82, N = 3 SE +/- 5984.74, N = 3 655272 650951
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Tumbleweed 20220510 Tumbleweed 20220507 300 600 900 1200 1500 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 1110 1206
Phoronix Test Suite v10.8.4