Intel 10980XE  GCC Compiler Benchmarks

Intel Core i9-10980XE GCC compiler benchmarking by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2107032-IB-10980XECO53
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Audio Encoding 4 Tests
AV1 4 Tests
Bioinformatics 3 Tests
C/C++ Compiler Tests 21 Tests
Compression Tests 3 Tests
CPU Massive 20 Tests
Creator Workloads 24 Tests
Cryptography 5 Tests
Encoding 13 Tests
Finance 2 Tests
HPC - High Performance Computing 7 Tests
Imaging 3 Tests
Machine Learning 4 Tests
Multi-Core 18 Tests
NVIDIA GPU Compute 3 Tests
OpenMPI Tests 2 Tests
Programmer / Developer System Benchmarks 3 Tests
Raytracing 2 Tests
Renderers 3 Tests
Scientific Computing 3 Tests
Server CPU Tests 12 Tests
Single-Threaded 6 Tests
Speech 2 Tests
Telephony 3 Tests
Video Encoding 9 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
GCC 8.5
July 03 2021
  6 Hours, 30 Minutes
GCC 9.4
July 02 2021
  9 Hours, 31 Minutes
GCC 10.3
July 02 2021
  6 Hours, 12 Minutes
GCC 11.1
July 02 2021
  6 Hours, 7 Minutes
GCC 12.0.0 20210701
July 01 2021
  7 Hours, 40 Minutes
Invert Hiding All Results Option
  7 Hours, 12 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Intel 10980XE  GCC Compiler BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Core i9-10980XE @ 4.80GHz (18 Cores / 36 Threads)ASRock X299 Steel Legend (P1.30 BIOS)Intel Sky Lake-E DMI3 Registers32GBSamsung SSD 970 PRO 512GBNVIDIA NV132 11GBRealtek ALC1220ASUS VP28UIntel I219-V + Intel I211Ubuntu 21.045.11.0-22-generic (x86_64)GNOME Shell 3.38.4X Server + Waylandnouveau4.3 Mesa 21.0.11.0.2GCC 8.5.0GCC 9.4.0GCC 10.3.0GCC 11.1.0GCC 12.0.0 20210701ext42560x1600ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilersFile-SystemScreen ResolutionIntel 10980XE  GCC Compiler Benchmarks PerformanceSystem Logs- Transparent Huge Pages: madvise- CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native"- --disable-multilib --enable-checking=release --enable-languages=c,c++- Scaling Governor: intel_cpufreq schedutil - CPU Microcode: 0x5003102- Python 3.9.5- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

GCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701Result OverviewPhoronix Test Suite100%108%115%123%eSpeak-NG Speech EngineSmallptGraphicsMagickTimed MrBayes AnalysisQuantLibBotanCoremarkGcrypt LibraryTNNStockfishVP9 libvpx EncodingZstd CompressiononeDNNx265Liquid-DSPWebP Image EncodeOpus Codec EncodingViennaCLTachyonSVT-VP9Timed HMMer SearchMobile Neural NetworkLAME MP3 Encoding7-Zip CompressionCrypto++EtcpakC-RayVOSK Speech Recognition ToolkitHimeno BenchmarkSecureMarkNCNNC-Bloscdav1dFLAC Audio EncodingSQLite Speedtestlibjpeg-turbo tjbenchNgspiceSVT-AV1PJSIPAOM AV1GnuPGKvazaarSVT-HEVCWavPack Audio EncodingFinanceBench

Intel 10980XE  GCC Compiler Benchmarksgraphics-magick: Sharpenfinancebench: Bonds OpenMPcompress-zstd: 8, Long Mode - Compression Speedespeak: Text-To-Speech Synthesisbotan: ChaCha20Poly1305botan: ChaCha20Poly1305 - Decryptfinancebench: Repo OpenMPgraphics-magick: Swirlonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUsmallpt: Global Illumination Renderer; 128 Samplesmnn: resnet-v2-50viennacl: CPU BLAS - dGEMM-NNbotan: Twofishviennacl: CPU BLAS - dGEMM-TNviennacl: CPU BLAS - dGEMM-NTviennacl: CPU BLAS - dGEMM-TTbotan: Twofish - Decryptgraphics-magick: Resizingtnn: CPU - MobileNet v2graphics-magick: Rotatebotan: Blowfishmrbayes: Primate Phylogeny Analysisonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUbotan: Blowfish - Decryptquantlib: ncnn: CPU-v2-v2 - mobilenet-v2coremark: CoreMark Size 666 - Iterations Per Secondcompress-zstd: 19, Long Mode - Decompression Speedbotan: CAST-256 - Decryptbotan: CAST-256gcrypt: mnn: inception-v3ncnn: CPU - googlenettnn: CPU - SqueezeNet v2ncnn: CPU - efficientnet-b0compress-zstd: 19 - Decompression Speedgraphics-magick: HWB Color Spacencnn: CPU - resnet18ncnn: CPU - mnasnetvpxenc: Speed 5 - Bosphorus 4Kmnn: mobilenetV3webp: Quality 100, Highest Compressioncryptopp: Unkeyed Algorithmsonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUcompress-zstd: 8 - Decompression Speedetcpak: DXT1stockfish: Total Timeonednn: IP Shapes 3D - u8s8f32 - CPUmnn: MobileNetV2_224compress-zstd: 8, Long Mode - Decompression Speedsvt-vp9: VMAF Optimized - Bosphorus 1080pncnn: CPU - resnet50graphics-magick: Noise-Gaussianliquid-dsp: 36 - 256 - 57ncnn: CPU-v3-v3 - mobilenet-v3mnn: SqueezeNetV1.0cryptopp: Keyed Algorithmswebp: Quality 100, Lossless, Highest Compressiondav1d: Chimera 1080p 10-bitncnn: CPU - squeezenet_ssdx265: Bosphorus 4Kdav1d: Summer Nature 4Kvpxenc: Speed 0 - Bosphorus 4Kviennacl: CPU BLAS - sAXPYtnn: CPU - SqueezeNet v1.1aom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kncnn: CPU - regnety_400metcpak: ETC1 + Ditheringviennacl: CPU BLAS - dGEMV-Nencode-opus: WAV To Opus Encodecompress-zstd: 8 - Compression Speedonednn: IP Shapes 3D - bf16bf16bf16 - CPUtachyon: Total Timeliquid-dsp: 32 - 256 - 57svt-vp9: PSNR/SSIM Optimized - Bosphorus 1080ponednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUncnn: CPU - blazefacencnn: CPU - mobilenetonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUwebp: Quality 100, Losslessviennacl: CPU BLAS - sCOPYonednn: Recurrent Neural Network Inference - u8s8f32 - CPUhmmer: Pfam Database Searchbotan: KASUMIngspice: C7552encode-mp3: WAV To MP3compress-7zip: Compress Speed Testcompress-zstd: 19, Long Mode - Compression Speedonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUetcpak: ETC2pjsip: OPTIONS, Statelessncnn: CPU - alexnetpjsip: INVITEc-ray: Total Time - 4K, 16 Rays Per Pixelvosk: aom-av1: Speed 8 Realtime - Bosphorus 4Kbotan: KASUMI - Decrypthimeno: Poisson Pressure Solverncnn: CPU - vgg16securemark: SecureMark-TLSgraphics-magick: Enhancedblosc: blosclzmnn: mobilenet-v1-1.0aom-av1: Speed 6 Realtime - Bosphorus 4Kcryptopp: Integer + Elliptic Curve Public Key Algorithmssvt-vp9: Visual Quality Optimized - Bosphorus 1080pkvazaar: Bosphorus 4K - Very Fastncnn: CPU - shufflenet-v2sqlite-speedtest: Timed Time - Size 1,000encode-flac: WAV To FLACcompress-zstd: 19 - Compression Speedtjbench: Decompression Throughputsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Kviennacl: CPU BLAS - sDOTkvazaar: Bosphorus 4K - Ultra Fastpjsip: OPTIONS, Statefulsvt-hevc: 1 - Bosphorus 1080pngspice: C2670svt-hevc: 10 - Bosphorus 1080ponednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUsvt-hevc: 7 - Bosphorus 1080pviennacl: CPU BLAS - dGEMV-Tbotan: AES-256gnupg: 2.7GB Sample File Encryptiontnn: CPU - DenseNetviennacl: CPU BLAS - dAXPYviennacl: CPU BLAS - dCOPYonednn: IP Shapes 1D - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUencode-wavpack: WAV To WavPackbotan: AES-256 - Decryptlibgav1: Chimera 1080p 10-bitlibgav1: Summer Nature 4Kncnn: CPU - yolov4-tinymnn: squeezenetv1.1viennacl: CPU BLAS - dDOTonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070119774820.187500335.526.836984.019977.16542354.8984377920.6794825.28627.29755.5416.18456.054.755.2420.3661444321.387809491.138146.0960.441500482.7802586.35.36618050.8300092819.2152.429152.235194.12130.15412.7370.1246.692676.890310.544.828.222.4036.642377.7809021573.181573.039.828583361.71445.235511400131.232393.7043547.4306.0818.333909167900004.725.594714.48766937.695215.1615.6321.53197.464.7568.8289.9634.4627.1813.77329.12869.58.283425.72.9490348.1611924630000310.79939.9232.5614.161.7630817.20245.9937.607126.20499.716126.2008.7169971143.39.34766198.1091353029.05330729.81820.72119.4097.6444522.73117036.2025986942411800.72.4337.515519.144212247.4521.355.0557.6068.43660.3218.8135811.34011.92577.040.13580112.88134.346374.625.5406211.0180190.0379.93998.62764.2393505.93157.138.10.5284160.46145913.3553991.20120.844.56463.67.8903226576452.778646375.628.107951.152945.44942795.0533857520.8288666.04531.45256.1414.44556.254.154.9411.5731617347.436776486.315157.3320.467594475.4082568.85.10650499.4748883017.6150.879150.585193.97332.41212.4473.9386.572802.786410.584.738.612.2976.560375.2314921639.781636.969.791853436.81450.560506225521.279913.5943628.4295.0717.593879216700004.575.540719.76248436.869219.6915.0821.64199.894.8771.2296.1424.4427.2413.87336.10671.88.241429.42.8600847.8849930236667302.25961.3832.5413.941.7915016.82347.1960.128126.506100.411127.6888.5259829843.59.55455199.0971359039.15325230.03520.99319.3498.5574609.39856336.0126345742411802.62.4557.435538.547039243.4821.204.9757.0348.50060.2220.6177871.35512.02178.040.16572912.91134.222376.895.5953310.9596190.6279.73987.08064.2283527.68257.438.10.5267980.45945613.3753993.89021.354.42063.78.1003831749799.115885370.132.672788.573780.12335458.6627617610.6805226.13028.25558.7404.15758.956.457.1411.5221585311.604765486.288154.6290.426902474.8042529.85.12630485.5885102876.9151.248151.184193.41130.80413.0669.2976.622701.986411.164.808.592.3416.866372.5830411566.751565.419.390623285.51484.230499422761.227033.6693479.0299.9717.874039406600004.645.612717.16555937.869222.2715.2621.84195.154.8470.3286.2154.4827.8613.63329.48671.68.283424.02.9397847.9045939716667306.89938.2202.6113.811.7552017.25146.4935.962126.68798.200126.8778.7309742643.99.35095197.6291382229.18328130.43020.75319.2896.8794538.66196136.3526347242711713.42.4677.385503.078606246.7521.095.0257.3038.36960.1219.5427991.35912.06277.440.64574413.04133.912372.695.5333410.9199189.8879.63999.24864.4243508.29057.338.30.5260140.46048213.3403998.47921.264.27154.77.9016331948802.755208469.435.086779.376774.64534558.2239589240.6970806.20128.44551.0367.67751.949.850.5373.5621571314.561852442.670142.9340.430676439.5552749.15.06597455.1608122775.7140.850141.031208.34331.27512.8469.8026.562642.291610.974.728.632.4126.780360.4141921566.251563.059.413463351.91468.968522069631.230123.7543553.2297.3217.774039545366674.665.723692.98639936.471223.0615.2321.16192.954.8770.7288.9104.3328.0713.93327.32971.78.456419.52.9342847.8659951170000305.72936.8802.5513.791.7626416.80346.7938.043126.616100.697129.3968.7329814944.39.35550194.7591364449.08324029.96020.89419.6497.0014592.94740136.5625956543211926.82.4777.515593.130439244.0521.015.0557.4118.41161.0218.6181621.34712.09077.640.31576912.96134.711375.655.5454410.9199191.0279.33985.26664.2043508.39057.438.30.5281330.45995613.3533995.23221.374.60963.77.9047731948317.579427385.527.281781.383775.48834223.3033869030.6786265.99128.27251.2366.64851.949.851.5374.7071607318.056794442.265145.1740.425675442.4102773.64.89601830.2632922782.7140.480140.309196.22230.79712.2169.2316.272773.988410.934.588.652.3726.548374.6407951564.711567.419.594523332.71419.365507345711.224963.7293531.4293.7117.744039375533334.545.506714.20526937.161221.9415.2821.08194.064.9270.1287.4904.4028.1013.48325.27871.48.186432.72.9467049.3237944433333303.54935.3782.5413.811.7447116.89246.4936.491129.454100.609128.3208.5999849343.99.34206197.1281379668.99330429.97320.57419.6796.6104580.18807336.7026451442911889.42.4777.495532.467940244.5621.154.9856.7158.37960.8217.4258161.34811.96677.140.20576312.94135.428375.325.5367210.9330191.3379.53972.02064.6133524.74657.238.20.5279390.45966013.3313993.17321.3228.2422.834.28363.77.91258OpenBenchmarking.org

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SharpenGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 2021070170140210280350SE +/- 0.33, N = 31972653173193191. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

FinanceBench

FinanceBench is a collection of financial program benchmarks with support for benchmarking on the GPU via OpenCL and CPU benchmarking with OpenMP. The FinanceBench test cases are focused on Black-Sholes-Merton Process with Analytic European Option engine, QMC (Sobol) Monte-Carlo method (Equity Option Example), Bonds Fixed-rate bond with flat forward curve, and Repo Securities repurchase agreement. FinanceBench was originally written by the Cavazos Lab at University of Delaware. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMPGCC 9.4GCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 2021070116K32K48K64K80KSE +/- 1061.39, N = 3SE +/- 5.53, N = 3SE +/- 11.94, N = 3SE +/- 36.89, N = 3SE +/- 48.36, N = 376452.7874820.1949799.1248802.7648317.581. (CXX) g++ options: -O3 -march=native -fopenmp

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8, Long Mode - Compression SpeedGCC 8.5GCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 11.1100200300400500SE +/- 3.63, N = 3SE +/- 3.28, N = 15SE +/- 2.56, N = 13SE +/- 3.88, N = 15SE +/- 3.45, N = 3335.5370.1375.6385.5469.41. (CC) gcc options: -O3 -march=native -pthread -lz

eSpeak-NG Speech Engine

This test times how long it takes the eSpeak speech synthesizer to read Project Gutenberg's The Outline of Science and output to a WAV file. This test profile is now tracking the eSpeak-NG version of eSpeak. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BettereSpeak-NG Speech Engine 20200907Text-To-Speech SynthesisGCC 11.1GCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 8.5816243240SE +/- 0.16, N = 4SE +/- 0.09, N = 4SE +/- 0.23, N = 4SE +/- 0.18, N = 4SE +/- 0.19, N = 435.0932.6728.1127.2826.841. (CC) gcc options: -O3 -march=native -std=c99

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305GCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 9.4GCC 8.52004006008001000SE +/- 1.05, N = 3SE +/- 0.73, N = 3SE +/- 0.15, N = 3SE +/- 1.36, N = 3SE +/- 2.79, N = 3779.38781.38788.57951.15984.021. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: ChaCha20Poly1305 - DecryptGCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 9.4GCC 8.52004006008001000SE +/- 0.89, N = 3SE +/- 0.47, N = 3SE +/- 0.79, N = 3SE +/- 0.08, N = 3SE +/- 2.38, N = 3774.65775.49780.12945.45977.171. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

FinanceBench

FinanceBench is a collection of financial program benchmarks with support for benchmarking on the GPU via OpenCL and CPU benchmarking with OpenMP. The FinanceBench test cases are focused on Black-Sholes-Merton Process with Analytic European Option engine, QMC (Sobol) Monte-Carlo method (Equity Option Example), Bonds Fixed-rate bond with flat forward curve, and Repo Securities repurchase agreement. FinanceBench was originally written by the Cavazos Lab at University of Delaware. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Repo OpenMPGCC 9.4GCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 202107019K18K27K36K45KSE +/- 10.60, N = 3SE +/- 34.41, N = 3SE +/- 120.35, N = 3SE +/- 43.71, N = 3SE +/- 22.03, N = 342795.0542354.9035458.6634558.2234223.301. (CXX) g++ options: -O3 -march=native -fopenmp

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: SwirlGCC 9.4GCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 11.12004006008001000SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 37527617929039241. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUGCC 9.4GCC 11.1GCC 10.3GCC 8.5GCC 12.0.0 202107010.18650.3730.55950.7460.9325SE +/- 0.008442, N = 15SE +/- 0.005568, N = 3SE +/- 0.005954, N = 8SE +/- 0.003298, N = 3SE +/- 0.008934, N = 30.8288660.6970800.6805220.6794820.678626MIN: 0.74MIN: 0.67MIN: 0.63MIN: 0.66MIN: 0.651. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Smallpt

Smallpt is a C++ global illumination renderer written in less than 100 lines of code. Global illumination is done via unbiased Monte Carlo path tracing and there is multi-threading support via the OpenMP library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSmallpt 1.0Global Illumination Renderer; 128 SamplesGCC 11.1GCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 8.5246810SE +/- 0.004, N = 3SE +/- 0.033, N = 3SE +/- 0.011, N = 3SE +/- 0.017, N = 3SE +/- 0.007, N = 36.2016.1306.0455.9915.2861. (CXX) g++ options: -fopenmp -O3 -march=native

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-50GCC 9.4GCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 8.5714212835SE +/- 0.47, N = 15SE +/- 0.06, N = 3SE +/- 0.19, N = 3SE +/- 0.24, N = 3SE +/- 0.10, N = 331.4528.4528.2728.2627.30MIN: 24.41 / MAX: 36.24MIN: 27.77 / MAX: 28.83MIN: 27.7 / MAX: 28.91MIN: 27.6 / MAX: 28.76MIN: 26.86 / MAX: 27.931. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NNGCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 9.4GCC 10.31326395265SE +/- 0.15, N = 3SE +/- 0.44, N = 3SE +/- 0.75, N = 3SE +/- 0.13, N = 3SE +/- 0.63, N = 351.051.255.556.158.71. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: TwofishGCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 9.4GCC 8.590180270360450SE +/- 0.30, N = 3SE +/- 1.13, N = 3SE +/- 0.23, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 3366.65367.68404.16414.45416.181. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TNGCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 9.4GCC 10.31326395265SE +/- 0.10, N = 3SE +/- 0.10, N = 3SE +/- 1.55, N = 2SE +/- 0.36, N = 3SE +/- 1.17, N = 351.951.956.056.258.91. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-NTGCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 8.5GCC 10.31326395265SE +/- 0.15, N = 3SE +/- 0.37, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 3SE +/- 0.48, N = 349.849.854.154.756.41. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

OpenBenchmarking.orgGFLOPs/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMM-TTGCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 8.5GCC 10.31326395265SE +/- 0.20, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.32, N = 3SE +/- 0.70, N = 250.551.554.955.257.11. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Twofish - DecryptGCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 9.4GCC 8.590180270360450SE +/- 0.56, N = 3SE +/- 0.17, N = 3SE +/- 0.26, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3373.56374.71411.52411.57420.371. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: ResizingGCC 8.5GCC 11.1GCC 10.3GCC 12.0.0 20210701GCC 9.430060090012001500SE +/- 2.91, N = 3SE +/- 3.51, N = 3SE +/- 8.67, N = 3SE +/- 7.21, N = 3SE +/- 4.93, N = 3144415711585160716171. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2GCC 9.4GCC 8.5GCC 12.0.0 20210701GCC 11.1GCC 10.380160240320400SE +/- 0.34, N = 3SE +/- 0.29, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.31, N = 3347.44321.39318.06314.56311.60MIN: 345.68 / MAX: 356.59MIN: 319.29 / MAX: 341.28MIN: 316.44 / MAX: 326.16MIN: 312.66 / MAX: 328.44MIN: 309.73 / MAX: 322.671. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: RotateGCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 8.5GCC 11.12004006008001000SE +/- 5.24, N = 3SE +/- 3.51, N = 3SE +/- 7.25, N = 15SE +/- 7.07, N = 15SE +/- 2.52, N = 37657767948098521. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: BlowfishGCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 9.4GCC 8.5110220330440550SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.22, N = 3SE +/- 0.29, N = 3SE +/- 0.01, N = 3442.27442.67486.29486.32491.141. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Timed MrBayes Analysis

This test performs a bayesian analysis of a set of primate genome sequences in order to estimate their phylogeny. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.2.7Primate Phylogeny AnalysisGCC 9.4GCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 11.1306090120150SE +/- 1.65, N = 12SE +/- 0.58, N = 3SE +/- 0.45, N = 3SE +/- 1.02, N = 3SE +/- 0.32, N = 3157.33154.63146.10145.17142.931. (CC) gcc options: -mmmx -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -maes -mavx -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mrdrnd -mbmi -mbmi2 -madx -mmpx -mabm -O3 -std=c99 -pedantic -march=native -lm

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUGCC 9.4GCC 8.5GCC 11.1GCC 10.3GCC 12.0.0 202107010.10520.21040.31560.42080.526SE +/- 0.002588, N = 3SE +/- 0.003487, N = 3SE +/- 0.004665, N = 3SE +/- 0.004576, N = 4SE +/- 0.000391, N = 30.4675940.4415000.4306760.4269020.425675MIN: 0.44MIN: 0.41MIN: 0.41MIN: 0.4MIN: 0.411. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: Blowfish - DecryptGCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 9.4GCC 8.5100200300400500SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.30, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3439.56442.41474.80475.41482.781. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.21GCC 10.3GCC 9.4GCC 8.5GCC 11.1GCC 12.0.0 202107016001200180024003000SE +/- 18.68, N = 3SE +/- 35.29, N = 3SE +/- 19.67, N = 3SE +/- 33.86, N = 4SE +/- 0.85, N = 32529.82568.82586.32749.12773.61. (CXX) g++ options: -O3 -march=native -rdynamic

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v2GCC 8.5GCC 10.3GCC 9.4GCC 11.1GCC 12.0.0 202107011.2062.4123.6184.8246.03SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 35.365.125.105.064.89MIN: 4.96 / MAX: 8.4MIN: 4.76 / MAX: 8.89MIN: 4.73 / MAX: 10.4MIN: 4.72 / MAX: 10.01MIN: 4.72 / MAX: 10.071. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondGCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 10.3GCC 9.4140K280K420K560K700KSE +/- 1267.23, N = 3SE +/- 2406.19, N = 3SE +/- 3624.80, N = 3SE +/- 2003.80, N = 3SE +/- 1621.16, N = 3597455.16601830.26618050.83630485.59650499.471. (CC) gcc options: -O2 -O3 -march=native -lrt" -lrt

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Decompression SpeedGCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 10.3GCC 9.46001200180024003000SE +/- 14.84, N = 3SE +/- 2.25, N = 3SE +/- 10.70, N = 3SE +/- 2.75, N = 3SE +/- 4.29, N = 32775.72782.72819.22876.93017.61. (CC) gcc options: -O3 -march=native -pthread -lz

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256 - DecryptGCC 12.0.0 20210701GCC 11.1GCC 9.4GCC 10.3GCC 8.5306090120150SE +/- 0.28, N = 3SE +/- 0.50, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3140.48140.85150.88151.25152.431. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: CAST-256GCC 12.0.0 20210701GCC 11.1GCC 9.4GCC 10.3GCC 8.5306090120150SE +/- 0.30, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3140.31141.03150.59151.18152.241. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Gcrypt Library

Libgcrypt is a general purpose cryptographic library developed as part of the GnuPG project. This is a benchmark of libgcrypt's integrated benchmark and is measuring the time to run the benchmark command with a cipher/mac/hash repetition count set for 50 times as simple, high level look at the overall crypto performance of the system under test. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGcrypt Library 1.9GCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 9.4GCC 10.350100150200250SE +/- 0.18, N = 3SE +/- 0.33, N = 3SE +/- 0.27, N = 3SE +/- 0.21, N = 3SE +/- 0.44, N = 3208.34196.22194.12193.97193.411. (CC) gcc options: -O3 -march=native -fvisibility=hidden -lgpg-error

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v3GCC 9.4GCC 11.1GCC 10.3GCC 12.0.0 20210701GCC 8.5816243240SE +/- 0.28, N = 15SE +/- 0.42, N = 3SE +/- 0.42, N = 3SE +/- 0.43, N = 3SE +/- 0.10, N = 332.4131.2830.8030.8030.15MIN: 29.17 / MAX: 33.89MIN: 30.28 / MAX: 31.97MIN: 30.12 / MAX: 31.88MIN: 30.14 / MAX: 31.87MIN: 29.77 / MAX: 30.531. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenetGCC 10.3GCC 11.1GCC 8.5GCC 9.4GCC 12.0.0 202107013691215SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.28, N = 3SE +/- 0.31, N = 313.0612.8412.7312.4412.21MIN: 12.84 / MAX: 14.29MIN: 12.68 / MAX: 16.73MIN: 12.1 / MAX: 19.86MIN: 12 / MAX: 13.22MIN: 11.77 / MAX: 13.021. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2GCC 9.4GCC 8.5GCC 11.1GCC 10.3GCC 12.0.0 202107011632486480SE +/- 1.05, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 373.9470.1269.8069.3069.23MIN: 72.33 / MAX: 77.08MIN: 69.44 / MAX: 71.63MIN: 69.16 / MAX: 70.99MIN: 68.65 / MAX: 70.61MIN: 68.59 / MAX: 70.341. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b0GCC 8.5GCC 10.3GCC 9.4GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 36.696.626.576.566.27MIN: 6.33 / MAX: 10.85MIN: 6.24 / MAX: 24.41MIN: 6.28 / MAX: 14.64MIN: 6.27 / MAX: 11.76MIN: 6.05 / MAX: 14.371. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Decompression SpeedGCC 11.1GCC 8.5GCC 10.3GCC 12.0.0 20210701GCC 9.46001200180024003000SE +/- 7.69, N = 9SE +/- 3.24, N = 3SE +/- 9.76, N = 3SE +/- 16.86, N = 3SE +/- 14.28, N = 32642.22676.82701.92773.92802.71. (CC) gcc options: -O3 -march=native -pthread -lz

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color SpaceGCC 9.4GCC 10.3GCC 12.0.0 20210701GCC 8.5GCC 11.12004006008001000SE +/- 1.33, N = 3SE +/- 0.88, N = 3SE +/- 1.15, N = 38648648849039161. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18GCC 10.3GCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 8.53691215SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.28, N = 3SE +/- 0.23, N = 311.1610.9710.9310.5810.54MIN: 11.03 / MAX: 11.45MIN: 10.84 / MAX: 20.49MIN: 10.84 / MAX: 11.27MIN: 10.2 / MAX: 11.57MIN: 10.19 / MAX: 17.981. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnetGCC 8.5GCC 10.3GCC 9.4GCC 11.1GCC 12.0.0 202107011.08452.1693.25354.3385.4225SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 34.824.804.734.724.58MIN: 4.55 / MAX: 12.4MIN: 4.42 / MAX: 16.22MIN: 4.44 / MAX: 11.54MIN: 4.46 / MAX: 10.72MIN: 4.39 / MAX: 10.871. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

VP9 libvpx Encoding

This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9 video format. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.10.0Speed: Speed 5 - Input: Bosphorus 4KGCC 8.5GCC 10.3GCC 9.4GCC 11.1GCC 12.0.0 20210701246810SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.228.598.618.638.651. (CXX) g++ options: -m64 -lm -lpthread -O3 -march=native -fPIC -U_FORTIFY_SOURCE -std=gnu++11

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV3GCC 11.1GCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 9.40.54271.08541.62812.17082.7135SE +/- 0.032, N = 3SE +/- 0.012, N = 3SE +/- 0.011, N = 3SE +/- 0.011, N = 3SE +/- 0.015, N = 152.4122.4032.3722.3412.297MIN: 2.23 / MAX: 2.61MIN: 2.28 / MAX: 2.54MIN: 2.25 / MAX: 2.5MIN: 2.16 / MAX: 2.53MIN: 1.96 / MAX: 2.531. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Highest CompressionGCC 10.3GCC 11.1GCC 8.5GCC 9.4GCC 12.0.0 20210701246810SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.007, N = 3SE +/- 0.007, N = 3SE +/- 0.043, N = 36.8666.7806.6426.5606.5481. (CC) gcc options: -fvisibility=hidden -O3 -march=native -pthread -lm -ljpeg -lpng16

Crypto++

Crypto++ is a C++ class library of cryptographic algorithms. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Unkeyed AlgorithmsGCC 11.1GCC 10.3GCC 12.0.0 20210701GCC 9.4GCC 8.580160240320400SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.68, N = 3SE +/- 0.65, N = 3SE +/- 0.02, N = 3360.41372.58374.64375.23377.781. (CXX) g++ options: -O3 -march=native -fPIC -pthread -pipe

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUGCC 9.4GCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 20210701400800120016002000SE +/- 1.53, N = 3SE +/- 0.81, N = 3SE +/- 1.06, N = 3SE +/- 3.72, N = 3SE +/- 1.54, N = 31639.781573.181566.751566.251564.71MIN: 1630.86MIN: 1566.72MIN: 1558.77MIN: 1553.36MIN: 1557.511. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUGCC 9.4GCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 11.1400800120016002000SE +/- 2.09, N = 3SE +/- 1.09, N = 3SE +/- 0.75, N = 3SE +/- 0.93, N = 3SE +/- 2.29, N = 31636.961573.031567.411565.411563.05MIN: 1629.18MIN: 1566.77MIN: 1561.17MIN: 1559.12MIN: 1555.641. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.33691215SE +/- 0.02091, N = 3SE +/- 0.00795, N = 3SE +/- 0.02038, N = 3SE +/- 0.01742, N = 3SE +/- 0.02137, N = 39.828589.791859.594529.413469.39062MIN: 9.53MIN: 9.62MIN: 9.4MIN: 9.27MIN: 9.291. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8 - Decompression SpeedGCC 10.3GCC 12.0.0 20210701GCC 11.1GCC 8.5GCC 9.47001400210028003500SE +/- 3.06, N = 3SE +/- 2.91, N = 3SE +/- 5.37, N = 3SE +/- 2.28, N = 3SE +/- 2.27, N = 53285.53332.73351.93361.73436.81. (CC) gcc options: -O3 -march=native -pthread -lz

Etcpak

Etcpack is the self-proclaimed "fastest ETC compressor on the planet" with focused on providing open-source, very fast ETC and S3 texture compression support. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 0.7Configuration: DXT1GCC 12.0.0 20210701GCC 8.5GCC 9.4GCC 11.1GCC 10.330060090012001500SE +/- 1.30, N = 3SE +/- 1.51, N = 3SE +/- 0.45, N = 3SE +/- 0.47, N = 3SE +/- 0.37, N = 31419.371445.241450.561468.971484.231. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

Stockfish

This is a test of Stockfish, an advanced open-source C++11 chess benchmark that can scale up to 512 CPU threads. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 13Total TimeGCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 8.5GCC 11.111M22M33M44M55MSE +/- 623930.99, N = 3SE +/- 508293.85, N = 15SE +/- 432778.20, N = 8SE +/- 562135.06, N = 15SE +/- 211973.29, N = 349942276506225525073457151140013522069631. (CXX) g++ options: -lgcov -m64 -lpthread -O3 -march=native -fno-exceptions -std=c++17 -pedantic -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -fprofile-use -fno-peel-loops -fno-tracer -flto=jobserver

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUGCC 9.4GCC 8.5GCC 11.1GCC 10.3GCC 12.0.0 202107010.2880.5760.8641.1521.44SE +/- 0.00348, N = 3SE +/- 0.00683, N = 3SE +/- 0.00400, N = 3SE +/- 0.00554, N = 3SE +/- 0.00255, N = 31.279911.232391.230121.227031.22496MIN: 1.23MIN: 1.18MIN: 1.19MIN: 1.18MIN: 1.181. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_224GCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 10.3GCC 9.40.84471.68942.53413.37884.2235SE +/- 0.018, N = 3SE +/- 0.058, N = 3SE +/- 0.069, N = 3SE +/- 0.090, N = 3SE +/- 0.040, N = 153.7543.7293.7043.6693.594MIN: 3.47 / MAX: 3.95MIN: 3.41 / MAX: 3.94MIN: 3.31 / MAX: 3.95MIN: 3.42 / MAX: 4.19MIN: 3.07 / MAX: 4.081. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8, Long Mode - Decompression SpeedGCC 10.3GCC 12.0.0 20210701GCC 8.5GCC 11.1GCC 9.48001600240032004000SE +/- 3.49, N = 15SE +/- 3.04, N = 15SE +/- 5.55, N = 3SE +/- 3.35, N = 3SE +/- 2.52, N = 133479.03531.43547.43553.23628.41. (CC) gcc options: -O3 -march=native -pthread -lz

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: VMAF Optimized - Input: Bosphorus 1080pGCC 12.0.0 20210701GCC 9.4GCC 11.1GCC 10.3GCC 8.570140210280350SE +/- 3.01, N = 5SE +/- 4.16, N = 3SE +/- 2.83, N = 6SE +/- 1.76, N = 14SE +/- 2.56, N = 13293.71295.07297.32299.97306.081. (CC) gcc options: -O3 -fcommon -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet50GCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 20210701GCC 9.4510152025SE +/- 0.30, N = 3SE +/- 0.29, N = 3SE +/- 0.24, N = 3SE +/- 0.24, N = 3SE +/- 0.29, N = 318.3317.8717.7717.7417.59MIN: 17.58 / MAX: 24.57MIN: 17.16 / MAX: 18.62MIN: 17.07 / MAX: 28.68MIN: 17.09 / MAX: 18.96MIN: 17.07 / MAX: 18.691. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-GaussianGCC 9.4GCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 2021070190180270360450SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 33873904034034031. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 36 - Buffer Length: 256 - Filter Length: 57GCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 10.3GCC 11.1200M400M600M800M1000MSE +/- 120554.28, N = 3SE +/- 588132.64, N = 3SE +/- 1056729.76, N = 3SE +/- 272213.15, N = 3SE +/- 1013283.99, N = 39167900009216700009375533339406600009545366671. (CC) gcc options: -O3 -march=native -pthread -lm -lc -lliquid

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v3GCC 8.5GCC 11.1GCC 10.3GCC 9.4GCC 12.0.0 202107011.0622.1243.1864.2485.31SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 34.724.664.644.574.54MIN: 4.49 / MAX: 7.39MIN: 4.46 / MAX: 12.92MIN: 4.36 / MAX: 10.01MIN: 4.37 / MAX: 9.05MIN: 4.37 / MAX: 11.471. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.0GCC 11.1GCC 10.3GCC 8.5GCC 9.4GCC 12.0.0 202107011.28772.57543.86315.15086.4385SE +/- 0.020, N = 3SE +/- 0.083, N = 3SE +/- 0.056, N = 3SE +/- 0.039, N = 15SE +/- 0.079, N = 35.7235.6125.5945.5405.506MIN: 5.47 / MAX: 6.72MIN: 5.24 / MAX: 6.01MIN: 5.4 / MAX: 5.85MIN: 5.06 / MAX: 6.72MIN: 5.22 / MAX: 5.911. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Crypto++

Crypto++ is a C++ class library of cryptographic algorithms. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Keyed AlgorithmsGCC 11.1GCC 12.0.0 20210701GCC 8.5GCC 10.3GCC 9.4160320480640800SE +/- 0.20, N = 3SE +/- 0.24, N = 3SE +/- 0.10, N = 3SE +/- 0.48, N = 3SE +/- 0.35, N = 3692.99714.21714.49717.17719.761. (CXX) g++ options: -O3 -march=native -fPIC -pthread -pipe

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Lossless, Highest CompressionGCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 9.4GCC 11.1918273645SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.00, N = 337.8737.7037.1636.8736.471. (CC) gcc options: -fvisibility=hidden -O3 -march=native -pthread -lm -ljpeg -lpng16

dav1d

Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.0Video Input: Chimera 1080p 10-bitGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 10.3GCC 11.150100150200250SE +/- 0.39, N = 3SE +/- 0.34, N = 3SE +/- 0.48, N = 3SE +/- 0.50, N = 3SE +/- 1.18, N = 3215.16219.69221.94222.27223.06-lm - MIN: 151.62 / MAX: 411.26-lm - MIN: 156.35 / MAX: 406.23MIN: 157.38 / MAX: 404.98MIN: 157.09 / MAX: 436.51MIN: 157.45 / MAX: 397.961. (CC) gcc options: -O3 -march=native -pthread

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssdGCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 9.448121620SE +/- 0.36, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 315.6315.2815.2615.2315.08MIN: 15.02 / MAX: 16.85MIN: 14.89 / MAX: 16.1MIN: 14.97 / MAX: 18.92MIN: 14.88 / MAX: 17.07MIN: 14.88 / MAX: 21.621. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

x265

This is a simple test of the x265 encoder run on the CPU with 1080p and 4K options for H.265 video encode performance with x265. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4KGCC 12.0.0 20210701GCC 11.1GCC 8.5GCC 9.4GCC 10.3510152025SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 321.0821.1621.5321.6421.841. (CXX) g++ options: -O3 -march=native -rdynamic -lpthread -lrt -ldl -lnuma

dav1d

Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterdav1d 0.9.0Video Input: Summer Nature 4KGCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 8.5GCC 9.44080120160200SE +/- 1.13, N = 3SE +/- 1.97, N = 6SE +/- 2.16, N = 3SE +/- 0.89, N = 3SE +/- 1.65, N = 3192.95194.06195.15197.46199.89MIN: 132.83 / MAX: 217.9MIN: 131.48 / MAX: 225.93MIN: 149.2 / MAX: 222.59-lm - MIN: 150.4 / MAX: 226.05-lm - MIN: 143.79 / MAX: 228.441. (CC) gcc options: -O3 -march=native -pthread

VP9 libvpx Encoding

This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9 video format. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.10.0Speed: Speed 0 - Input: Bosphorus 4KGCC 8.5GCC 10.3GCC 9.4GCC 11.1GCC 12.0.0 202107011.1072.2143.3214.4285.535SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 34.754.844.874.874.921. (CXX) g++ options: -m64 -lm -lpthread -O3 -march=native -fPIC -U_FORTIFY_SOURCE -std=gnu++11

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sAXPYGCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 9.41632486480SE +/- 1.48, N = 3SE +/- 0.35, N = 3SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.12, N = 368.870.170.370.771.21. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1GCC 9.4GCC 8.5GCC 11.1GCC 12.0.0 20210701GCC 10.360120180240300SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.63, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3296.14289.96288.91287.49286.22MIN: 294.66 / MAX: 298.56MIN: 288.43 / MAX: 291.61MIN: 286.05 / MAX: 294.45MIN: 285.88 / MAX: 299.62MIN: 285.02 / MAX: 287.821. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KGCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 8.5GCC 10.31.0082.0163.0244.0325.04SE +/- 0.04, N = 3SE +/- 0.03, N = 10SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 34.334.404.444.464.481. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KGCC 8.5GCC 9.4GCC 10.3GCC 11.1GCC 12.0.0 20210701714212835SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 327.1827.2427.8628.0728.101. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400mGCC 11.1GCC 9.4GCC 8.5GCC 10.3GCC 12.0.0 2021070148121620SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 313.9313.8713.7713.6313.48MIN: 13.17 / MAX: 14.48MIN: 13.18 / MAX: 15.01MIN: 12.93 / MAX: 14.62MIN: 13.01 / MAX: 14.57MIN: 13.11 / MAX: 14.041. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Etcpak

Etcpack is the self-proclaimed "fastest ETC compressor on the planet" with focused on providing open-source, very fast ETC and S3 texture compression support. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 0.7Configuration: ETC1 + DitheringGCC 12.0.0 20210701GCC 11.1GCC 8.5GCC 10.3GCC 9.470140210280350SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 2.72, N = 3SE +/- 0.38, N = 3SE +/- 0.09, N = 3325.28327.33329.13329.49336.111. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-NGCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 9.41632486480SE +/- 0.12, N = 3SE +/- 0.31, N = 3SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 369.571.471.671.771.81. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Opus Codec Encoding

Opus is an open audio codec. Opus is a lossy audio compression format designed primarily for interactive real-time applications over the Internet. This test uses Opus-Tools and measures the time required to encode a WAV file to Opus. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.3.1WAV To Opus EncodeGCC 11.1GCC 10.3GCC 8.5GCC 9.4GCC 12.0.0 20210701246810SE +/- 0.013, N = 5SE +/- 0.031, N = 5SE +/- 0.011, N = 5SE +/- 0.021, N = 5SE +/- 0.011, N = 58.4568.2838.2838.2418.1861. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 8 - Compression SpeedGCC 11.1GCC 10.3GCC 8.5GCC 9.4GCC 12.0.0 2021070190180270360450SE +/- 5.64, N = 3SE +/- 4.87, N = 3SE +/- 4.99, N = 3SE +/- 4.23, N = 5SE +/- 5.56, N = 3419.5424.0425.7429.4432.71. (CC) gcc options: -O3 -march=native -pthread -lz

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 9.40.66351.3271.99052.6543.3175SE +/- 0.01360, N = 3SE +/- 0.01797, N = 3SE +/- 0.01261, N = 3SE +/- 0.01584, N = 3SE +/- 0.01601, N = 32.949032.946702.939782.934282.86008MIN: 2.85MIN: 2.84MIN: 2.83MIN: 2.83MIN: 2.771. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Tachyon

This is a test of the threaded Tachyon, a parallel ray-tracing system, measuring the time to ray-trace a sample scene. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTachyon 0.99b6Total TimeGCC 12.0.0 20210701GCC 8.5GCC 10.3GCC 9.4GCC 11.11122334455SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.26, N = 349.3248.1647.9047.8847.871. (CC) gcc options: -m64 -O3 -fomit-frame-pointer -ffast-math -ltachyon -lm -lpthread

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 32 - Buffer Length: 256 - Filter Length: 57GCC 8.5GCC 9.4GCC 10.3GCC 12.0.0 20210701GCC 11.1200M400M600M800M1000MSE +/- 353836.12, N = 3SE +/- 539269.05, N = 3SE +/- 2904171.33, N = 3SE +/- 4623189.13, N = 3SE +/- 4781007.56, N = 39246300009302366679397166679444333339511700001. (CC) gcc options: -O3 -march=native -pthread -lm -lc -lliquid

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080pGCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 8.570140210280350SE +/- 1.42, N = 3SE +/- 0.68, N = 3SE +/- 2.35, N = 3SE +/- 1.79, N = 3SE +/- 0.21, N = 3302.25303.54305.72306.89310.791. (CC) gcc options: -O3 -fcommon -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUGCC 9.4GCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 202107012004006008001000SE +/- 1.46, N = 3SE +/- 1.32, N = 3SE +/- 0.16, N = 3SE +/- 0.70, N = 3SE +/- 0.15, N = 3961.38939.92938.22936.88935.38MIN: 955.17MIN: 933.27MIN: 930.52MIN: 931.54MIN: 931.251. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazefaceGCC 10.3GCC 8.5GCC 11.1GCC 12.0.0 20210701GCC 9.40.58731.17461.76192.34922.9365SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 32.612.562.552.542.54MIN: 2.47 / MAX: 3.3MIN: 2.5 / MAX: 3.31MIN: 2.47 / MAX: 3.17MIN: 2.46 / MAX: 3.12MIN: 2.45 / MAX: 3.321. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenetGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 10.3GCC 11.148121620SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 314.1613.9413.8113.8113.79MIN: 13.93 / MAX: 14.76MIN: 13.68 / MAX: 22.27MIN: 13.64 / MAX: 14.54MIN: 13.51 / MAX: 20.36MIN: 13.61 / MAX: 14.231. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUGCC 9.4GCC 8.5GCC 11.1GCC 10.3GCC 12.0.0 202107010.40310.80621.20931.61242.0155SE +/- 0.00782, N = 3SE +/- 0.00719, N = 3SE +/- 0.00508, N = 3SE +/- 0.00494, N = 3SE +/- 0.00613, N = 31.791501.763081.762641.755201.74471MIN: 1.74MIN: 1.7MIN: 1.69MIN: 1.69MIN: 1.661. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, LosslessGCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 9.4GCC 11.148121620SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 317.2517.2016.8916.8216.801. (CC) gcc options: -fvisibility=hidden -O3 -march=native -pthread -lm -ljpeg -lpng16

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sCOPYGCC 8.5GCC 10.3GCC 12.0.0 20210701GCC 11.1GCC 9.41122334455SE +/- 0.27, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.17, N = 345.946.446.446.747.11. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUGCC 9.4GCC 11.1GCC 8.5GCC 12.0.0 20210701GCC 10.32004006008001000SE +/- 0.63, N = 3SE +/- 0.60, N = 3SE +/- 0.50, N = 3SE +/- 0.46, N = 3SE +/- 0.69, N = 3960.13938.04937.61936.49935.96MIN: 955.07MIN: 933.04MIN: 932.91MIN: 932.18MIN: 930.61. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Timed HMMer Search

This test searches through the Pfam database of profile hidden markov models. The search finds the domain structure of Drosophila Sevenless protein. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.2Pfam Database SearchGCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 9.4GCC 8.5306090120150SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3129.45126.69126.62126.51126.201. (CC) gcc options: -O3 -march=native -pthread -lhmmer -leasel -lm -lmpi

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMIGCC 10.3GCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 11.120406080100SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3SE +/- 0.07, N = 398.2099.72100.41100.61100.701. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Ngspice

Ngspice is an open-source SPICE circuit simulator. Ngspice was originally based on the Berkeley SPICE electronic circuit simulator. Ngspice supports basic threading using OpenMP. This test profile is making use of the ISCAS 85 benchmark circuits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNgspice 34Circuit: C7552GCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 10.3GCC 8.5306090120150SE +/- 0.26, N = 3SE +/- 1.05, N = 3SE +/- 1.54, N = 3SE +/- 1.51, N = 3SE +/- 1.35, N = 3129.40128.32127.69126.88126.201. (CC) gcc options: -O3 -march=native -fopenmp -lm -lfftw3 -lXaw -lXmu -lXt -lXext -lX11 -lSM -lICE

LAME MP3 Encoding

LAME is an MP3 encoder licensed under the LGPL. This test measures the time required to encode a WAV file to MP3 format. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100WAV To MP3GCC 11.1GCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 9.4246810SE +/- 0.005, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.011, N = 38.7328.7308.7168.5998.5251. (CC) gcc options: -O3 -ffast-math -funroll-loops -fschedule-insns2 -fbranch-count-reg -fforce-addr -pipe -march=native -lm

7-Zip Compression

This is a test of 7-Zip using p7zip with its integrated benchmark feature or upstream 7-Zip for the Windows x64 build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 16.02Compress Speed TestGCC 10.3GCC 11.1GCC 9.4GCC 12.0.0 20210701GCC 8.520K40K60K80K100KSE +/- 46.23, N = 3SE +/- 304.44, N = 3SE +/- 343.09, N = 3SE +/- 228.39, N = 3SE +/- 69.57, N = 397426981499829898493997111. (CXX) g++ options: -pipe -lpthread

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Compression SpeedGCC 8.5GCC 9.4GCC 10.3GCC 12.0.0 20210701GCC 11.11020304050SE +/- 0.15, N = 3SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 343.343.543.943.944.31. (CC) gcc options: -O3 -march=native -pthread -lz

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUGCC 9.4GCC 11.1GCC 10.3GCC 8.5GCC 12.0.0 202107013691215SE +/- 0.01517, N = 3SE +/- 0.01164, N = 3SE +/- 0.01276, N = 3SE +/- 0.01311, N = 3SE +/- 0.00808, N = 39.554559.355509.350959.347669.34206MIN: 9.5MIN: 9.29MIN: 9.29MIN: 9.29MIN: 9.281. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

Etcpak

Etcpack is the self-proclaimed "fastest ETC compressor on the planet" with focused on providing open-source, very fast ETC and S3 texture compression support. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 0.7Configuration: ETC2GCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 8.5GCC 9.44080120160200SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3194.76197.13197.63198.11199.101. (CXX) g++ options: -O3 -march=native -std=c++11 -lpthread

PJSIP

PJSIP is a free and open source multimedia communication library written in C language implementing standard based protocols such as SIP, SDP, RTP, STUN, TURN, and ICE. It combines signaling protocol (SIP) with rich multimedia framework and NAT traversal functionality into high level API that is portable and suitable for almost any type of systems ranging from desktops, embedded systems, to mobile handsets. This test profile is making use of pjsip-perf with both the client/server on teh system. More details on the PJSIP benchmark at https://www.pjsip.org/high-performance-sip.htm Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: OPTIONS, StatelessGCC 8.5GCC 9.4GCC 11.1GCC 12.0.0 20210701GCC 10.330K60K90K120K150KSE +/- 578.10, N = 3SE +/- 1635.40, N = 4SE +/- 946.90, N = 3SE +/- 734.59, N = 3SE +/- 1006.09, N = 31353021359031364441379661382221. (CC) gcc options: -lstdc++ -lssl -lcrypto -lm -lrt -lpthread -O3 -march=native

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnetGCC 10.3GCC 9.4GCC 11.1GCC 8.5GCC 12.0.0 202107013691215SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 39.189.159.089.058.99MIN: 9.11 / MAX: 9.74MIN: 9.08 / MAX: 9.59MIN: 9 / MAX: 11.81MIN: 8.96 / MAX: 19.48MIN: 8.73 / MAX: 9.391. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

PJSIP

PJSIP is a free and open source multimedia communication library written in C language implementing standard based protocols such as SIP, SDP, RTP, STUN, TURN, and ICE. It combines signaling protocol (SIP) with rich multimedia framework and NAT traversal functionality into high level API that is portable and suitable for almost any type of systems ranging from desktops, embedded systems, to mobile handsets. This test profile is making use of pjsip-perf with both the client/server on teh system. More details on the PJSIP benchmark at https://www.pjsip.org/high-performance-sip.htm Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: INVITEGCC 11.1GCC 9.4GCC 10.3GCC 12.0.0 20210701GCC 8.57001400210028003500SE +/- 7.22, N = 3SE +/- 27.02, N = 3SE +/- 6.36, N = 3SE +/- 25.40, N = 15SE +/- 25.16, N = 15324032523281330433071. (CC) gcc options: -lstdc++ -lssl -lcrypto -lm -lrt -lpthread -O3 -march=native

C-Ray

This is a test of C-Ray, a simple raytracer designed to test the floating-point CPU performance. This test is multi-threaded (16 threads per core), will shoot 8 rays per pixel for anti-aliasing, and will generate a 1600 x 1200 image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelGCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 8.5714212835SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 330.4330.0429.9729.9629.821. (CC) gcc options: -lm -lpthread -O3 -march=native

VOSK Speech Recognition Toolkit

VOSK is an open-source offline speech recognition API/toolkit. VOSK supports speech recognition in 17 languages and has a variety of models available and interfaces for different programming languages. This test profile times the speech-to-text process for a roughly three minute audio recording. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterVOSK Speech Recognition Toolkit 0.3.21GCC 9.4GCC 11.1GCC 10.3GCC 8.5GCC 12.0.0 20210701510152025SE +/- 0.13, N = 3SE +/- 0.26, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.07, N = 320.9920.8920.7520.7220.57

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KGCC 10.3GCC 9.4GCC 8.5GCC 11.1GCC 12.0.0 20210701510152025SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 319.2819.3419.4019.6419.671. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: KASUMI - DecryptGCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 8.5GCC 9.420406080100SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 396.6196.8897.0097.6498.561. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

Himeno Benchmark

The Himeno benchmark is a linear solver of pressure Poisson using a point-Jacobi method. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterHimeno Benchmark 3.0Poisson Pressure SolverGCC 8.5GCC 10.3GCC 12.0.0 20210701GCC 11.1GCC 9.410002000300040005000SE +/- 0.61, N = 3SE +/- 13.08, N = 3SE +/- 2.82, N = 3SE +/- 0.64, N = 3SE +/- 5.70, N = 34522.734538.664580.194592.954609.401. (CC) gcc options: -O3 -march=native -mavx2

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg16GCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 8.5GCC 9.4816243240SE +/- 0.53, N = 3SE +/- 0.52, N = 3SE +/- 0.47, N = 3SE +/- 0.37, N = 3SE +/- 0.49, N = 336.7036.5636.3536.2036.01MIN: 35.5 / MAX: 41.99MIN: 35.42 / MAX: 58.41MIN: 35.3 / MAX: 37.7MIN: 35.36 / MAX: 47.25MIN: 35.37 / MAX: 37.681. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

SecureMark

SecureMark is an objective, standardized benchmarking framework for measuring the efficiency of cryptographic processing solutions developed by EEMBC. SecureMark-TLS is benchmarking Transport Layer Security performance with a focus on IoT/edge computing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSGCC 11.1GCC 8.5GCC 9.4GCC 10.3GCC 12.0.0 2021070160K120K180K240K300KSE +/- 68.80, N = 3SE +/- 106.27, N = 3SE +/- 247.29, N = 3SE +/- 95.66, N = 3SE +/- 101.43, N = 32595652598692634572634722645141. (CC) gcc options: -pedantic -O3

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: EnhancedGCC 8.5GCC 9.4GCC 10.3GCC 12.0.0 20210701GCC 11.1901802703604504244244274294321. (CC) gcc options: -fopenmp -O3 -march=native -pthread -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lz -lm -lpthread

C-Blosc

A simple, compressed, fast and persistent data store library for C. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.0Compressor: blosclzGCC 10.3GCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 11.13K6K9K12K15KSE +/- 21.15, N = 3SE +/- 11.42, N = 3SE +/- 18.15, N = 3SE +/- 37.20, N = 3SE +/- 69.56, N = 311713.411800.711802.611889.411926.81. (CC) gcc options: -std=gnu99 -O3 -pthread -lrt -lm

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.0GCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 9.4GCC 8.50.55731.11461.67192.22922.7865SE +/- 0.029, N = 3SE +/- 0.024, N = 3SE +/- 0.025, N = 3SE +/- 0.012, N = 15SE +/- 0.025, N = 32.4772.4772.4672.4552.433MIN: 2.3 / MAX: 2.74MIN: 2.3 / MAX: 2.65MIN: 2.32 / MAX: 2.68MIN: 2.23 / MAX: 3.16MIN: 2.32 / MAX: 2.621. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.1Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4KGCC 10.3GCC 9.4GCC 12.0.0 20210701GCC 8.5GCC 11.1246810SE +/- 0.04, N = 3SE +/- 0.08, N = 15SE +/- 0.08, N = 12SE +/- 0.05, N = 3SE +/- 0.04, N = 37.387.437.497.517.511. (CXX) g++ options: -O3 -march=native -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

Crypto++

Crypto++ is a C++ class library of cryptographic algorithms. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Integer + Elliptic Curve Public Key AlgorithmsGCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 9.4GCC 11.112002400360048006000SE +/- 1.85, N = 3SE +/- 1.33, N = 3SE +/- 5.19, N = 3SE +/- 6.16, N = 3SE +/- 1.99, N = 35503.085519.145532.475538.555593.131. (CXX) g++ options: -O3 -march=native -fPIC -pthread -pipe

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 1080pGCC 9.4GCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 8.550100150200250SE +/- 1.22, N = 3SE +/- 3.10, N = 3SE +/- 1.58, N = 3SE +/- 3.33, N = 3SE +/- 1.34, N = 3243.48244.05244.56246.75247.451. (CC) gcc options: -O3 -fcommon -march=native -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

Kvazaar

This is a test of Kvazaar as a CPU-based H.265 video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Very FastGCC 11.1GCC 10.3GCC 12.0.0 20210701GCC 9.4GCC 8.5510152025SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 321.0121.0921.1521.2021.351. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O3 -march=native -lpthread -lm -lrt

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v2GCC 11.1GCC 8.5GCC 10.3GCC 12.0.0 20210701GCC 9.41.13632.27263.40894.54525.6815SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 35.055.055.024.984.97MIN: 4.88 / MAX: 9.37MIN: 4.83 / MAX: 14.14MIN: 4.83 / MAX: 15.94MIN: 4.88 / MAX: 8.6MIN: 4.8 / MAX: 8.91. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

SQLite Speedtest

This is a benchmark of SQLite's speedtest1 benchmark program with an increased problem size of 1,000. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,000GCC 8.5GCC 11.1GCC 10.3GCC 9.4GCC 12.0.0 202107011326395265SE +/- 0.22, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 357.6157.4157.3057.0356.721. (CC) gcc options: -O3 -march=native -ldl -lz -lpthread

FLAC Audio Encoding

This test times how long it takes to encode a sample WAV file to FLAC format five times. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.2WAV To FLACGCC 9.4GCC 8.5GCC 11.1GCC 12.0.0 20210701GCC 10.3246810SE +/- 0.006, N = 5SE +/- 0.012, N = 5SE +/- 0.009, N = 5SE +/- 0.014, N = 5SE +/- 0.004, N = 58.5008.4368.4118.3798.3691. (CXX) g++ options: -O3 -march=native -fvisibility=hidden -logg -lm

Zstd Compression

This test measures the time needed to compress/decompress a sample file (a FreeBSD disk image - FreeBSD-12.2-RELEASE-amd64-memstick.img) using Zstd compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Compression SpeedGCC 10.3GCC 9.4GCC 8.5GCC 12.0.0 20210701GCC 11.11428425670SE +/- 0.56, N = 3SE +/- 0.50, N = 3SE +/- 0.19, N = 3SE +/- 0.47, N = 3SE +/- 0.50, N = 960.160.260.360.861.01. (CC) gcc options: -O3 -march=native -pthread -lz

libjpeg-turbo tjbench

tjbench is a JPEG decompression/compression benchmark that is part of libjpeg-turbo, a JPEG image codec library optimized for SIMD instructions on modern CPU architectures. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMegapixels/sec, More Is Betterlibjpeg-turbo tjbench 2.1.0Test: Decompression ThroughputGCC 12.0.0 20210701GCC 11.1GCC 8.5GCC 10.3GCC 9.450100150200250SE +/- 0.26, N = 3SE +/- 0.47, N = 3SE +/- 0.03, N = 3SE +/- 0.30, N = 3SE +/- 0.84, N = 3217.43218.62218.81219.54220.621. (CC) gcc options: -O3 -march=native -rdynamic

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8.7Encoder Mode: Preset 4 - Input: Bosphorus 4KGCC 8.5GCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 10.30.30580.61160.91741.22321.529SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 31.3401.3471.3481.3551.3591. (CXX) g++ options: -O3 -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq -pie

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 0.8.7Encoder Mode: Preset 8 - Input: Bosphorus 4KGCC 8.5GCC 12.0.0 20210701GCC 9.4GCC 10.3GCC 11.13691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 311.9311.9712.0212.0612.091. (CXX) g++ options: -O3 -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq -pie

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - sDOTGCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 11.1GCC 9.420406080100SE +/- 0.42, N = 3SE +/- 0.49, N = 3SE +/- 0.33, N = 3SE +/- 0.43, N = 3SE +/- 0.26, N = 377.077.177.477.678.01. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Kvazaar

This is a test of Kvazaar as a CPU-based H.265 video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Ultra FastGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.3918273645SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 340.1340.1640.2040.3140.641. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O3 -march=native -lpthread -lm -lrt

PJSIP

PJSIP is a free and open source multimedia communication library written in C language implementing standard based protocols such as SIP, SDP, RTP, STUN, TURN, and ICE. It combines signaling protocol (SIP) with rich multimedia framework and NAT traversal functionality into high level API that is portable and suitable for almost any type of systems ranging from desktops, embedded systems, to mobile handsets. This test profile is making use of pjsip-perf with both the client/server on teh system. More details on the PJSIP benchmark at https://www.pjsip.org/high-performance-sip.htm Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgResponses Per Second, More Is BetterPJSIP 2.11Method: OPTIONS, StatefulGCC 9.4GCC 10.3GCC 12.0.0 20210701GCC 11.1GCC 8.512002400360048006000SE +/- 24.67, N = 3SE +/- 8.67, N = 3SE +/- 23.13, N = 3SE +/- 53.69, N = 3SE +/- 16.26, N = 3572957445763576958011. (CC) gcc options: -lstdc++ -lssl -lcrypto -lm -lrt -lpthread -O3 -march=native

SVT-HEVC

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC / H.265 video format with a sample 1080p YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 1 - Input: Bosphorus 1080pGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.33691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 312.8812.9112.9412.9613.041. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

Ngspice

Ngspice is an open-source SPICE circuit simulator. Ngspice was originally based on the Berkeley SPICE electronic circuit simulator. Ngspice supports basic threading using OpenMP. This test profile is making use of the ISCAS 85 benchmark circuits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNgspice 34Circuit: C2670GCC 12.0.0 20210701GCC 11.1GCC 8.5GCC 9.4GCC 10.3306090120150SE +/- 0.83, N = 3SE +/- 0.92, N = 3SE +/- 0.81, N = 3SE +/- 0.71, N = 3SE +/- 1.13, N = 3135.43134.71134.35134.22133.911. (CC) gcc options: -O3 -march=native -fopenmp -lm -lfftw3 -lXaw -lXmu -lXt -lXext -lX11 -lSM -lICE

SVT-HEVC

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC / H.265 video format with a sample 1080p YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 10 - Input: Bosphorus 1080pGCC 10.3GCC 8.5GCC 12.0.0 20210701GCC 11.1GCC 9.480160240320400SE +/- 1.74, N = 3SE +/- 0.95, N = 3SE +/- 0.75, N = 3SE +/- 1.99, N = 3SE +/- 0.96, N = 3372.69374.62375.32375.65376.891. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUGCC 9.4GCC 11.1GCC 8.5GCC 12.0.0 20210701GCC 10.31.25892.51783.77675.03566.2945SE +/- 0.02285, N = 3SE +/- 0.02335, N = 3SE +/- 0.02371, N = 3SE +/- 0.02089, N = 3SE +/- 0.01959, N = 35.595335.545445.540625.536725.53334MIN: 5.45MIN: 5.4MIN: 5.4MIN: 5.38MIN: 5.381. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.33691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 311.0210.9610.9310.9210.92MIN: 10.79MIN: 10.74MIN: 10.77MIN: 10.74MIN: 10.741. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

SVT-HEVC

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC / H.265 video format with a sample 1080p YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 7 - Input: Bosphorus 1080pGCC 10.3GCC 8.5GCC 9.4GCC 11.1GCC 12.0.0 202107014080120160200SE +/- 0.44, N = 3SE +/- 0.58, N = 3SE +/- 0.18, N = 3SE +/- 0.31, N = 3SE +/- 0.32, N = 3189.88190.03190.62191.02191.331. (CC) gcc options: -O3 -march=native -fPIE -fPIC -O2 -pie -rdynamic -lpthread -lrt

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dGEMV-TGCC 11.1GCC 12.0.0 20210701GCC 10.3GCC 9.4GCC 8.520406080100SE +/- 0.38, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.25, N = 379.379.579.679.779.91. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256GCC 12.0.0 20210701GCC 11.1GCC 9.4GCC 8.5GCC 10.39001800270036004500SE +/- 7.30, N = 3SE +/- 2.67, N = 3SE +/- 0.82, N = 3SE +/- 0.87, N = 3SE +/- 4.08, N = 33972.023985.273987.083998.633999.251. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

GnuPG

This test times how long it takes to encrypt a sample file using GnuPG. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 2.2.272.7GB Sample File EncryptionGCC 12.0.0 20210701GCC 10.3GCC 8.5GCC 9.4GCC 11.11428425670SE +/- 0.56, N = 3SE +/- 0.36, N = 3SE +/- 0.17, N = 3SE +/- 0.19, N = 3SE +/- 0.23, N = 364.6164.4264.2464.2364.201. (CC) gcc options: -O3 -march=native

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNetGCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 8.58001600240032004000SE +/- 2.55, N = 3SE +/- 0.21, N = 3SE +/- 0.77, N = 3SE +/- 0.59, N = 3SE +/- 0.16, N = 33527.683524.753508.393508.293505.93MIN: 3508.67 / MAX: 3981.67MIN: 3509.67 / MAX: 3548.51MIN: 3486.98 / MAX: 3606.8MIN: 3489.27 / MAX: 3603.98MIN: 3487.54 / MAX: 3535.341. (CXX) g++ options: -O3 -march=native -fopenmp -pthread -fvisibility=hidden -fvisibility=default -rdynamic -ldl

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dAXPYGCC 8.5GCC 12.0.0 20210701GCC 10.3GCC 9.4GCC 11.11326395265SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 357.157.257.357.457.41. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dCOPYGCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 10.3GCC 11.1918273645SE +/- 0.00, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 338.138.138.238.338.31. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 11.1GCC 12.0.0 20210701GCC 9.4GCC 10.30.11890.23780.35670.47560.5945SE +/- 0.003001, N = 3SE +/- 0.003036, N = 3SE +/- 0.003225, N = 3SE +/- 0.003361, N = 3SE +/- 0.003324, N = 30.5284160.5281330.5279390.5267980.526014MIN: 0.5MIN: 0.5MIN: 0.5MIN: 0.5MIN: 0.51. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUGCC 8.5GCC 10.3GCC 11.1GCC 12.0.0 20210701GCC 9.40.10380.20760.31140.41520.519SE +/- 0.000631, N = 3SE +/- 0.001585, N = 3SE +/- 0.000687, N = 3SE +/- 0.001427, N = 3SE +/- 0.001062, N = 30.4614590.4604820.4599560.4596600.459456MIN: 0.45MIN: 0.45MIN: 0.45MIN: 0.45MIN: 0.451. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

WavPack Audio Encoding

This test times how long it takes to encode a sample WAV file to WavPack format with very high quality settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3WAV To WavPackGCC 9.4GCC 8.5GCC 11.1GCC 10.3GCC 12.0.0 202107013691215SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 0.02, N = 5SE +/- 0.00, N = 513.3813.3613.3513.3413.331. (CXX) g++ options: -O3 -march=native -rdynamic

Botan

Botan is a BSD-licensed cross-platform open-source C++ crypto library "cryptography toolkit" that supports most publicly known cryptographic algorithms. The project's stated goal is to be "the best option for cryptography in C++ by offering the tools necessary to implement a range of practical systems, such as TLS protocol, X.509 certificates, modern AEAD ciphers, PKCS#11 and TPM hardware support, password hashing, and post quantum crypto schemes." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMiB/s, More Is BetterBotan 2.17.3Test: AES-256 - DecryptGCC 8.5GCC 12.0.0 20210701GCC 9.4GCC 11.1GCC 10.39001800270036004500SE +/- 1.28, N = 3SE +/- 4.17, N = 3SE +/- 0.39, N = 3SE +/- 0.79, N = 3SE +/- 0.87, N = 33991.203993.173993.893995.233998.481. (CXX) g++ options: -fstack-protector -m64 -pthread -lbotan-2 -ldl -lrt

libgav1

Libgav1 is an AV1 decoder developed by Google for AV1 profile 0/1 compliance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is Betterlibgav1 0.16.3Video Input: Chimera 1080p 10-bitGCC 12.0.0 20210701510152025SE +/- 0.01, N = 321.321. (CXX) g++ options: -O3 -march=native -lpthread -lrt

OpenBenchmarking.orgFPS, More Is Betterlibgav1 0.16.3Video Input: Summer Nature 4KGCC 12.0.0 20210701714212835SE +/- 0.01, N = 328.241. (CXX) g++ options: -O3 -march=native -lpthread -lrt

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tinyGCC 12.0.0 20210701GCC 11.1GCC 9.4GCC 10.3GCC 8.5510152025SE +/- 1.86, N = 3SE +/- 0.10, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.25, N = 322.8321.3721.3521.2620.84MIN: 20.18 / MAX: 937.4MIN: 20.44 / MAX: 22.72MIN: 20.42 / MAX: 33.9MIN: 20 / MAX: 24.4MIN: 19.92 / MAX: 24.911. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.1GCC 11.1GCC 8.5GCC 9.4GCC 12.0.0 20210701GCC 10.31.0372.0743.1114.1485.185SE +/- 0.007, N = 3SE +/- 0.036, N = 3SE +/- 0.061, N = 15SE +/- 0.149, N = 3SE +/- 0.162, N = 34.6094.5644.4204.2834.271MIN: 4.51 / MAX: 4.78MIN: 4.42 / MAX: 4.75MIN: 3.98 / MAX: 4.76MIN: 3.97 / MAX: 4.71MIN: 3.97 / MAX: 4.721. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

ViennaCL

ViennaCL is an open-source linear algebra library written in C++ and with support for OpenCL and OpenMP. This test profile makes use of ViennaCL's built-in benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGB/s, More Is BetterViennaCL 1.7.1Test: CPU BLAS - dDOTGCC 10.3GCC 8.5GCC 9.4GCC 11.1GCC 12.0.0 202107011428425670SE +/- 9.10, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 354.763.663.763.763.71. (CXX) g++ options: -O3 -march=native -fopenmp -rdynamic -lOpenCL

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.1.2Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUGCC 9.4GCC 12.0.0 20210701GCC 11.1GCC 10.3GCC 8.5246810SE +/- 0.17046, N = 14SE +/- 0.03413, N = 3SE +/- 0.03513, N = 3SE +/- 0.03159, N = 3SE +/- 0.02602, N = 38.100387.912587.904777.901637.89032MIN: 7.58MIN: 7.63MIN: 7.56MIN: 7.61MIN: 7.581. (CXX) g++ options: -O3 -march=native -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

142 Results Shown

GraphicsMagick
FinanceBench
Zstd Compression
eSpeak-NG Speech Engine
Botan:
  ChaCha20Poly1305
  ChaCha20Poly1305 - Decrypt
FinanceBench
GraphicsMagick
oneDNN
Smallpt
Mobile Neural Network
ViennaCL
Botan
ViennaCL:
  CPU BLAS - dGEMM-TN
  CPU BLAS - dGEMM-NT
  CPU BLAS - dGEMM-TT
Botan
GraphicsMagick
TNN
GraphicsMagick
Botan
Timed MrBayes Analysis
oneDNN
Botan
QuantLib
NCNN
Coremark
Zstd Compression
Botan:
  CAST-256 - Decrypt
  CAST-256
Gcrypt Library
Mobile Neural Network
NCNN
TNN
NCNN
Zstd Compression
GraphicsMagick
NCNN:
  CPU - resnet18
  CPU - mnasnet
VP9 libvpx Encoding
Mobile Neural Network
WebP Image Encode
Crypto++
oneDNN:
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
Zstd Compression
Etcpak
Stockfish
oneDNN
Mobile Neural Network
Zstd Compression
SVT-VP9
NCNN
GraphicsMagick
Liquid-DSP
NCNN
Mobile Neural Network
Crypto++
WebP Image Encode
dav1d
NCNN
x265
dav1d
VP9 libvpx Encoding
ViennaCL
TNN
AOM AV1:
  Speed 6 Two-Pass - Bosphorus 4K
  Speed 9 Realtime - Bosphorus 4K
NCNN
Etcpak
ViennaCL
Opus Codec Encoding
Zstd Compression
oneDNN
Tachyon
Liquid-DSP
SVT-VP9
oneDNN
NCNN:
  CPU - blazeface
  CPU - mobilenet
oneDNN
WebP Image Encode
ViennaCL
oneDNN
Timed HMMer Search
Botan
Ngspice
LAME MP3 Encoding
7-Zip Compression
Zstd Compression
oneDNN
Etcpak
PJSIP
NCNN
PJSIP
C-Ray
VOSK Speech Recognition Toolkit
AOM AV1
Botan
Himeno Benchmark
NCNN
SecureMark
GraphicsMagick
C-Blosc
Mobile Neural Network
AOM AV1
Crypto++
SVT-VP9
Kvazaar
NCNN
SQLite Speedtest
FLAC Audio Encoding
Zstd Compression
libjpeg-turbo tjbench
SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
ViennaCL
Kvazaar
PJSIP
SVT-HEVC
Ngspice
SVT-HEVC
oneDNN:
  IP Shapes 1D - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
SVT-HEVC
ViennaCL
Botan
GnuPG
TNN
ViennaCL:
  CPU BLAS - dAXPY
  CPU BLAS - dCOPY
oneDNN:
  IP Shapes 1D - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
WavPack Audio Encoding
Botan
libgav1:
  Chimera 1080p 10-bit
  Summer Nature 4K
NCNN
Mobile Neural Network
ViennaCL
oneDNN