Xeon E5 1680 v3 Xmas

Intel Xeon E5-1680 v3 testing with a ASUS X99-A (3902 BIOS) and eVGA NVIDIA NVE7 1GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2012271-HA-XEONE516824&sor&grs.

Xeon E5 1680 v3 XmasProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution123Intel Xeon E5-1680 v3 @ 3.80GHz (8 Cores / 16 Threads)ASUS X99-A (3902 BIOS)Intel Xeon E7 v3/Xeon16GBPNY CS900 240GBeVGA NVIDIA NVE7 1GBRealtek ALC1150G237HLIntel I218-VUbuntu 20.045.4.0-47-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.3 Mesa 20.0.8GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43Python Details- Python 3.8.5Security Details- itlb_multihit: KVM: Vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Xeon E5 1680 v3 Xmasncnn: CPU - yolov4-tinymlpack: scikit_icaredis: GETbuild2: Time To Compilencnn: CPU - mnasnetonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUclomp: Static OMP Speedupnode-web-tooling: graphics-magick: Rotateyquake2: Software CPU - 1920 x 1080compilebench: Read Compiled Treeopenvino: Person Detection 0106 FP16 - CPUncnn: CPU - blazefacegraphics-magick: HWB Color Spacekvazaar: Bosphorus 1080p - Very Fastncnn: CPU-v2-v2 - mobilenet-v2x265: Bosphorus 1080pffte: N=256, 3D Complex FFT Routinekvazaar: Bosphorus 4K - Mediumnumpy: kvazaar: Bosphorus 4K - Very Faststockfish: Total Timeunpack-firefox: firefox-84.0.source.tar.xzastcenc: Fastkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Ultra Fastkvazaar: Bosphorus 4K - Ultra Fastonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUx265: Bosphorus 4Kcrafty: Elapsed Timencnn: CPU - mobilenetonednn: IP Shapes 3D - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUncnn: CPU - shufflenet-v2ncnn: CPU - regnety_400mlczero: BLASncnn: CPU - googlenetgraphics-magick: Resizingcompress-lz4: 9 - Compression Speedonednn: IP Shapes 1D - f32 - CPUlczero: Eigenkeydb: coremark: CoreMark Size 666 - Iterations Per Secondcompress-lz4: 1 - Compression Speedonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUncnn: CPU-v3-v3 - mobilenet-v3lammps: Rhodopsin Proteinmafft: Multiple Sequence Alignment - LSU RNAcouchdb: 100 - 1000 - 24asmfish: 1024 Hash Memory, 26 Depthembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crowndolfyn: Computational Fluid Dynamicssqlite-speedtest: Timed Time - Size 1,000onednn: IP Shapes 1D - u8s8f32 - CPUbyte: Dhrystone 2graphics-magick: Swirlrnnoise: embree: Pathtracer - Asian Dragon Objembree: Pathtracer - Crownindigobench: CPU - Supercarbuild-eigen: Time To Compileencode-opus: WAV To Opus Encoderav1e: 6onednn: Deconvolution Batch shapes_3d - f32 - CPUbasis: ETC1Sonednn: Convolution Batch Shapes Auto - f32 - CPUgraphics-magick: Noise-Gaussianonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUindigobench: CPU - Bedroomhmmer: Pfam Database Searchsockperf: Latency Ping Pongncnn: CPU - resnet18openvino: Age Gender Recognition Retail 0013 FP16 - CPUncnn: CPU - vgg16ai-benchmark: Device Training Scorerav1e: 10embree: Pathtracer - Asian Dragonai-benchmark: Device AI Scorephpbench: PHP Benchmark Suiterav1e: 5ncnn: CPU - resnet50ncnn: CPU - squeezenet_ssdcaffe: AlexNet - CPU - 200basis: UASTC Level 0openvino: Age Gender Recognition Retail 0013 FP32 - CPUcompress-lz4: 9 - Decompression Speedmlpack: scikit_linearridgeregressionai-benchmark: Device Inference Scorehint: FLOATonednn: Recurrent Neural Network Training - u8s8f32 - CPUopenvino: Person Detection 0106 FP16 - CPUncnn: CPU - alexnetgromacs: Water Benchmarkbasis: UASTC Level 2onednn: Recurrent Neural Network Inference - f32 - CPUembree: Pathtracer ISPC - Asian Dragon Objencode-ape: WAV To APEencode-wavpack: WAV To WavPacksockperf: Throughputonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUbrl-cad: VGR Performance Metriconednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUopenvino: Person Detection 0106 FP32 - CPUcaffe: AlexNet - CPU - 100compress-lz4: 3 - Compression Speedonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUastcenc: Mediumcompress-lz4: 3 - Decompression Speedbuild-ffmpeg: Time To Compileopenvino: Face Detection 0106 FP32 - CPUmlpack: scikit_svmcompress-lz4: 1 - Decompression Speedbasis: UASTC Level 3openvino: Face Detection 0106 FP16 - CPUencode-ogg: WAV To Oggcaffe: GoogleNet - CPU - 100caffe: GoogleNet - CPU - 200astcenc: Thoroughastcenc: Exhaustiveopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP16 - CPUrav1e: 1graphics-magick: Enhancedgraphics-magick: Sharpenmlpack: scikit_qdancnn: CPU - efficientnet-b0redis: SETredis: LPUSHredis: SADDredis: LPOPespeak: Text-To-Speech Synthesissockperf: Latency Under Loadcompilebench: Initial Createcompilebench: Compile12329.9167.171834428.00173.7205.457.876959.99.7759875.42243.771.32.5556536.786.1935.5130109.6107896683.62285.1510.281412440423.1607.0015.6569.7018.563.509938.85700296820.506.877523.013736.8820.68110515.3964842.064.530121046470540.93270945.8630966098.312.552046.334795.405.05511.358134.6022170791812.03199.680723.20779.0223.1334137390438.726225.7119.40028.68042.96697.3169.6781.0889.1772765.82212.551917510.81602480.101.297162.5754.49914.025069.4747.9510602.41510.014620796264800.81527.3724.8111808610.2385077.117283.63.181019348188152.871624529.123070.2111.160.75447.3832474.8810.812014.15715.9772655434533.01888174531.112472.673074.795930742.976.203196.597267.381.8432113.8722.307499.088.8742114.4024.75515099430196041.52334.100.770.771.31.881.880.2721019061.468.171481853.311289264.921639601.212000353.8635.72125.468357.55760.8428.2067.931750688.54172.5925.637.9035410.29.7161273.62297.291.272.5557536.786.2336.2230542.4636811963.61289.2010.281414134222.8377.1115.6769.2118.523.496808.75692672120.236.787912.988146.9520.87110415.5865142.114.583501050475933.28273924.3357036163.862.534576.400145.425.02611.317134.0852157760312.13739.735323.39779.6623.1587437461981.326425.6699.41918.61702.96397.1799.6431.0939.2346366.20412.498017610.75462469.551.291163.4544.48714.075044.3348.1410602.42510.054020826262180.81627.4624.7211850710.2025066.127259.43.191022349172823.112384523.863078.7011.190.75347.4182468.9710.798614.17015.9802660974523.92889954525.422470.373069.325920542.996.212956.587256.981.8602115.3122.337494.088.9862115.2924.74915085330168641.51334.170.770.771.31.881.880.2721019063.568.341456546.481306966.331625787.131685556.7237.47925.961339.32773.5828.9271.221852979.38178.6005.607.6647410.29.5061374.82286.431.302.6157836.026.3235.6030708.4487632543.55283.8810.101390057523.2177.0415.4368.6818.293.460348.87702127020.446.811392.974476.9720.95109115.4765641.604.557781038475766.15273946.9709046152.722.524946.372705.455.07211.256135.2982176866212.09849.762923.32379.3163.1447537177008.126425.5219.34998.66752.94697.8079.6161.0869.1992166.22312.478117610.80742466.091.298163.3134.51014.005066.6148.1810652.41910.047720876241670.81827.4724.7311814910.2045060.177278.73.191022348871675.898174536.473073.9511.190.75547.5062468.8010.786814.13916.0122656224526.33888854533.642468.253073.875922143.046.210706.597267.981.7432116.8422.337503.588.9332116.9924.77715102030176041.50334.210.770.771.31.881.880.2721019067.828.671464928.241243644.161635637.531279010.1738.49724.475376.15653.68OpenBenchmarking.org

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny231714212835SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 0.25, N = 328.2028.9229.91MIN: 27.88 / MAX: 28.62MIN: 27.88 / MAX: 35.07MIN: 27.91 / MAX: 34.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Mlpack Benchmark

Benchmark: scikit_ica

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_ica1231632486480SE +/- 0.62, N = 15SE +/- 0.78, N = 6SE +/- 1.19, N = 367.1767.9371.22

Redis

Test: GET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: GET312400K800K1200K1600K2000KSE +/- 28672.73, N = 3SE +/- 22966.71, N = 3SE +/- 26369.12, N = 151852979.381834428.001750688.541. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Build2

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.13Time To Compile2134080120160200SE +/- 2.37, N = 4SE +/- 2.07, N = 5SE +/- 1.61, N = 3172.59173.72178.60

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet1321.26682.53363.80045.06726.334SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 35.455.605.63MIN: 5.28 / MAX: 16.44MIN: 5.39 / MAX: 16.65MIN: 5.37 / MAX: 17.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU312246810SE +/- 0.01396, N = 3SE +/- 0.10075, N = 5SE +/- 0.12917, N = 37.664747.876957.90354MIN: 7.58MIN: 7.57MIN: 7.651. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

CLOMP

Static OMP Speedup

OpenBenchmarking.orgSpeedup, More Is BetterCLOMP 1.2Static OMP Speedup3213691215SE +/- 0.09, N = 3SE +/- 0.15, N = 4SE +/- 0.14, N = 410.210.29.91. (CC) gcc options: -fopenmp -O3 -lm

Node.js V8 Web Tooling Benchmark

OpenBenchmarking.orgruns/s, More Is BetterNode.js V8 Web Tooling Benchmark1233691215SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 39.779.719.501. Nodejs v10.19.0

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Rotate321130260390520650SE +/- 0.33, N = 36136125981. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

yquake2

Renderer: Software CPU - Resolution: 1920 x 1080

OpenBenchmarking.orgFrames Per Second, More Is Betteryquake2 7.45Renderer: Software CPU - Resolution: 1920 x 108013220406080100SE +/- 0.98, N = 5SE +/- 0.26, N = 3SE +/- 0.35, N = 375.474.873.61. (CC) gcc options: -lm -ldl -rdynamic -shared -lSDL2 -O2 -pipe -fomit-frame-pointer -std=gnu99 -fno-strict-aliasing -fwrapv -fvisibility=hidden -MMD -mfpmath=sse -fPIC

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Tree2315001000150020002500SE +/- 12.51, N = 3SE +/- 10.79, N = 3SE +/- 25.31, N = 32297.292286.432243.77

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU3120.29250.5850.87751.171.4625SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.301.301.27

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface1230.58731.17461.76192.34922.9365SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 32.552.552.61MIN: 2.48 / MAX: 2.62MIN: 2.51 / MAX: 2.59MIN: 2.55 / MAX: 3.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: HWB Color Space321120240360480600SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 35785755651. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Very Fast213816243240SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 336.7836.7836.021. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v2123246810SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 36.196.236.32MIN: 6 / MAX: 15.89MIN: 6.01 / MAX: 16.48MIN: 6.04 / MAX: 17.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

x265

Video Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 1080p231816243240SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.53, N = 336.2235.6035.511. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFTE

N=256, 3D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT Routine3217K14K21K28K35KSE +/- 89.40, N = 3SE +/- 209.55, N = 3SE +/- 340.92, N = 330708.4530542.4630109.611. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Medium1230.81451.6292.44353.2584.0725SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.623.613.551. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy Benchmark21360120180240300SE +/- 0.38, N = 3SE +/- 0.88, N = 3SE +/- 0.75, N = 3289.20285.15283.88

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Very Fast2133691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 310.2810.2810.101. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 12Total Time2133M6M9M12M15MSE +/- 71363.03, N = 3SE +/- 166711.74, N = 3SE +/- 194479.46, N = 41414134214124404139005751. (CXX) g++ options: -m64 -lpthread -fno-exceptions -std=c++17 -pedantic -O3 -msse -msse3 -mpopcnt -msse4.1 -mssse3 -msse2 -flto -flto=jobserver

Unpacking Firefox

Extracting: firefox-84.0.source.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking Firefox 84.0Extracting: firefox-84.0.source.tar.xz213612182430SE +/- 0.28, N = 6SE +/- 0.31, N = 4SE +/- 0.33, N = 422.8423.1623.22

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Fast132246810SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 37.007.047.111. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Medium21348121620SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 315.6715.6515.431. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 1080p - Video Preset: Ultra Fast1231632486480SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 369.7069.2168.681. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.0Video Input: Bosphorus 4K - Video Preset: Ultra Fast123510152025SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 318.5618.5218.291. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU3210.78971.57942.36913.15883.9485SE +/- 0.01650, N = 3SE +/- 0.02742, N = 3SE +/- 0.00979, N = 33.460343.496803.50993MIN: 3.32MIN: 3.33MIN: 3.441. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4K312246810SE +/- 0.08, N = 3SE +/- 0.09, N = 8SE +/- 0.12, N = 48.878.858.751. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Crafty

Elapsed Time

OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed Time3121.5M3M4.5M6M7.5MSE +/- 33788.32, N = 3SE +/- 8272.92, N = 3SE +/- 19512.27, N = 37021270700296869267211. (CC) gcc options: -pthread -lstdc++ -fprofile-use -lm

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet231510152025SE +/- 0.01, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 320.2320.4420.50MIN: 20.1 / MAX: 22.33MIN: 20.12 / MAX: 27.98MIN: 20.12 / MAX: 38.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU231246810SE +/- 0.02409, N = 3SE +/- 0.03424, N = 3SE +/- 0.01639, N = 36.787916.811396.87752MIN: 6.64MIN: 6.68MIN: 6.771. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU3210.67811.35622.03432.71243.3905SE +/- 0.00748, N = 3SE +/- 0.00758, N = 3SE +/- 0.00785, N = 32.974472.988143.01373MIN: 2.9MIN: 2.91MIN: 2.931. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v2123246810SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 36.886.956.97MIN: 6.77 / MAX: 17.73MIN: 6.77 / MAX: 18.58MIN: 6.8 / MAX: 18.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123510152025SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 320.6820.8720.95MIN: 20.41 / MAX: 37.64MIN: 20.52 / MAX: 52.3MIN: 20.63 / MAX: 34.711. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: BLAS1232004006008001000SE +/- 8.29, N = 3SE +/- 4.93, N = 3SE +/- 8.14, N = 31105110410911. (CXX) g++ options: -flto -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet13248121620SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 315.3915.4715.58MIN: 15.11 / MAX: 19.35MIN: 15.2 / MAX: 16.43MIN: 15.19 / MAX: 16.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Resizing321140280420560700SE +/- 0.67, N = 3SE +/- 1.15, N = 3SE +/- 1.15, N = 36566516481. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

LZ4 Compression

Compression Level: 9 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 9 - Compression Speed2131020304050SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.56, N = 342.1142.0641.601. (CC) gcc options: -O3

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU1321.03132.06263.09394.12525.1565SE +/- 0.01478, N = 3SE +/- 0.02200, N = 3SE +/- 0.03023, N = 34.530124.557784.58350MIN: 4.43MIN: 4.45MIN: 4.481. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.26Backend: Eigen2132004006008001000SE +/- 5.03, N = 3SE +/- 2.89, N = 3SE +/- 11.79, N = 31050104610381. (CXX) g++ options: -flto -pthread

KeyDB

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.0.16231100K200K300K400K500KSE +/- 111.39, N = 3SE +/- 531.93, N = 3SE +/- 1362.98, N = 3475933.28475766.15470540.931. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per Second32160K120K180K240K300KSE +/- 486.71, N = 3SE +/- 590.16, N = 3SE +/- 1053.72, N = 3273946.97273924.34270945.861. (CC) gcc options: -O2 -lrt" -lrt

LZ4 Compression

Compression Level: 1 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 1 - Compression Speed23113002600390052006500SE +/- 5.37, N = 3SE +/- 8.03, N = 3SE +/- 1.20, N = 36163.866152.726098.311. (CC) gcc options: -O3

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU3210.57421.14841.72262.29682.871SE +/- 0.01253, N = 3SE +/- 0.01518, N = 3SE +/- 0.01421, N = 32.524942.534572.55204MIN: 2.48MIN: 2.49MIN: 2.51. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU132246810SE +/- 0.00863, N = 3SE +/- 0.03639, N = 3SE +/- 0.01093, N = 36.334796.372706.40014MIN: 6.26MIN: 6.26MIN: 6.31. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v31231.22632.45263.67894.90526.1315SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 35.405.425.45MIN: 5.25 / MAX: 17.21MIN: 5.27 / MAX: 16.73MIN: 5.3 / MAX: 16.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 29Oct2020Model: Rhodopsin Protein3121.14122.28243.42364.56485.706SE +/- 0.007, N = 3SE +/- 0.005, N = 3SE +/- 0.072, N = 35.0725.0555.0261. (CXX) g++ options: -O3 -pthread -lm

Timed MAFFT Alignment

Multiple Sequence Alignment - LSU RNA

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNA3213691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 311.2611.3211.361. (CC) gcc options: -std=c99 -O3 -lm -lpthread

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.1.1Bulk Size: 100 - Inserts: 1000 - Rounds: 24213306090120150SE +/- 0.62, N = 3SE +/- 0.34, N = 3SE +/- 2.21, N = 3134.09134.60135.301. (CXX) g++ options: -std=c++14 -lmozjs-68 -lm -lerl_interface -lei -fPIC -MMD

asmFish

1024 Hash Memory, 26 Depth

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-231024 Hash Memory, 26 Depth3125M10M15M20M25MSE +/- 288716.85, N = 3SE +/- 260870.39, N = 3SE +/- 222609.71, N = 3217686622170791821577603

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.9.0Binary: Pathtracer ISPC - Model: Asian Dragon2313691215SE +/- 0.11, N = 3SE +/- 0.10, N = 3SE +/- 0.01, N = 312.1412.1012.03MIN: 11.91 / MAX: 12.45MIN: 11.87 / MAX: 12.37MIN: 11.97 / MAX: 12.2

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.9.0Binary: Pathtracer ISPC - Model: Crown3213691215SE +/- 0.0193, N = 3SE +/- 0.0397, N = 3SE +/- 0.0256, N = 39.76299.73539.6807MIN: 9.68 / MAX: 9.94MIN: 9.62 / MAX: 9.95MIN: 9.6 / MAX: 9.86

Dolfyn

Computational Fluid Dynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid Dynamics132612182430SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.16, N = 323.2123.3223.40

SQLite Speedtest

Timed Time - Size 1,000

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite Speedtest 3.30Timed Time - Size 1,00013220406080100SE +/- 0.33, N = 3SE +/- 0.06, N = 3SE +/- 0.41, N = 379.0279.3279.661. (CC) gcc options: -O2 -ldl -lz -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU1320.71071.42142.13212.84283.5535SE +/- 0.01227, N = 3SE +/- 0.01108, N = 3SE +/- 0.01228, N = 33.133413.144753.15874MIN: 3.07MIN: 3.07MIN: 3.11. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

BYTE Unix Benchmark

Computational Test: Dhrystone 2

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 22138M16M24M32M40MSE +/- 46692.87, N = 3SE +/- 165452.15, N = 3SE +/- 122181.12, N = 337461981.337390438.737177008.1

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Swirl32160120180240300SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.58, N = 32642642621. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

RNNoise

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28321612182430SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 325.5225.6725.711. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.9.0Binary: Pathtracer - Model: Asian Dragon Obj2133691215SE +/- 0.0255, N = 3SE +/- 0.0214, N = 3SE +/- 0.0092, N = 39.41919.40029.3499MIN: 9.36 / MAX: 9.54MIN: 9.33 / MAX: 9.52MIN: 9.3 / MAX: 9.45

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.9.0Binary: Pathtracer - Model: Crown132246810SE +/- 0.0232, N = 3SE +/- 0.0281, N = 3SE +/- 0.0079, N = 38.68048.66758.6170MIN: 8.59 / MAX: 8.82MIN: 8.57 / MAX: 8.83MIN: 8.56 / MAX: 8.76

IndigoBench

Acceleration: CPU - Scene: Supercar

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: Supercar1230.66741.33482.00222.66963.337SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 32.9662.9632.946

Timed Eigen Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.3.9Time To Compile21320406080100SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 397.1897.3297.81

Opus Codec Encoding

WAV To Opus Encode

OpenBenchmarking.orgSeconds, Fewer Is BetterOpus Codec Encoding 1.3.1WAV To Opus Encode3213691215SE +/- 0.008, N = 5SE +/- 0.033, N = 5SE +/- 0.024, N = 59.6169.6439.6781. (CXX) g++ options: -fvisibility=hidden -logg -lm

rav1e

Speed: 6

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 62130.24590.49180.73770.98361.2295SE +/- 0.006, N = 3SE +/- 0.001, N = 3SE +/- 0.003, N = 31.0931.0881.086

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU1323691215SE +/- 0.01399, N = 3SE +/- 0.00829, N = 3SE +/- 0.02794, N = 39.177279.199219.23463MIN: 9.08MIN: 9.09MIN: 9.091. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

Basis Universal

Settings: ETC1S

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: ETC1S1231530456075SE +/- 0.44, N = 3SE +/- 0.19, N = 3SE +/- 0.05, N = 365.8266.2066.221. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU3213691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 312.4812.5012.55MIN: 12.34MIN: 12.37MIN: 12.411. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Noise-Gaussian3214080120160200SE +/- 0.33, N = 31761761751. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU2313691215SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 310.7510.8110.82MIN: 10.48MIN: 10.47MIN: 10.521. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU3215001000150020002500SE +/- 0.45, N = 3SE +/- 2.48, N = 3SE +/- 10.28, N = 32466.092469.552480.10MIN: 2461.63MIN: 2462.7MIN: 24651. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

IndigoBench

Acceleration: CPU - Scene: Bedroom

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: Bedroom3120.29210.58420.87631.16841.4605SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.002, N = 31.2981.2971.291

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database Search1324080120160200SE +/- 0.21, N = 3SE +/- 0.13, N = 3SE +/- 0.36, N = 3162.58163.31163.451. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm

Sockperf

Test: Latency Ping Pong

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Ping Pong2131.01482.02963.04444.05925.074SE +/- 0.032, N = 5SE +/- 0.037, N = 25SE +/- 0.055, N = 64.4874.4994.5101. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet1831248121620SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 314.0014.0214.07MIN: 13.86 / MAX: 15.29MIN: 13.88 / MAX: 14.41MIN: 13.87 / MAX: 19.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU13211002200330044005500SE +/- 13.21, N = 3SE +/- 7.38, N = 3SE +/- 8.75, N = 35069.475066.615044.33

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg161231122334455SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 347.9548.1448.18MIN: 47.64 / MAX: 50.16MIN: 47.78 / MAX: 64.77MIN: 47.69 / MAX: 57.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

AI Benchmark Alpha

Device Training Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Training Score3212004006008001000106510601060

rav1e

Speed: 10

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 102310.54561.09121.63682.18242.728SE +/- 0.004, N = 3SE +/- 0.007, N = 3SE +/- 0.001, N = 32.4252.4192.415

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.9.0Binary: Pathtracer - Model: Asian Dragon2313691215SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 310.0510.0510.01MIN: 9.94 / MAX: 10.21MIN: 9.86 / MAX: 10.24MIN: 9.97 / MAX: 10.12

AI Benchmark Alpha

Device AI Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device AI Score321400800120016002000208720822079

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suite123130K260K390K520K650KSE +/- 676.23, N = 3SE +/- 872.14, N = 3SE +/- 1083.96, N = 3626480626218624167

rav1e

Speed: 5

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 53210.18410.36820.55230.73640.9205SE +/- 0.005, N = 3SE +/- 0.005, N = 3SE +/- 0.002, N = 30.8180.8160.815

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet50123612182430SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 327.3727.4627.47MIN: 26.85 / MAX: 35.85MIN: 27.01 / MAX: 44.87MIN: 27.05 / MAX: 45.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd231612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.11, N = 324.7224.7324.81MIN: 24.64 / MAX: 26.71MIN: 24.64 / MAX: 27.27MIN: 24.62 / MAX: 48.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Caffe

Model: AlexNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 20013230K60K90K120K150KSE +/- 18.73, N = 3SE +/- 86.87, N = 3SE +/- 244.34, N = 31180861181491185071. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Basis Universal

Settings: UASTC Level 0

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 02313691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 310.2010.2010.241. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU12311002200330044005500SE +/- 9.42, N = 3SE +/- 9.51, N = 3SE +/- 7.20, N = 35077.115066.125060.17

LZ4 Compression

Compression Level: 9 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 9 - Decompression Speed13216003200480064008000SE +/- 5.97, N = 3SE +/- 14.52, N = 3SE +/- 4.05, N = 37283.67278.77259.41. (CC) gcc options: -O3

Mlpack Benchmark

Benchmark: scikit_linearridgeregression

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_linearridgeregression1230.71781.43562.15342.87123.589SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.183.193.19

AI Benchmark Alpha

Device Inference Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Inference Score3212004006008001000102210221019

Hierarchical INTegration

Test: FLOAT

OpenBenchmarking.orgQUIPs, More Is BetterHierarchical INTegration 1.0Test: FLOAT23170M140M210M280M350MSE +/- 348495.09, N = 3SE +/- 110846.40, N = 3SE +/- 671953.04, N = 3349172823.11348871675.90348188152.871. (CC) gcc options: -O3 -march=native -lm

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU21310002000300040005000SE +/- 3.64, N = 3SE +/- 0.35, N = 3SE +/- 7.29, N = 34523.864529.124536.47MIN: 4513.41MIN: 4522.47MIN: 4520.131. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1327001400210028003500SE +/- 2.92, N = 3SE +/- 0.75, N = 3SE +/- 2.89, N = 33070.213073.953078.70

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet1233691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 311.1611.1911.19MIN: 11.09 / MAX: 11.53MIN: 11.11 / MAX: 11.28MIN: 11.11 / MAX: 20.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

GROMACS

Water Benchmark

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water Benchmark3120.16990.33980.50970.67960.8495SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 30.7550.7540.7531. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm

Basis Universal

Settings: UASTC Level 2

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 21231122334455SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 347.3847.4247.511. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU3215001000150020002500SE +/- 1.82, N = 3SE +/- 3.28, N = 3SE +/- 2.75, N = 32468.802468.972474.88MIN: 2463.37MIN: 2460.79MIN: 2467.181. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.9.0Binary: Pathtracer ISPC - Model: Asian Dragon Obj1233691215SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 310.8110.8010.79MIN: 10.7 / MAX: 11.01MIN: 10.71 / MAX: 11.01MIN: 10.7 / MAX: 10.96

Monkey Audio Encoding

WAV To APE

OpenBenchmarking.orgSeconds, Fewer Is BetterMonkey Audio Encoding 3.99.6WAV To APE31248121620SE +/- 0.05, N = 5SE +/- 0.04, N = 5SE +/- 0.06, N = 514.1414.1614.171. (CXX) g++ options: -O3 -pedantic -rdynamic -lrt

WavPack Audio Encoding

WAV To WavPack

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.3WAV To WavPack12348121620SE +/- 0.04, N = 5SE +/- 0.05, N = 5SE +/- 0.05, N = 515.9815.9816.011. (CXX) g++ options: -rdynamic

Sockperf

Test: Throughput

OpenBenchmarking.orgMessages Per Second, More Is BetterSockperf 3.4Test: Throughput23160K120K180K240K300KSE +/- 2697.01, N = 25SE +/- 2962.76, N = 5SE +/- 2778.72, N = 252660972656222655431. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU23110002000300040005000SE +/- 1.37, N = 3SE +/- 3.38, N = 3SE +/- 2.65, N = 34523.924526.334533.01MIN: 4517.94MIN: 4516.82MIN: 4522.751. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.30.8VGR Performance Metric23120K40K60K80K100K8899588885888171. (CXX) g++ options: -std=c++11 -pipe -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -rdynamic -lSM -lICE -lXi -lGLU -lGL -lGLdispatch -lX11 -lXext -lXrender -lpthread -ldl -luuid -lm

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU21310002000300040005000SE +/- 1.21, N = 3SE +/- 1.69, N = 3SE +/- 2.17, N = 34525.424531.114533.64MIN: 4516.35MIN: 4524.03MIN: 4525.251. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU3215001000150020002500SE +/- 1.99, N = 3SE +/- 0.84, N = 3SE +/- 0.91, N = 32468.252470.372472.67MIN: 2462.29MIN: 2466.62MIN: 2467.61. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU2317001400210028003500SE +/- 1.16, N = 3SE +/- 5.64, N = 3SE +/- 1.72, N = 33069.323073.873074.79

Caffe

Model: AlexNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 10023113K26K39K52K65KSE +/- 51.35, N = 3SE +/- 27.33, N = 3SE +/- 170.12, N = 35920559221593071. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

LZ4 Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 3 - Compression Speed3211020304050SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 343.0442.9942.971. (CC) gcc options: -O3

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU132246810SE +/- 0.01219, N = 3SE +/- 0.01601, N = 3SE +/- 0.02072, N = 36.203196.210706.21295MIN: 6.12MIN: 6.1MIN: 6.111. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Medium213246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36.586.596.591. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

LZ4 Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 3 - Decompression Speed31216003200480064008000SE +/- 4.32, N = 3SE +/- 4.72, N = 3SE +/- 6.48, N = 37267.97267.37256.91. (CC) gcc options: -O3

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 4.2.2Time To Compile31220406080100SE +/- 0.12, N = 3SE +/- 0.23, N = 3SE +/- 0.09, N = 381.7481.8481.86

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1235001000150020002500SE +/- 0.83, N = 3SE +/- 0.51, N = 3SE +/- 1.55, N = 32113.872115.312116.84

Mlpack Benchmark

Benchmark: scikit_svm

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_svm123510152025SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 322.3022.3322.33

LZ4 Compression

Compression Level: 1 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterLZ4 Compression 1.9.3Compression Level: 1 - Decompression Speed31216003200480064008000SE +/- 10.24, N = 3SE +/- 8.20, N = 3SE +/- 10.99, N = 37503.57499.07494.01. (CC) gcc options: -O3

Basis Universal

Settings: UASTC Level 3

OpenBenchmarking.orgSeconds, Fewer Is BetterBasis Universal 1.12Settings: UASTC Level 313220406080100SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 388.8788.9388.991. (CXX) g++ options: -std=c++11 -fvisibility=hidden -fPIC -fno-strict-aliasing -O3 -rdynamic -lm -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1235001000150020002500SE +/- 0.54, N = 3SE +/- 0.91, N = 3SE +/- 1.10, N = 32114.402115.292116.99

Ogg Audio Encoding

WAV To Ogg

OpenBenchmarking.orgSeconds, Fewer Is BetterOgg Audio Encoding 1.3.4WAV To Ogg213612182430SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 324.7524.7624.781. (CC) gcc options: -O2 -ffast-math -fsigned-char

Caffe

Model: GoogleNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 10021330K60K90K120K150KSE +/- 78.70, N = 3SE +/- 103.00, N = 3SE +/- 108.38, N = 31508531509941510201. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 20023160K120K180K240K300KSE +/- 155.18, N = 3SE +/- 180.52, N = 3SE +/- 189.29, N = 33016863017603019601. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Thorough321918273645SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 341.5041.5141.521. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Exhaustive12370140210280350SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3334.10334.17334.211. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1230.17330.34660.51990.69320.8665SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.770.770.77

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1230.17330.34660.51990.69320.8665SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.770.770.77

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU3210.29250.5850.87751.171.4625SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.31.31.3

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU3210.4230.8461.2691.6922.115SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 31.881.881.88

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU3210.4230.8461.2691.6922.115SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.881.881.88

rav1e

Speed: 1

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 13210.06120.12240.18360.24480.306SE +/- 0.000, N = 3SE +/- 0.000, N = 3SE +/- 0.000, N = 30.2720.2720.272

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Enhanced321204060801001011011011. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.33Operation: Sharpen321204060801009090901. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Mlpack Benchmark

Benchmark: scikit_qda

OpenBenchmarking.orgSeconds, Fewer Is BetterMlpack BenchmarkBenchmark: scikit_qda1231530456075SE +/- 0.21, N = 3SE +/- 1.18, N = 12SE +/- 2.69, N = 1261.4663.5667.82

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b0123246810SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.35, N = 38.178.348.67MIN: 8.07 / MAX: 8.37MIN: 8.06 / MAX: 16.21MIN: 8.06 / MAX: 89.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Redis

Test: SET

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SET132300K600K900K1200K1500KSE +/- 34189.05, N = 15SE +/- 32485.29, N = 15SE +/- 26544.26, N = 151481853.311464928.241456546.481. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: LPUSH

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: LPUSH213300K600K900K1200K1500KSE +/- 10203.98, N = 15SE +/- 16275.71, N = 5SE +/- 34112.41, N = 121306966.331289264.921243644.161. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: SADD

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: SADD132400K800K1200K1600K2000KSE +/- 11131.75, N = 3SE +/- 24311.83, N = 15SE +/- 31572.89, N = 151639601.211635637.531625787.131. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: LPOP

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 6.0.9Test: LPOP123400K800K1200K1600K2000KSE +/- 33266.07, N = 15SE +/- 113389.94, N = 12SE +/- 28277.44, N = 152000353.861685556.721279010.171. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

eSpeak-NG Speech Engine

Text-To-Speech Synthesis

OpenBenchmarking.orgSeconds, Fewer Is BettereSpeak-NG Speech Engine 20200907Text-To-Speech Synthesis123918273645SE +/- 0.32, N = 4SE +/- 0.44, N = 20SE +/- 0.55, N = 2035.7237.4838.501. (CC) gcc options: -O2 -std=c99

Sockperf

Test: Latency Under Load

OpenBenchmarking.orgusec, Fewer Is BetterSockperf 3.4Test: Latency Under Load312612182430SE +/- 1.22, N = 25SE +/- 0.84, N = 25SE +/- 1.08, N = 2024.4825.4725.961. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Create31280160240320400SE +/- 7.94, N = 3SE +/- 5.18, N = 3SE +/- 25.84, N = 3376.15357.55339.32

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compile213170340510680850SE +/- 5.81, N = 3SE +/- 8.09, N = 3SE +/- 52.39, N = 12773.58760.84653.68

Phoronix Test Suite v10.8.5