Pre 10.0 Xeon

2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2010091-FI-PRE100XEO81
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Bioinformatics 2 Tests
C/C++ Compiler Tests 4 Tests
CPU Massive 4 Tests
Creator Workloads 2 Tests
Database Test Suite 2 Tests
Fortran Tests 2 Tests
HPC - High Performance Computing 9 Tests
Machine Learning 4 Tests
Molecular Dynamics 2 Tests
Multi-Core 2 Tests
NVIDIA GPU Compute 3 Tests
Python Tests 2 Tests
Scientific Computing 5 Tests
Server 2 Tests
Single-Threaded 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
October 08 2020
  3 Hours, 34 Minutes
2
October 09 2020
  5 Hours, 30 Minutes
3
October 09 2020
  3 Hours, 41 Minutes
Invert Hiding All Results Option
  4 Hours, 15 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Pre 10.0 XeonProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution1232 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads)TYAN S7106 (V2.01.B40 BIOS)Intel Sky Lake-E DMI3 Registers94GB500GB Samsung SSD 860llvmpipeVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbEUbuntu 20.045.9.0-050900rc6-generic (x86_64) 20200920GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x10802 x Intel I210OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01Python Details- Python 2.7.18rc1 + Python 3.8.2Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

123Result OverviewPhoronix Test Suite100%101%102%103%Apache CouchDBDolfynNCNNKeyDBTimed MAFFT AlignmentGROMACSHierarchical INTegrationRNNoiseFFTETimed HMMer SearchBYTE Unix BenchmarkOpenVINOCaffe

Pre 10.0 Xeondolfyn: Computational Fluid Dynamicsffte: N=256, 3D Complex FFT Routinehmmer: Pfam Database Searchmafft: Multiple Sequence Alignment - LSU RNAbyte: Dhrystone 2rnnoise: couchdb: 100 - 1000 - 24keydb: gromacs: Water Benchmarkcaffe: AlexNet - CPU - 100caffe: AlexNet - CPU - 200caffe: GoogleNet - CPU - 100caffe: GoogleNet - CPU - 200ncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUhint: FLOAT12321.445108341.69325295224.18711.76538439689.928.597220.168428636.103.3886622412710017501636919220.5022.719.999.549.229.2812.754.5323.0340.3215.7111.9128.4532.107.002518.376.972526.494.174179.404.154182.3221610.130.821620.670.8385726582.8091821.770108071.86268882223.49411.66138381617.828.472230.040431112.393.4146458613173218838334093420.1122.479.959.449.379.2612.544.4622.8441.0615.5711.8628.2232.147.022518.586.982519.704.154182.734.154168.0421650.990.821613.900.8383680919.9090621.418108490.03516195224.40611.78338354114.728.532227.445433887.123.4126557612958918772237477220.0922.7310.249.669.629.3912.834.4922.9742.2715.7411.9028.2631.816.952533.706.992519.934.164167.664.144183.3521598.600.821634.750.8385694400.25235OpenBenchmarking.org

Dolfyn

Dolfyn is a Computational Fluid Dynamics (CFD) code of modern numerical simulation techniques. The Dolfyn test profile measures the execution time of the bundled computational fluid dynamics demos that are bundled with Dolfyn. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid Dynamics123510152025SE +/- 0.06, N = 3SE +/- 0.29, N = 4SE +/- 0.01, N = 321.4521.7721.42
OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid Dynamics123510152025Min: 21.33 / Avg: 21.45 / Max: 21.52Min: 21.32 / Avg: 21.77 / Max: 22.62Min: 21.39 / Avg: 21.42 / Max: 21.44

FFTE

FFTE is a package by Daisuke Takahashi to compute Discrete Fourier Transforms of 1-, 2- and 3- dimensional sequences of length (2^p)*(3^q)*(5^r). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT Routine12320K40K60K80K100KSE +/- 781.22, N = 3SE +/- 1010.36, N = 3SE +/- 243.36, N = 3108341.69108071.86108490.041. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp
OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT Routine12320K40K60K80K100KMin: 106917.37 / Avg: 108341.69 / Max: 109610.09Min: 106099.41 / Avg: 108071.86 / Max: 109438.27Min: 108189.94 / Avg: 108490.04 / Max: 108971.941. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

Timed HMMer Search

This test searches through the Pfam database of profile hidden markov models. The search finds the domain structure of Drosophila Sevenless protein. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database Search12350100150200250SE +/- 0.61, N = 3SE +/- 0.39, N = 3SE +/- 0.41, N = 3224.19223.49224.411. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database Search1234080120160200Min: 222.99 / Avg: 224.19 / Max: 225.01Min: 222.88 / Avg: 223.49 / Max: 224.21Min: 223.76 / Avg: 224.41 / Max: 225.161. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm

Timed MAFFT Alignment

This test performs an alignment of 100 pyruvate decarboxylase sequences. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNA1233691215SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.20, N = 311.7711.6611.781. (CC) gcc options: -std=c99 -O3 -lm -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNA1233691215Min: 11.64 / Avg: 11.77 / Max: 11.98Min: 11.62 / Avg: 11.66 / Max: 11.71Min: 11.56 / Avg: 11.78 / Max: 12.181. (CC) gcc options: -std=c99 -O3 -lm -lpthread

BYTE Unix Benchmark

This is a test of BYTE. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 21238M16M24M32M40MSE +/- 11954.47, N = 3SE +/- 57895.53, N = 3SE +/- 30065.94, N = 338439689.938381617.838354114.7
OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 21237M14M21M28M35MMin: 38416268.7 / Avg: 38439689.9 / Max: 38455561.5Min: 38270609.9 / Avg: 38381617.77 / Max: 38465645.7Min: 38307432.7 / Avg: 38354114.67 / Max: 38410280.6

RNNoise

RNNoise is a recurrent neural network for audio noise reduction developed by Mozilla and Xiph.Org. This test profile is a single-threaded test measuring the time to denoise a sample 26 minute long 16-bit RAW audio file using this recurrent neural network noise suppression library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28123714212835SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 328.6028.4728.531. (CC) gcc options: -O2 -pedantic -fvisibility=hidden
OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28123612182430Min: 28.45 / Avg: 28.6 / Max: 28.71Min: 28.44 / Avg: 28.47 / Max: 28.51Min: 28.41 / Avg: 28.53 / Max: 28.621. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

Apache CouchDB

This is a bulk insertion benchmark of Apache CouchDB. CouchDB is a document-oriented NoSQL database implemented in Erlang. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.1.1Bulk Size: 100 - Inserts: 1000 - Rounds: 2412350100150200250SE +/- 2.11, N = 3SE +/- 2.66, N = 12SE +/- 2.56, N = 12220.17230.04227.451. (CXX) g++ options: -std=c++14 -lmozjs-68 -lm -lerl_interface -lei -fPIC -MMD
OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.1.1Bulk Size: 100 - Inserts: 1000 - Rounds: 241234080120160200Min: 216.72 / Avg: 220.17 / Max: 223.99Min: 210.87 / Avg: 230.04 / Max: 239.49Min: 206.04 / Avg: 227.44 / Max: 241.481. (CXX) g++ options: -std=c++14 -lmozjs-68 -lm -lerl_interface -lei -fPIC -MMD

KeyDB

A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.0.1612390K180K270K360K450KSE +/- 4163.20, N = 3SE +/- 2528.13, N = 3SE +/- 4369.74, N = 8428636.10431112.39433887.121. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.0.1612380K160K240K320K400KMin: 422484.14 / Avg: 428636.1 / Max: 436571.27Min: 427098.96 / Avg: 431112.39 / Max: 435782.5Min: 408394.65 / Avg: 433887.12 / Max: 445696.111. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing on the CPU with the water_GMX50 data. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water Benchmark1230.76821.53642.30463.07283.841SE +/- 0.007, N = 3SE +/- 0.004, N = 3SE +/- 0.008, N = 33.3883.4143.4121. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm
OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water Benchmark123246810Min: 3.37 / Avg: 3.39 / Max: 3.4Min: 3.41 / Avg: 3.41 / Max: 3.42Min: 3.4 / Avg: 3.41 / Max: 3.431. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm

Caffe

This is a benchmark of the Caffe deep learning framework and currently supports the AlexNet and Googlenet model and execution on both CPUs and NVIDIA GPUs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 10012314K28K42K56K70KSE +/- 124.86, N = 3SE +/- 1797.00, N = 12SE +/- 92.99, N = 36622464586655761. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas
OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 10012311K22K33K44K55KMin: 65975 / Avg: 66224 / Max: 66365Min: 44913 / Avg: 64585.75 / Max: 67300Min: 65405 / Avg: 65575.67 / Max: 657251. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 20012330K60K90K120K150KSE +/- 3833.15, N = 11SE +/- 472.02, N = 3SE +/- 242.40, N = 31271001317321295891. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas
OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 20012320K40K60K80K100KMin: 89052 / Avg: 127100.27 / Max: 132792Min: 130835 / Avg: 131732.33 / Max: 132435Min: 129208 / Avg: 129588.67 / Max: 1300391. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 10012340K80K120K160K200KSE +/- 8266.82, N = 9SE +/- 1658.31, N = 12SE +/- 502.77, N = 31750161883831877221. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas
OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 10012330K60K90K120K150KMin: 131038 / Avg: 175015.89 / Max: 190037Min: 170422 / Avg: 188382.75 / Max: 191709Min: 186722 / Avg: 187722.33 / Max: 1883111. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 20012380K160K240K320K400KSE +/- 4358.06, N = 3SE +/- 17972.71, N = 9SE +/- 2056.32, N = 33691923409343747721. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas
OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 20012360K120K180K240K300KMin: 360775 / Avg: 369192 / Max: 375361Min: 258998 / Avg: 340934.22 / Max: 377600Min: 372582 / Avg: 374772.33 / Max: 3788821. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet123510152025SE +/- 0.16, N = 3SE +/- 0.26, N = 5SE +/- 0.16, N = 320.5020.1120.09MIN: 19.49 / MAX: 93.84MIN: 19.25 / MAX: 84.98MIN: 19.67 / MAX: 22.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet123510152025Min: 20.17 / Avg: 20.5 / Max: 20.67Min: 19.46 / Avg: 20.11 / Max: 20.85Min: 19.81 / Avg: 20.09 / Max: 20.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet123510152025SE +/- 0.18, N = 3SE +/- 0.21, N = 5SE +/- 0.26, N = 322.7122.4722.73MIN: 22.24 / MAX: 30.26MIN: 21.44 / MAX: 42.37MIN: 22.09 / MAX: 28.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet123510152025Min: 22.41 / Avg: 22.71 / Max: 23.02Min: 21.75 / Avg: 22.47 / Max: 23.02Min: 22.24 / Avg: 22.73 / Max: 23.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v21233691215SE +/- 0.15, N = 3SE +/- 0.13, N = 5SE +/- 0.17, N = 39.999.9510.24MIN: 9.45 / MAX: 22.3MIN: 9.11 / MAX: 23.8MIN: 9.49 / MAX: 25.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v21233691215Min: 9.74 / Avg: 9.99 / Max: 10.27Min: 9.69 / Avg: 9.95 / Max: 10.36Min: 9.91 / Avg: 10.24 / Max: 10.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v31233691215SE +/- 0.16, N = 3SE +/- 0.13, N = 5SE +/- 0.13, N = 39.549.449.66MIN: 8.86 / MAX: 29.64MIN: 8.82 / MAX: 31.17MIN: 9.07 / MAX: 25.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v31233691215Min: 9.21 / Avg: 9.54 / Max: 9.74Min: 9.07 / Avg: 9.44 / Max: 9.75Min: 9.41 / Avg: 9.66 / Max: 9.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v21233691215SE +/- 0.18, N = 3SE +/- 0.18, N = 5SE +/- 0.18, N = 39.229.379.62MIN: 8.65 / MAX: 9.98MIN: 8.52 / MAX: 10.73MIN: 8.69 / MAX: 13.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v21233691215Min: 8.88 / Avg: 9.22 / Max: 9.51Min: 9.04 / Avg: 9.37 / Max: 9.86Min: 9.27 / Avg: 9.62 / Max: 9.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet1233691215SE +/- 0.11, N = 3SE +/- 0.11, N = 5SE +/- 0.08, N = 39.289.269.39MIN: 8.7 / MAX: 33.25MIN: 8.61 / MAX: 30.88MIN: 8.67 / MAX: 31.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet1233691215Min: 9.11 / Avg: 9.28 / Max: 9.48Min: 8.98 / Avg: 9.26 / Max: 9.5Min: 9.26 / Avg: 9.39 / Max: 9.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b01233691215SE +/- 0.03, N = 3SE +/- 0.14, N = 5SE +/- 0.20, N = 312.7512.5412.83MIN: 12.48 / MAX: 14.63MIN: 11.99 / MAX: 15.19MIN: 12.01 / MAX: 16.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b012348121620Min: 12.69 / Avg: 12.75 / Max: 12.79Min: 12.22 / Avg: 12.54 / Max: 12.93Min: 12.46 / Avg: 12.83 / Max: 13.161. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface1231.01932.03863.05794.07725.0965SE +/- 0.01, N = 3SE +/- 0.06, N = 5SE +/- 0.10, N = 34.534.464.49MIN: 4.45 / MAX: 5.46MIN: 4.23 / MAX: 5.72MIN: 4.25 / MAX: 5.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface123246810Min: 4.51 / Avg: 4.53 / Max: 4.55Min: 4.29 / Avg: 4.46 / Max: 4.57Min: 4.3 / Avg: 4.49 / Max: 4.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet123612182430SE +/- 0.15, N = 3SE +/- 0.16, N = 5SE +/- 0.35, N = 323.0322.8422.97MIN: 22.75 / MAX: 51.05MIN: 21.98 / MAX: 97.93MIN: 22.25 / MAX: 28.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet123510152025Min: 22.87 / Avg: 23.03 / Max: 23.33Min: 22.29 / Avg: 22.84 / Max: 23.26Min: 22.39 / Avg: 22.97 / Max: 23.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg161231020304050SE +/- 0.34, N = 3SE +/- 0.45, N = 5SE +/- 0.69, N = 340.3241.0642.27MIN: 37.85 / MAX: 76.91MIN: 39.85 / MAX: 73.71MIN: 39.36 / MAX: 116.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16123918273645Min: 39.65 / Avg: 40.32 / Max: 40.66Min: 40.13 / Avg: 41.06 / Max: 42.63Min: 40.93 / Avg: 42.27 / Max: 43.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1812348121620SE +/- 0.10, N = 3SE +/- 0.11, N = 5SE +/- 0.04, N = 315.7115.5715.74MIN: 15.24 / MAX: 76.19MIN: 15.22 / MAX: 41.73MIN: 15.32 / MAX: 63.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1812348121620Min: 15.6 / Avg: 15.71 / Max: 15.91Min: 15.31 / Avg: 15.57 / Max: 15.86Min: 15.68 / Avg: 15.74 / Max: 15.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet1233691215SE +/- 0.24, N = 3SE +/- 0.17, N = 5SE +/- 0.21, N = 311.9111.8611.90MIN: 11.58 / MAX: 13.45MIN: 11.46 / MAX: 14.96MIN: 11.47 / MAX: 12.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet1233691215Min: 11.66 / Avg: 11.91 / Max: 12.38Min: 11.54 / Avg: 11.86 / Max: 12.28Min: 11.55 / Avg: 11.9 / Max: 12.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50123714212835SE +/- 0.29, N = 3SE +/- 0.31, N = 5SE +/- 0.06, N = 328.4528.2228.26MIN: 27.64 / MAX: 56.75MIN: 27.04 / MAX: 114.01MIN: 26.33 / MAX: 68.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50123612182430Min: 27.87 / Avg: 28.45 / Max: 28.82Min: 27.34 / Avg: 28.22 / Max: 28.95Min: 28.2 / Avg: 28.26 / Max: 28.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny123714212835SE +/- 0.22, N = 3SE +/- 0.42, N = 5SE +/- 0.15, N = 332.1032.1431.81MIN: 31.15 / MAX: 36.29MIN: 30.96 / MAX: 53.56MIN: 31.14 / MAX: 42.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny123714212835Min: 31.74 / Avg: 32.1 / Max: 32.5Min: 31.33 / Avg: 32.14 / Max: 33.65Min: 31.51 / Avg: 31.81 / Max: 31.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU123246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 37.007.026.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1233691215Min: 6.96 / Avg: 7 / Max: 7.02Min: 7.01 / Avg: 7.02 / Max: 7.03Min: 6.92 / Avg: 6.95 / Max: 6.981. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1235001000150020002500SE +/- 2.42, N = 3SE +/- 5.93, N = 3SE +/- 8.10, N = 32518.372518.582533.701. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU123400800120016002000Min: 2514.75 / Avg: 2518.37 / Max: 2522.96Min: 2511.1 / Avg: 2518.58 / Max: 2530.28Min: 2519.12 / Avg: 2533.7 / Max: 2547.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU123246810SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 36.976.986.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1233691215Min: 6.94 / Avg: 6.97 / Max: 7Min: 6.93 / Avg: 6.98 / Max: 7.02Min: 6.96 / Avg: 6.99 / Max: 7.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1235001000150020002500SE +/- 4.16, N = 3SE +/- 3.99, N = 3SE +/- 5.25, N = 32526.492519.702519.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU123400800120016002000Min: 2521.06 / Avg: 2526.49 / Max: 2534.67Min: 2515.31 / Avg: 2519.7 / Max: 2527.66Min: 2513.57 / Avg: 2519.93 / Max: 2530.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1230.93831.87662.81493.75324.6915SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.174.154.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU123246810Min: 4.16 / Avg: 4.17 / Max: 4.18Min: 4.14 / Avg: 4.15 / Max: 4.15Min: 4.15 / Avg: 4.16 / Max: 4.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1239001800270036004500SE +/- 3.40, N = 3SE +/- 2.33, N = 3SE +/- 6.74, N = 34179.404182.734167.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1237001400210028003500Min: 4172.86 / Avg: 4179.4 / Max: 4184.26Min: 4179.65 / Avg: 4182.73 / Max: 4187.29Min: 4155.84 / Avg: 4167.66 / Max: 4179.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1230.93381.86762.80143.73524.669SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 34.154.154.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU123246810Min: 4.14 / Avg: 4.15 / Max: 4.16Min: 4.13 / Avg: 4.15 / Max: 4.17Min: 4.11 / Avg: 4.14 / Max: 4.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1239001800270036004500SE +/- 3.70, N = 3SE +/- 4.93, N = 3SE +/- 3.58, N = 34182.324168.044183.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1237001400210028003500Min: 4175.03 / Avg: 4182.32 / Max: 4187.03Min: 4161.99 / Avg: 4168.04 / Max: 4177.8Min: 4176.18 / Avg: 4183.35 / Max: 4187.051. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1235K10K15K20K25KSE +/- 27.65, N = 3SE +/- 11.13, N = 3SE +/- 7.40, N = 321610.1321650.9921598.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1234K8K12K16K20KMin: 21564.59 / Avg: 21610.13 / Max: 21660.06Min: 21629.14 / Avg: 21650.99 / Max: 21665.63Min: 21585.89 / Avg: 21598.6 / Max: 21611.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1230.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.80.80.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU123246810Min: 0.8 / Avg: 0.8 / Max: 0.8Min: 0.8 / Avg: 0.8 / Max: 0.8Min: 0.8 / Avg: 0.8 / Max: 0.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1235K10K15K20K25KSE +/- 12.85, N = 3SE +/- 16.90, N = 3SE +/- 32.77, N = 321620.6721613.9021634.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1234K8K12K16K20KMin: 21605.72 / Avg: 21620.67 / Max: 21646.25Min: 21584.87 / Avg: 21613.9 / Max: 21643.42Min: 21569.32 / Avg: 21634.75 / Max: 21670.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1230.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.80.80.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU123246810Min: 0.8 / Avg: 0.8 / Max: 0.8Min: 0.8 / Avg: 0.8 / Max: 0.8Min: 0.8 / Avg: 0.8 / Max: 0.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

Hierarchical INTegration

This test runs the U.S. Department of Energy's Ames Laboratory Hierarchical INTegration (HINT) benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQUIPs, More Is BetterHierarchical INTegration 1.0Test: FLOAT12380M160M240M320M400MSE +/- 271494.10, N = 3SE +/- 357779.68, N = 3SE +/- 582471.28, N = 3385726582.81383680919.91385694400.251. (CC) gcc options: -O3 -march=native -lm
OpenBenchmarking.orgQUIPs, More Is BetterHierarchical INTegration 1.0Test: FLOAT12370M140M210M280M350MMin: 385384930.18 / Avg: 385726582.81 / Max: 386262898.18Min: 383131687.51 / Avg: 383680919.91 / Max: 384352747.31Min: 384539833.5 / Avg: 385694400.25 / Max: 386406034.281. (CC) gcc options: -O3 -march=native -lm

40 Results Shown

Dolfyn
FFTE
Timed HMMer Search
Timed MAFFT Alignment
BYTE Unix Benchmark
RNNoise
Apache CouchDB
KeyDB
GROMACS
Caffe:
  AlexNet - CPU - 100
  AlexNet - CPU - 200
  GoogleNet - CPU - 100
  GoogleNet - CPU - 200
NCNN:
  CPU - squeezenet
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
OpenVINO:
  Face Detection 0106 FP16 - CPU:
    FPS
    ms
  Face Detection 0106 FP32 - CPU:
    FPS
    ms
  Person Detection 0106 FP16 - CPU:
    FPS
    ms
  Person Detection 0106 FP32 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP32 - CPU:
    FPS
    ms
Hierarchical INTegration