Xeon Okt

Intel Xeon Gold 5218R testing with a GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2010174-FI-XEONOKT2449
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Bioinformatics 2 Tests
C/C++ Compiler Tests 3 Tests
CPU Massive 4 Tests
Fortran Tests 2 Tests
HPC - High Performance Computing 10 Tests
Machine Learning 4 Tests
Molecular Dynamics 3 Tests
Multi-Core 2 Tests
NVIDIA GPU Compute 2 Tests
Scientific Computing 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Xeon Gold 6249R 2P
October 13 2020
  8 Hours, 6 Minutes
Xeon Gold 6238R 2P
October 16 2020
  7 Hours, 10 Minutes
Xeon Gold 6238R
October 16 2020
  1 Hour, 36 Minutes
Xeon Gold 5218R
October 17 2020
  1 Hour, 47 Minutes
Invert Hiding All Results Option
  4 Hours, 40 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Xeon OktProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R2 x Intel Xeon Gold 6248R @ 4.00GHz (48 Cores / 96 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPE21D280GAllvmpipeVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.8.0-050800rc6daily20200721-generic (x86_64) 20200720GNOME Shell 3.36.1X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x10802 x Intel Xeon Gold 6238R @ 4.00GHz (56 Cores / 112 Threads)Intel Xeon Gold 6238R @ 4.00GHz (28 Cores / 56 Threads)188GB3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)Intel Xeon Gold 5218R @ 4.00GHz (20 Cores / 40 Threads)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performance - CPU Microcode: 0x500002cSecurity Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218RResult OverviewPhoronix Test Suite100%151%203%254%306%GROMACSNAMDFFTENCNNTimed HMMer SearchTimed MAFFT AlignmentMobile Neural NetworkTNNDolfynBYTE Unix BenchmarkRNNoise

Xeon Oktnamd: ATPase Simulation - 327,506 Atomsdolfyn: Computational Fluid Dynamicsffte: N=256, 3D Complex FFT Routinehmmer: Pfam Database Searchmafft: Multiple Sequence Alignment - LSU RNAbyte: Dhrystone 2rnnoise: gromacs: Water Benchmarkmnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinytnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.1Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R0.4050921.807165038.38363931151.40010.94339326273.528.4115.5718.73133.2245.0615.58030.88423.1125.5612.7212.8212.6511.9316.735.9325.7439.2915.3710.7330.1332.27346.689337.2560.4372721.615144010.79611615172.09310.74339223516.828.4155.25010.55035.0786.0966.09133.35126.6828.6115.7115.6715.2414.7320.697.7432.2637.5918.6712.0934.3234.57363.709337.2650.8335221.72796617.009519945142.7069.60139094495.428.4222.7208.10035.1254.6546.15435.02817.1119.468.007.297.207.369.923.4719.7428.9813.349.9324.5427.72353.570337.6631.1542921.83571128.499065317143.5969.74439436913.628.4091.8229.25440.4424.9566.56238.53616.4818.166.806.055.866.248.372.9018.0929.4313.029.8923.3927.90355.458337.580OpenBenchmarking.org

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R0.25970.51940.77911.03881.2985SE +/- 0.00120, N = 3SE +/- 0.00228, N = 3SE +/- 0.00292, N = 3SE +/- 0.00080, N = 30.405090.437270.833521.15429
OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R246810Min: 0.4 / Avg: 0.41 / Max: 0.41Min: 0.43 / Avg: 0.44 / Max: 0.44Min: 0.83 / Avg: 0.83 / Max: 0.84Min: 1.15 / Avg: 1.15 / Max: 1.16

Dolfyn

Dolfyn is a Computational Fluid Dynamics (CFD) code of modern numerical simulation techniques. The Dolfyn test profile measures the execution time of the bundled computational fluid dynamics demos that are bundled with Dolfyn. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid DynamicsXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R510152025SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 321.8121.6221.7321.84
OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid DynamicsXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R510152025Min: 21.71 / Avg: 21.81 / Max: 21.89Min: 21.55 / Avg: 21.62 / Max: 21.66Min: 21.68 / Avg: 21.73 / Max: 21.79Min: 21.8 / Avg: 21.83 / Max: 21.87

FFTE

FFTE is a package by Daisuke Takahashi to compute Discrete Fourier Transforms of 1-, 2- and 3- dimensional sequences of length (2^p)*(3^q)*(5^r). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT RoutineXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R40K80K120K160K200KSE +/- 563.06, N = 3SE +/- 507.43, N = 3SE +/- 84.30, N = 3SE +/- 537.92, N = 3165038.38144010.8096617.0171128.501. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp
OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT RoutineXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R30K60K90K120K150KMin: 164191.71 / Avg: 165038.38 / Max: 166104.73Min: 143336.46 / Avg: 144010.8 / Max: 145004.78Min: 96450.99 / Avg: 96617.01 / Max: 96725.49Min: 70062.16 / Avg: 71128.5 / Max: 71785.241. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

Timed HMMer Search

This test searches through the Pfam database of profile hidden markov models. The search finds the domain structure of Drosophila Sevenless protein. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database SearchXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R4080120160200SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 3151.40172.09142.71143.601. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database SearchXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R306090120150Min: 151.24 / Avg: 151.4 / Max: 151.64Min: 171.82 / Avg: 172.09 / Max: 172.37Min: 142.43 / Avg: 142.71 / Max: 142.91Min: 143.47 / Avg: 143.6 / Max: 143.831. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm

Timed MAFFT Alignment

This test performs an alignment of 100 pyruvate decarboxylase sequences. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNAXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215SE +/- 0.124, N = 3SE +/- 0.074, N = 3SE +/- 0.103, N = 3SE +/- 0.087, N = 310.94310.7439.6019.7441. (CC) gcc options: -std=c99 -O3 -lm -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNAXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215Min: 10.74 / Avg: 10.94 / Max: 11.17Min: 10.66 / Avg: 10.74 / Max: 10.89Min: 9.4 / Avg: 9.6 / Max: 9.73Min: 9.65 / Avg: 9.74 / Max: 9.921. (CC) gcc options: -std=c99 -O3 -lm -lpthread

BYTE Unix Benchmark

This is a test of BYTE. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R8M16M24M32M40MSE +/- 86882.36, N = 3SE +/- 111868.85, N = 3SE +/- 21335.39, N = 3SE +/- 30912.77, N = 339326273.539223516.839094495.439436913.6
OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R7M14M21M28M35MMin: 39155669.8 / Avg: 39326273.53 / Max: 39440148.3Min: 39101794.8 / Avg: 39223516.8 / Max: 39446956.2Min: 39061047.4 / Avg: 39094495.37 / Max: 39134165.4Min: 39375608.4 / Avg: 39436913.63 / Max: 39474498

RNNoise

RNNoise is a recurrent neural network for audio noise reduction developed by Mozilla and Xiph.Org. This test profile is a single-threaded test measuring the time to denoise a sample 26 minute long 16-bit RAW audio file using this recurrent neural network noise suppression library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R714212835SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 328.4128.4228.4228.411. (CC) gcc options: -O2 -pedantic -fvisibility=hidden
OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R612182430Min: 28.35 / Avg: 28.41 / Max: 28.45Min: 28.41 / Avg: 28.41 / Max: 28.42Min: 28.36 / Avg: 28.42 / Max: 28.46Min: 28.38 / Avg: 28.41 / Max: 28.431. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing on the CPU with the water_GMX50 data. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water BenchmarkXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R1.25352.5073.76055.0146.2675SE +/- 0.008, N = 3SE +/- 0.012, N = 3SE +/- 0.016, N = 3SE +/- 0.003, N = 35.5715.2502.7201.8221. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm
OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water BenchmarkXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R246810Min: 5.56 / Avg: 5.57 / Max: 5.59Min: 5.23 / Avg: 5.25 / Max: 5.27Min: 2.69 / Avg: 2.72 / Max: 2.75Min: 1.82 / Avg: 1.82 / Max: 1.831. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by ALibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: SqueezeNetV1.0Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215SE +/- 0.274, N = 15SE +/- 0.148, N = 3SE +/- 0.078, N = 3SE +/- 0.137, N = 48.73110.5508.1009.254MIN: 6.66 / MAX: 19.33MIN: 9.79 / MAX: 18.56MIN: 7.66 / MAX: 10.31MIN: 8.41 / MAX: 10.481. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: SqueezeNetV1.0Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215Min: 7.22 / Avg: 8.73 / Max: 10.35Min: 10.3 / Avg: 10.55 / Max: 10.81Min: 7.99 / Avg: 8.1 / Max: 8.25Min: 9.02 / Avg: 9.25 / Max: 9.651. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: resnet-v2-50Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R918273645SE +/- 0.30, N = 15SE +/- 0.55, N = 3SE +/- 0.54, N = 3SE +/- 1.47, N = 433.2235.0835.1340.44MIN: 29.49 / MAX: 214.74MIN: 31.13 / MAX: 87.98MIN: 33.6 / MAX: 43.39MIN: 37.42 / MAX: 45.21. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: resnet-v2-50Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R816243240Min: 30.75 / Avg: 33.22 / Max: 35.5Min: 33.99 / Avg: 35.08 / Max: 35.74Min: 34.26 / Avg: 35.13 / Max: 36.12Min: 37.99 / Avg: 40.44 / Max: 44.31. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: MobileNetV2_224Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R246810SE +/- 0.143, N = 15SE +/- 0.014, N = 3SE +/- 0.150, N = 3SE +/- 0.130, N = 45.0616.0964.6544.956MIN: 4.28 / MAX: 11.55MIN: 5.53 / MAX: 6.32MIN: 4.19 / MAX: 5.14MIN: 4.66 / MAX: 5.81. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: MobileNetV2_224Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R246810Min: 4.46 / Avg: 5.06 / Max: 5.84Min: 6.07 / Avg: 6.1 / Max: 6.11Min: 4.36 / Avg: 4.65 / Max: 4.83Min: 4.8 / Avg: 4.96 / Max: 5.351. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: mobilenet-v1-1.0Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R246810SE +/- 0.023, N = 15SE +/- 0.192, N = 3SE +/- 0.101, N = 3SE +/- 0.616, N = 45.5806.0916.1546.562MIN: 5.02 / MAX: 12.25MIN: 5.5 / MAX: 6.75MIN: 5.65 / MAX: 6.6MIN: 5.77 / MAX: 8.71. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: mobilenet-v1-1.0Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215Min: 5.43 / Avg: 5.58 / Max: 5.75Min: 5.85 / Avg: 6.09 / Max: 6.47Min: 5.96 / Avg: 6.15 / Max: 6.29Min: 5.89 / Avg: 6.56 / Max: 8.411. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: inception-v3Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R918273645SE +/- 0.21, N = 15SE +/- 0.45, N = 3SE +/- 1.26, N = 3SE +/- 0.29, N = 430.8833.3535.0338.54MIN: 29.04 / MAX: 109.69MIN: 31.8 / MAX: 97.66MIN: 32.67 / MAX: 38.29MIN: 37.33 / MAX: 40.331. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2020-09-17Model: inception-v3Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R816243240Min: 29.47 / Avg: 30.88 / Max: 32Min: 32.48 / Avg: 33.35 / Max: 33.93Min: 33.51 / Avg: 35.03 / Max: 37.53Min: 38.05 / Avg: 38.54 / Max: 39.341. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R612182430SE +/- 0.39, N = 15SE +/- 0.21, N = 14SE +/- 0.01, N = 3SE +/- 0.03, N = 323.1126.6817.1116.48MIN: 21.2 / MAX: 99.49MIN: 25.27 / MAX: 68.98MIN: 16.92 / MAX: 19.11MIN: 16.31 / MAX: 18.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R612182430Min: 21.47 / Avg: 23.11 / Max: 26.62Min: 25.82 / Avg: 26.68 / Max: 28.09Min: 17.1 / Avg: 17.11 / Max: 17.12Min: 16.42 / Avg: 16.48 / Max: 16.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R714212835SE +/- 1.22, N = 15SE +/- 0.13, N = 14SE +/- 0.16, N = 3SE +/- 0.02, N = 325.5628.6119.4618.16MIN: 23.48 / MAX: 2475.96MIN: 27.8 / MAX: 69.84MIN: 19.15 / MAX: 21.78MIN: 18.03 / MAX: 20.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R612182430Min: 23.74 / Avg: 25.56 / Max: 42.56Min: 28.05 / Avg: 28.61 / Max: 29.47Min: 19.28 / Avg: 19.46 / Max: 19.78Min: 18.13 / Avg: 18.16 / Max: 18.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620SE +/- 0.12, N = 15SE +/- 0.09, N = 14SE +/- 0.02, N = 3SE +/- 0.02, N = 312.7215.718.006.80MIN: 11.62 / MAX: 52.58MIN: 14.55 / MAX: 101.34MIN: 7.55 / MAX: 11.32MIN: 6.4 / MAX: 9.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620Min: 12.01 / Avg: 12.72 / Max: 13.69Min: 15.14 / Avg: 15.71 / Max: 16.32Min: 7.97 / Avg: 8 / Max: 8.03Min: 6.76 / Avg: 6.8 / Max: 6.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620SE +/- 0.10, N = 15SE +/- 0.10, N = 14SE +/- 0.03, N = 3SE +/- 0.02, N = 312.8215.677.296.05MIN: 11.94 / MAX: 48MIN: 14.9 / MAX: 56.83MIN: 7 / MAX: 9.78MIN: 5.83 / MAX: 8.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620Min: 12.27 / Avg: 12.82 / Max: 13.64Min: 15.11 / Avg: 15.67 / Max: 16.39Min: 7.22 / Avg: 7.29 / Max: 7.32Min: 6.03 / Avg: 6.05 / Max: 6.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620SE +/- 0.12, N = 15SE +/- 0.10, N = 14SE +/- 0.01, N = 3SE +/- 0.02, N = 312.6515.247.205.86MIN: 11.5 / MAX: 53.06MIN: 14.25 / MAX: 61.5MIN: 6.72 / MAX: 9.36MIN: 5.56 / MAX: 8.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620Min: 11.89 / Avg: 12.65 / Max: 13.67Min: 14.7 / Avg: 15.24 / Max: 15.84Min: 7.18 / Avg: 7.2 / Max: 7.22Min: 5.82 / Avg: 5.86 / Max: 5.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620SE +/- 0.06, N = 15SE +/- 0.08, N = 14SE +/- 0.07, N = 3SE +/- 0.01, N = 311.9314.737.366.24MIN: 11.13 / MAX: 58.19MIN: 13.84 / MAX: 40.88MIN: 7.06 / MAX: 7.96MIN: 5.95 / MAX: 8.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620Min: 11.54 / Avg: 11.93 / Max: 12.41Min: 14.27 / Avg: 14.73 / Max: 15.19Min: 7.25 / Avg: 7.36 / Max: 7.49Min: 6.22 / Avg: 6.24 / Max: 6.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R510152025SE +/- 0.11, N = 15SE +/- 0.14, N = 14SE +/- 0.05, N = 3SE +/- 0.04, N = 316.7320.699.928.37MIN: 15.58 / MAX: 46.71MIN: 19.33 / MAX: 281.38MIN: 9.4 / MAX: 10.59MIN: 7.98 / MAX: 26.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R510152025Min: 15.95 / Avg: 16.73 / Max: 17.5Min: 19.97 / Avg: 20.69 / Max: 21.86Min: 9.82 / Avg: 9.92 / Max: 9.99Min: 8.29 / Avg: 8.37 / Max: 8.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazefaceXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R246810SE +/- 0.04, N = 15SE +/- 0.36, N = 14SE +/- 0.01, N = 3SE +/- 0.00, N = 35.937.743.472.90MIN: 5.63 / MAX: 14.96MIN: 7.04 / MAX: 744.5MIN: 3.43 / MAX: 3.97MIN: 2.85 / MAX: 3.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazefaceXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215Min: 5.71 / Avg: 5.93 / Max: 6.24Min: 7.11 / Avg: 7.74 / Max: 12.38Min: 3.46 / Avg: 3.47 / Max: 3.48Min: 2.89 / Avg: 2.9 / Max: 2.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R714212835SE +/- 0.23, N = 15SE +/- 0.59, N = 14SE +/- 0.03, N = 3SE +/- 0.03, N = 325.7432.2619.7418.09MIN: 24.23 / MAX: 457.41MIN: 29.19 / MAX: 1104.2MIN: 19.22 / MAX: 40.48MIN: 17.94 / MAX: 20.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R714212835Min: 24.69 / Avg: 25.74 / Max: 27.61Min: 30.32 / Avg: 32.26 / Max: 38.55Min: 19.69 / Avg: 19.74 / Max: 19.77Min: 18.04 / Avg: 18.09 / Max: 18.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R918273645SE +/- 2.28, N = 15SE +/- 0.75, N = 14SE +/- 0.04, N = 3SE +/- 0.05, N = 339.2937.5928.9829.43MIN: 30.28 / MAX: 1019.46MIN: 32.76 / MAX: 132.62MIN: 28.79 / MAX: 45.29MIN: 29.14 / MAX: 32.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R816243240Min: 34.44 / Avg: 39.29 / Max: 69.5Min: 33.39 / Avg: 37.59 / Max: 43.03Min: 28.92 / Avg: 28.98 / Max: 29.05Min: 29.37 / Avg: 29.43 / Max: 29.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R510152025SE +/- 0.36, N = 15SE +/- 0.67, N = 14SE +/- 0.02, N = 3SE +/- 0.02, N = 315.3718.6713.3413.02MIN: 14.38 / MAX: 35.06MIN: 16.51 / MAX: 906.76MIN: 13.24 / MAX: 13.85MIN: 12.92 / MAX: 17.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R510152025Min: 14.5 / Avg: 15.37 / Max: 19.23Min: 17.02 / Avg: 18.67 / Max: 26.42Min: 13.31 / Avg: 13.34 / Max: 13.38Min: 12.98 / Avg: 13.02 / Max: 13.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R3691215SE +/- 0.12, N = 15SE +/- 0.18, N = 14SE +/- 0.18, N = 3SE +/- 0.01, N = 310.7312.099.939.89MIN: 10.02 / MAX: 78.64MIN: 11.26 / MAX: 53.4MIN: 9.57 / MAX: 24.76MIN: 9.84 / MAX: 11.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnetXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R48121620Min: 10.22 / Avg: 10.73 / Max: 11.88Min: 11.4 / Avg: 12.09 / Max: 13.78Min: 9.62 / Avg: 9.93 / Max: 10.25Min: 9.87 / Avg: 9.89 / Max: 9.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R816243240SE +/- 0.70, N = 15SE +/- 0.20, N = 14SE +/- 0.04, N = 3SE +/- 0.08, N = 330.1334.3224.5423.39MIN: 27.85 / MAX: 918.7MIN: 32.66 / MAX: 164.92MIN: 24.22 / MAX: 28.19MIN: 23.08 / MAX: 26.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R714212835Min: 28.24 / Avg: 30.13 / Max: 39.06Min: 33.35 / Avg: 34.32 / Max: 35.85Min: 24.45 / Avg: 24.54 / Max: 24.59Min: 23.25 / Avg: 23.39 / Max: 23.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tinyXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R816243240SE +/- 0.86, N = 15SE +/- 0.34, N = 14SE +/- 0.14, N = 3SE +/- 0.06, N = 332.2734.5727.7227.90MIN: 28.3 / MAX: 915.32MIN: 32.37 / MAX: 746.38MIN: 27.1 / MAX: 31.73MIN: 27.22 / MAX: 30.361. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tinyXeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R714212835Min: 29.15 / Avg: 32.27 / Max: 41.71Min: 32.97 / Avg: 34.57 / Max: 36.86Min: 27.48 / Avg: 27.72 / Max: 27.96Min: 27.79 / Avg: 27.9 / Max: 281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R80160240320400SE +/- 1.37, N = 3SE +/- 2.49, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3346.69363.71353.57355.46MIN: 343.13 / MAX: 470.47MIN: 354.06 / MAX: 513.97MIN: 352.63 / MAX: 368.55MIN: 354.48 / MAX: 364.621. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: MobileNet v2Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R60120180240300Min: 344.77 / Avg: 346.69 / Max: 349.35Min: 359.46 / Avg: 363.71 / Max: 368.07Min: 353.44 / Avg: 353.57 / Max: 353.76Min: 355.31 / Avg: 355.46 / Max: 355.591. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.1Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R70140210280350SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3337.26337.27337.66337.58MIN: 336.76 / MAX: 338.51MIN: 336.96 / MAX: 338.09MIN: 336.95 / MAX: 342.59MIN: 336.76 / MAX: 340.481. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.2.3Target: CPU - Model: SqueezeNet v1.1Xeon Gold 6249R 2PXeon Gold 6238R 2PXeon Gold 6238RXeon Gold 5218R60120180240300Min: 337.21 / Avg: 337.26 / Max: 337.32Min: 337.16 / Avg: 337.27 / Max: 337.38Min: 337.36 / Avg: 337.66 / Max: 337.96Min: 337.38 / Avg: 337.58 / Max: 337.711. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -O3 -rdynamic -ldl