Pre 10.0 Xeon

2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2010091-FI-PRE100XEO81&grs&sro.

Pre 10.0 XeonProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution1232 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads)TYAN S7106 (V2.01.B40 BIOS)Intel Sky Lake-E DMI3 Registers94GB500GB Samsung SSD 860llvmpipeVE2282 x Intel I210 + 2 x QLogic cLOM8214 1/10GbEUbuntu 20.045.9.0-050900rc6-generic (x86_64) 20200920GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.83.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x10802 x Intel I210OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x5002f01Python Details- Python 2.7.18rc1 + Python 3.8.2Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Pre 10.0 Xeonncnn: CPU - vgg16couchdb: 100 - 1000 - 24ncnn: CPU - shufflenet-v2ncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - efficientnet-b0ncnn: CPU - squeezenetdolfyn: Computational Fluid Dynamicsncnn: CPU - blazefacencnn: CPU - mnasnetkeydb: ncnn: CPU - mobilenetncnn: CPU - resnet18mafft: Multiple Sequence Alignment - LSU RNAncnn: CPU - yolov4-tinyopenvino: Face Detection 0106 FP16 - CPUncnn: CPU - googlenetncnn: CPU - resnet50gromacs: Water Benchmarkopenvino: Face Detection 0106 FP16 - CPUhint: FLOATopenvino: Person Detection 0106 FP16 - CPUrnnoise: ncnn: CPU - alexnethmmer: Pfam Database Searchffte: N=256, 3D Complex FFT Routineopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUbyte: Dhrystone 2openvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUcaffe: GoogleNet - CPU - 200caffe: GoogleNet - CPU - 100caffe: AlexNet - CPU - 200caffe: AlexNet - CPU - 10012340.32220.1689.229.999.5412.7520.5021.4454.539.28428636.1022.7115.7111.76532.107.0023.0328.453.3882518.37385726582.809184.1728.59711.91224.187108341.693252954182.324179.406.972526.4921610.134.1538439689.921620.670.80.83691921750161271006622441.06230.0409.379.959.4412.5420.1121.7704.469.26431112.3922.4715.5711.66132.147.0222.8428.223.4142518.58383680919.909064.1528.47211.86223.494108071.862688824168.044182.736.982519.7021650.994.1538381617.821613.900.80.83409341883831317326458642.27227.4459.6210.249.6612.8320.0921.4184.499.39433887.1222.7315.7411.78331.816.9522.9728.263.4122533.70385694400.252354.1628.53211.90224.406108490.035161954183.354167.666.992519.9321598.604.1438354114.721634.750.80.837477218772212958965576OpenBenchmarking.org

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg161231020304050SE +/- 0.34, N = 3SE +/- 0.45, N = 5SE +/- 0.69, N = 340.3241.0642.27MIN: 37.85 / MAX: 76.91MIN: 39.85 / MAX: 73.71MIN: 39.36 / MAX: 116.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 24

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.1.1Bulk Size: 100 - Inserts: 1000 - Rounds: 2412350100150200250SE +/- 2.11, N = 3SE +/- 2.66, N = 12SE +/- 2.56, N = 12220.17230.04227.451. (CXX) g++ options: -std=c++14 -lmozjs-68 -lm -lerl_interface -lei -fPIC -MMD

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v21233691215SE +/- 0.18, N = 3SE +/- 0.18, N = 5SE +/- 0.18, N = 39.229.379.62MIN: 8.65 / MAX: 9.98MIN: 8.52 / MAX: 10.73MIN: 8.69 / MAX: 13.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v21233691215SE +/- 0.15, N = 3SE +/- 0.13, N = 5SE +/- 0.17, N = 39.999.9510.24MIN: 9.45 / MAX: 22.3MIN: 9.11 / MAX: 23.8MIN: 9.49 / MAX: 25.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v31233691215SE +/- 0.16, N = 3SE +/- 0.13, N = 5SE +/- 0.13, N = 39.549.449.66MIN: 8.86 / MAX: 29.64MIN: 8.82 / MAX: 31.17MIN: 9.07 / MAX: 25.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b01233691215SE +/- 0.03, N = 3SE +/- 0.14, N = 5SE +/- 0.20, N = 312.7512.5412.83MIN: 12.48 / MAX: 14.63MIN: 11.99 / MAX: 15.19MIN: 12.01 / MAX: 16.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet123510152025SE +/- 0.16, N = 3SE +/- 0.26, N = 5SE +/- 0.16, N = 320.5020.1120.09MIN: 19.49 / MAX: 93.84MIN: 19.25 / MAX: 84.98MIN: 19.67 / MAX: 22.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Dolfyn

Computational Fluid Dynamics

OpenBenchmarking.orgSeconds, Fewer Is BetterDolfyn 0.527Computational Fluid Dynamics123510152025SE +/- 0.06, N = 3SE +/- 0.29, N = 4SE +/- 0.01, N = 321.4521.7721.42

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface1231.01932.03863.05794.07725.0965SE +/- 0.01, N = 3SE +/- 0.06, N = 5SE +/- 0.10, N = 34.534.464.49MIN: 4.45 / MAX: 5.46MIN: 4.23 / MAX: 5.72MIN: 4.25 / MAX: 5.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet1233691215SE +/- 0.11, N = 3SE +/- 0.11, N = 5SE +/- 0.08, N = 39.289.269.39MIN: 8.7 / MAX: 33.25MIN: 8.61 / MAX: 30.88MIN: 8.67 / MAX: 31.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

KeyDB

OpenBenchmarking.orgOps/sec, More Is BetterKeyDB 6.0.1612390K180K270K360K450KSE +/- 4163.20, N = 3SE +/- 2528.13, N = 3SE +/- 4369.74, N = 8428636.10431112.39433887.121. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet123510152025SE +/- 0.18, N = 3SE +/- 0.21, N = 5SE +/- 0.26, N = 322.7122.4722.73MIN: 22.24 / MAX: 30.26MIN: 21.44 / MAX: 42.37MIN: 22.09 / MAX: 28.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1812348121620SE +/- 0.10, N = 3SE +/- 0.11, N = 5SE +/- 0.04, N = 315.7115.5715.74MIN: 15.24 / MAX: 76.19MIN: 15.22 / MAX: 41.73MIN: 15.32 / MAX: 63.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Timed MAFFT Alignment

Multiple Sequence Alignment - LSU RNA

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 7.471Multiple Sequence Alignment - LSU RNA1233691215SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.20, N = 311.7711.6611.781. (CC) gcc options: -std=c99 -O3 -lm -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny123714212835SE +/- 0.22, N = 3SE +/- 0.42, N = 5SE +/- 0.15, N = 332.1032.1431.81MIN: 31.15 / MAX: 36.29MIN: 30.96 / MAX: 53.56MIN: 31.14 / MAX: 42.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU123246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 37.007.026.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet123612182430SE +/- 0.15, N = 3SE +/- 0.16, N = 5SE +/- 0.35, N = 323.0322.8422.97MIN: 22.75 / MAX: 51.05MIN: 21.98 / MAX: 97.93MIN: 22.25 / MAX: 28.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50123714212835SE +/- 0.29, N = 3SE +/- 0.31, N = 5SE +/- 0.06, N = 328.4528.2228.26MIN: 27.64 / MAX: 56.75MIN: 27.04 / MAX: 114.01MIN: 26.33 / MAX: 68.531. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

GROMACS

Water Benchmark

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2020.3Water Benchmark1230.76821.53642.30463.07283.841SE +/- 0.007, N = 3SE +/- 0.004, N = 3SE +/- 0.008, N = 33.3883.4143.4121. (CXX) g++ options: -O3 -pthread -lrt -lpthread -lm

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1235001000150020002500SE +/- 2.42, N = 3SE +/- 5.93, N = 3SE +/- 8.10, N = 32518.372518.582533.701. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

Hierarchical INTegration

Test: FLOAT

OpenBenchmarking.orgQUIPs, More Is BetterHierarchical INTegration 1.0Test: FLOAT12380M160M240M320M400MSE +/- 271494.10, N = 3SE +/- 357779.68, N = 3SE +/- 582471.28, N = 3385726582.81383680919.91385694400.251. (CC) gcc options: -O3 -march=native -lm

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1230.93831.87662.81493.75324.6915SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.174.154.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

RNNoise

OpenBenchmarking.orgSeconds, Fewer Is BetterRNNoise 2020-06-28123714212835SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 328.6028.4728.531. (CC) gcc options: -O2 -pedantic -fvisibility=hidden

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet1233691215SE +/- 0.24, N = 3SE +/- 0.17, N = 5SE +/- 0.21, N = 311.9111.8611.90MIN: 11.58 / MAX: 13.45MIN: 11.46 / MAX: 14.96MIN: 11.47 / MAX: 12.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Timed HMMer Search

Pfam Database Search

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed HMMer Search 3.3.1Pfam Database Search12350100150200250SE +/- 0.61, N = 3SE +/- 0.39, N = 3SE +/- 0.41, N = 3224.19223.49224.411. (CC) gcc options: -O3 -pthread -lhmmer -leasel -lm

FFTE

N=256, 3D Complex FFT Routine

OpenBenchmarking.orgMFLOPS, More Is BetterFFTE 7.0N=256, 3D Complex FFT Routine12320K40K60K80K100KSE +/- 781.22, N = 3SE +/- 1010.36, N = 3SE +/- 243.36, N = 3108341.69108071.86108490.041. (F9X) gfortran options: -O3 -fomit-frame-pointer -fopenmp

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1239001800270036004500SE +/- 3.70, N = 3SE +/- 4.93, N = 3SE +/- 3.58, N = 34182.324168.044183.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU1239001800270036004500SE +/- 3.40, N = 3SE +/- 2.33, N = 3SE +/- 6.74, N = 34179.404182.734167.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU123246810SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 36.976.986.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1235001000150020002500SE +/- 4.16, N = 3SE +/- 3.99, N = 3SE +/- 5.25, N = 32526.492519.702519.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1235K10K15K20K25KSE +/- 27.65, N = 3SE +/- 11.13, N = 3SE +/- 7.40, N = 321610.1321650.9921598.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU1230.93381.86762.80143.73524.669SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 34.154.154.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

BYTE Unix Benchmark

Computational Test: Dhrystone 2

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 3.6Computational Test: Dhrystone 21238M16M24M32M40MSE +/- 11954.47, N = 3SE +/- 57895.53, N = 3SE +/- 30065.94, N = 338439689.938381617.838354114.7

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1235K10K15K20K25KSE +/- 12.85, N = 3SE +/- 16.90, N = 3SE +/- 32.77, N = 321620.6721613.9021634.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU1230.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.80.80.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1230.180.360.540.720.9SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.80.80.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

Caffe

Model: GoogleNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 20012380K160K240K320K400KSE +/- 4358.06, N = 3SE +/- 17972.71, N = 9SE +/- 2056.32, N = 33691923409343747721. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: GoogleNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: GoogleNet - Acceleration: CPU - Iterations: 10012340K80K120K160K200KSE +/- 8266.82, N = 9SE +/- 1658.31, N = 12SE +/- 502.77, N = 31750161883831877221. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: AlexNet - Acceleration: CPU - Iterations: 200

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 20012330K60K90K120K150KSE +/- 3833.15, N = 11SE +/- 472.02, N = 3SE +/- 242.40, N = 31271001317321295891. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Caffe

Model: AlexNet - Acceleration: CPU - Iterations: 100

OpenBenchmarking.orgMilli-Seconds, Fewer Is BetterCaffe 2020-02-13Model: AlexNet - Acceleration: CPU - Iterations: 10012314K28K42K56K70KSE +/- 124.86, N = 3SE +/- 1797.00, N = 12SE +/- 92.99, N = 36622464586655761. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas

Phoronix Test Suite v10.8.5