Xeon E-2288G Deep Learning Intel Xeon E-2288G testing with a Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS) and NVIDIA Quadro RTX 4000 8GB on Ubuntu 19.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2009188-NI-XEONE228891 .
Xeon E-2288G Deep Learning Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver Compiler File-System Screen Resolution Xeon E-2288G Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads) Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS) Intel Cannon Lake PCH 2 x 32 GB DDR4-2667MT/s Samsung M378A4G43MB1-CTD Samsung SSD 970 EVO Plus 250GB NVIDIA Quadro RTX 4000 8GB Intel Cannon Lake PCH cAVS VE228 Intel I219-LM + Intel I210 Ubuntu 19.10 5.3.0-64-generic (x86_64) GNOME Shell 3.34.1 X Server 1.20.5 modesetting 1.20.5 GCC 11.0.0 20200917 ext4 1920x1080 OpenBenchmarking.org - --disable-multilib --enable-checking=release --enable-languages=c,c++,fortran - Scaling Governor: intel_pstate powersave - CPU Microcode: 0xd6 - itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Mitigation of TSX disabled + tsx_async_abort: Mitigation of TSX disabled
Xeon E-2288G Deep Learning mnn: SqueezeNetV1.0 mnn: resnet-v2-50 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 ncnn: CPU - squeezenet_int8 ncnn: CPU - mobilenet_v3 ncnn: CPU - squeezenet ncnn: CPU - mnasnet ncnn: CPU - blazeface ncnn: CPU - googlenet_int8 ncnn: CPU - vgg16_int8 ncnn: CPU - resnet18_int8 ncnn: CPU - alexnet ncnn: CPU - resnet50_int8 ncnn: CPU - mobilenetv2_yolov3 Xeon E-2288G 6.409 41.955 3.535 6.940 43.788 17.44 4.18 3.22 4.28 1.59 54.02 110.16 25.04 15.09 114.14 18.87 OpenBenchmarking.org
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: SqueezeNetV1.0 Xeon E-2288G 2 4 6 8 10 SE +/- 0.015, N = 3 6.409 MIN: 6.16 / MAX: 11.38 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: resnet-v2-50 Xeon E-2288G 10 20 30 40 50 SE +/- 0.29, N = 3 41.96 MIN: 35.94 / MAX: 73.93 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: MobileNetV2_224 Xeon E-2288G 0.7954 1.5908 2.3862 3.1816 3.977 SE +/- 0.115, N = 3 3.535 MIN: 3.13 / MAX: 15.72 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: mobilenet-v1-1.0 Xeon E-2288G 2 4 6 8 10 SE +/- 0.207, N = 3 6.940 MIN: 6.43 / MAX: 18.37 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: inception-v3 Xeon E-2288G 10 20 30 40 50 SE +/- 0.07, N = 3 43.79 MIN: 43.34 / MAX: 55.15 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU - Model: squeezenet_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet_int8 Xeon E-2288G 4 8 12 16 20 SE +/- 0.07, N = 3 17.44 MIN: 17.17 / MAX: 25.82 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet_v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenet_v3 Xeon E-2288G 0.9405 1.881 2.8215 3.762 4.7025 SE +/- 0.11, N = 3 4.18 MIN: 3.93 / MAX: 4.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet Xeon E-2288G 0.7245 1.449 2.1735 2.898 3.6225 SE +/- 0.14, N = 3 3.22 MIN: 2.89 / MAX: 3.65 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mnasnet Xeon E-2288G 0.963 1.926 2.889 3.852 4.815 SE +/- 0.01, N = 3 4.28 MIN: 4.14 / MAX: 4.6 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: blazeface Xeon E-2288G 0.3578 0.7156 1.0734 1.4312 1.789 SE +/- 0.00, N = 3 1.59 MIN: 1.53 / MAX: 1.75 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: googlenet_int8 Xeon E-2288G 12 24 36 48 60 SE +/- 0.45, N = 3 54.02 MIN: 53.22 / MAX: 57.66 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: vgg16_int8 Xeon E-2288G 20 40 60 80 100 SE +/- 0.09, N = 3 110.16 MIN: 109.3 / MAX: 119.41 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet18_int8 Xeon E-2288G 6 12 18 24 30 SE +/- 0.07, N = 3 25.04 MIN: 24.69 / MAX: 34.17 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: alexnet Xeon E-2288G 4 8 12 16 20 SE +/- 0.01, N = 3 15.09 MIN: 14.98 / MAX: 15.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50_int8 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet50_int8 Xeon E-2288G 30 60 90 120 150 SE +/- 0.18, N = 3 114.14 MIN: 113.61 / MAX: 122.67 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenetv2_yolov3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenetv2_yolov3 Xeon E-2288G 5 10 15 20 25 SE +/- 0.07, N = 3 18.87 MIN: 18.64 / MAX: 19.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Phoronix Test Suite v10.8.4