Xeon E NN Intel Xeon E-2288G testing with a Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS) and NVIDIA Quadro RTX 4000 8GB on Ubuntu 19.10 via the Phoronix Test Suite. 1: Processor: Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads), Motherboard: Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 2 x 32 GB DDR4-2667MT/s Samsung M378A4G43MB1-CTD, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: NVIDIA Quadro RTX 4000 8GB, Audio: Intel Cannon Lake PCH cAVS, Monitor: VE228, Network: Intel I219-LM + Intel I210 OS: Ubuntu 19.10, Kernel: 5.3.0-64-generic (x86_64), Desktop: GNOME Shell 3.34.1, Display Server: X Server 1.20.5, Display Driver: modesetting 1.20.5, Compiler: GCC 11.0.0 20200924, File-System: ext4, Screen Resolution: 1920x1080 2: Processor: Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads), Motherboard: Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 2 x 32 GB DDR4-2667MT/s Samsung M378A4G43MB1-CTD, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: NVIDIA Quadro RTX 4000 8GB, Audio: Intel Cannon Lake PCH cAVS, Monitor: VE228, Network: Intel I219-LM + Intel I210 OS: Ubuntu 19.10, Kernel: 5.3.0-64-generic (x86_64), Desktop: GNOME Shell 3.34.1, Display Server: X Server 1.20.5, Display Driver: modesetting 1.20.5, Compiler: GCC 11.0.0 20200924, File-System: ext4, Screen Resolution: 1920x1080 3: Processor: Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads), Motherboard: Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 2 x 32 GB DDR4-2667MT/s Samsung M378A4G43MB1-CTD, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: NVIDIA Quadro RTX 4000 8GB, Audio: Intel Cannon Lake PCH cAVS, Monitor: VE228, Network: Intel I219-LM + Intel I210 OS: Ubuntu 19.10, Kernel: 5.3.0-64-generic (x86_64), Desktop: GNOME Shell 3.34.1, Display Server: X Server 1.20.5, Display Driver: modesetting 1.20.5, Compiler: GCC 11.0.0 20200924, File-System: ext4, Screen Resolution: 1920x1080 NCNN 20200916 Target: CPU - Model: squeezenet ms < Lower Is Better 1 . 29.76 |=================================================================== 2 . 30.21 |==================================================================== 3 . 30.24 |==================================================================== NCNN 20200916 Target: CPU - Model: mobilenet ms < Lower Is Better 1 . 18.95 |=================================================================== 2 . 19.18 |==================================================================== 3 . 19.00 |=================================================================== NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1 . 5.32 |==================================================================== 2 . 5.43 |===================================================================== 3 . 5.39 |==================================================================== NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1 . 4.19 |=================================================================== 2 . 4.31 |===================================================================== 3 . 4.25 |==================================================================== NCNN 20200916 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 1 . 3.20 |================================================================= 2 . 3.42 |===================================================================== 3 . 3.25 |================================================================== NCNN 20200916 Target: CPU - Model: mnasnet ms < Lower Is Better 1 . 4.22 |==================================================================== 2 . 4.19 |==================================================================== 3 . 4.27 |===================================================================== NCNN 20200916 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 1 . 6.68 |===================================================================== 2 . 6.65 |==================================================================== 3 . 6.70 |===================================================================== NCNN 20200916 Target: CPU - Model: blazeface ms < Lower Is Better 1 . 1.64 |===================================================================== 2 . 1.58 |================================================================== 3 . 1.59 |=================================================================== NCNN 20200916 Target: CPU - Model: googlenet ms < Lower Is Better 1 . 48.63 |================================================================== 2 . 50.07 |==================================================================== 3 . 49.07 |=================================================================== NCNN 20200916 Target: CPU - Model: vgg16 ms < Lower Is Better 1 . 108.54 |=================================================================== 2 . 109.08 |=================================================================== 3 . 108.70 |=================================================================== NCNN 20200916 Target: CPU - Model: resnet18 ms < Lower Is Better 1 . 24.48 |=================================================================== 2 . 24.71 |==================================================================== 3 . 24.52 |=================================================================== NCNN 20200916 Target: CPU - Model: alexnet ms < Lower Is Better 1 . 15.08 |==================================================================== 2 . 15.15 |==================================================================== 3 . 15.02 |=================================================================== NCNN 20200916 Target: CPU - Model: resnet50 ms < Lower Is Better 1 . 107.84 |================================================================== 2 . 108.74 |=================================================================== 3 . 107.99 |=================================================================== NCNN 20200916 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 1 . 28.69 |==================================================================== 2 . 28.89 |==================================================================== 3 . 28.90 |==================================================================== TNN 0.2.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better 1 . 279.01 |=================================================================== 2 . 279.04 |=================================================================== 3 . 278.77 |=================================================================== TNN 0.2.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better 1 . 268.47 |=================================================================== 2 . 268.47 |=================================================================== 3 . 268.48 |===================================================================