nn gravity too Intel Xeon E-2288G testing with a Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS) and NVIDIA Quadro RTX 4000 8GB on Ubuntu 20.10 via the Phoronix Test Suite. 1: Processor: Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads), Motherboard: Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 64GB, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: NVIDIA Quadro RTX 4000 8GB, Audio: Intel Cannon Lake PCH cAVS, Monitor: VE228, Network: Intel I219-LM + Intel I210 OS: Ubuntu 20.10, Kernel: 5.8.0-41-generic (x86_64), Desktop: GNOME Shell 3.38.2, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.32.03, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.2.109, Vulkan: 1.2.155, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 1920x1080 2: Processor: Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads), Motherboard: Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 64GB, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: NVIDIA Quadro RTX 4000 8GB, Audio: Intel Cannon Lake PCH cAVS, Monitor: VE228, Network: Intel I219-LM + Intel I210 OS: Ubuntu 20.10, Kernel: 5.8.0-41-generic (x86_64), Desktop: GNOME Shell 3.38.2, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.32.03, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.2.109, Vulkan: 1.2.155, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 1920x1080 3: Processor: Intel Xeon E-2288G @ 5.00GHz (8 Cores / 16 Threads), Motherboard: Compulab SBC-ATCFL v1.2 (ATOP3.PRD.0.29.2 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 64GB, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: NVIDIA Quadro RTX 4000 8GB, Audio: Intel Cannon Lake PCH cAVS, Monitor: VE228, Network: Intel I219-LM + Intel I210 OS: Ubuntu 20.10, Kernel: 5.8.0-41-generic (x86_64), Desktop: GNOME Shell 3.38.2, Display Server: X Server 1.20.9, Display Driver: NVIDIA 460.32.03, OpenGL: 4.6.0, OpenCL: OpenCL 1.2 CUDA 11.2.109, Vulkan: 1.2.155, Compiler: GCC 10.2.0, File-System: ext4, Screen Resolution: 1920x1080 GravityMark 1.1b Resolution: 800 x 600 - Renderer: OpenGL Frames Per Second > Higher Is Better 1 . 136.2 |==================================================================== 2 . 135.3 |==================================================================== 3 . 132.7 |================================================================== GravityMark 1.1b Resolution: 800 x 600 - Renderer: Vulkan Frames Per Second > Higher Is Better 1 . 157.9 |==================================================================== 2 . 157.4 |==================================================================== 3 . 150.3 |================================================================= GravityMark 1.1b Resolution: 1024 x 768 - Renderer: OpenGL Frames Per Second > Higher Is Better 1 . 123.3 |==================================================================== 2 . 120.7 |=================================================================== 3 . 113.7 |=============================================================== GravityMark 1.1b Resolution: 1024 x 768 - Renderer: Vulkan Frames Per Second > Higher Is Better 1 . 140.3 |==================================================================== 2 . 139.1 |=================================================================== 3 . 137.4 |=================================================================== GravityMark 1.1b Resolution: 1280 x 1024 - Renderer: OpenGL Frames Per Second > Higher Is Better 1 . 110.1 |==================================================================== 2 . 108.2 |=================================================================== 3 . 106.4 |================================================================== GravityMark 1.1b Resolution: 1280 x 1024 - Renderer: Vulkan Frames Per Second > Higher Is Better 1 . 129.2 |==================================================================== 2 . 128.8 |==================================================================== 3 . 126.4 |=================================================================== GravityMark 1.1b Resolution: 1920 x 1080 - Renderer: OpenGL Frames Per Second > Higher Is Better 1 . 98.6 |===================================================================== 2 . 93.4 |================================================================= 3 . 91.8 |================================================================ GravityMark 1.1b Resolution: 1920 x 1080 - Renderer: Vulkan Frames Per Second > Higher Is Better 1 . 114.2 |==================================================================== 2 . 107.6 |================================================================ 3 . 106.2 |=============================================================== Mobile Neural Network 1.2 Model: mobilenetV3 ms < Lower Is Better 1 . 1.904 |================================================================= 2 . 2.005 |==================================================================== 3 . 1.968 |=================================================================== Mobile Neural Network 1.2 Model: squeezenetv1.1 ms < Lower Is Better 1 . 3.987 |================================================================== 2 . 4.090 |=================================================================== 3 . 4.132 |==================================================================== Mobile Neural Network 1.2 Model: resnet-v2-50 ms < Lower Is Better 1 . 29.17 |================================================================= 2 . 30.12 |=================================================================== 3 . 30.63 |==================================================================== Mobile Neural Network 1.2 Model: SqueezeNetV1.0 ms < Lower Is Better 1 . 5.885 |=============================================================== 2 . 6.314 |==================================================================== 3 . 6.181 |=================================================================== Mobile Neural Network 1.2 Model: MobileNetV2_224 ms < Lower Is Better 1 . 3.220 |============================================================= 2 . 3.594 |==================================================================== 3 . 3.483 |================================================================== Mobile Neural Network 1.2 Model: mobilenet-v1-1.0 ms < Lower Is Better 1 . 2.745 |=========================================================== 2 . 3.045 |================================================================== 3 . 3.143 |==================================================================== Mobile Neural Network 1.2 Model: inception-v3 ms < Lower Is Better 1 . 39.06 |================================================================= 2 . 40.70 |==================================================================== 3 . 40.09 |=================================================================== NCNN 20210525 Target: CPU - Model: mobilenet ms < Lower Is Better 1 . 17.79 |================================================================= 2 . 18.62 |==================================================================== 3 . 18.47 |=================================================================== NCNN 20210525 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1 . 4.93 |=================================================================== 2 . 5.04 |===================================================================== 3 . 5.05 |===================================================================== NCNN 20210525 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1 . 4.16 |===================================================================== 2 . 4.00 |================================================================== 3 . 3.99 |================================================================== NCNN 20210525 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 1 . 3.57 |===================================================================== 2 . 3.51 |==================================================================== 3 . 3.53 |==================================================================== NCNN 20210525 Target: CPU - Model: mnasnet ms < Lower Is Better 1 . 3.91 |===================================================================== 2 . 3.82 |=================================================================== 3 . 3.86 |==================================================================== NCNN 20210525 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 1 . 6.37 |================================================================== 2 . 6.66 |===================================================================== 3 . 6.65 |===================================================================== NCNN 20210525 Target: CPU - Model: blazeface ms < Lower Is Better 1 . 1.63 |==================================================================== 2 . 1.62 |=================================================================== 3 . 1.66 |===================================================================== NCNN 20210525 Target: CPU - Model: googlenet ms < Lower Is Better 1 . 14.70 |============================================================== 2 . 15.19 |================================================================ 3 . 16.10 |==================================================================== NCNN 20210525 Target: CPU - Model: vgg16 ms < Lower Is Better 1 . 64.48 |=============================================================== 2 . 67.85 |=================================================================== 3 . 69.18 |==================================================================== NCNN 20210525 Target: CPU - Model: resnet18 ms < Lower Is Better 1 . 15.63 |================================================================ 2 . 16.68 |==================================================================== 3 . 16.43 |=================================================================== NCNN 20210525 Target: CPU - Model: alexnet ms < Lower Is Better 1 . 13.52 |================================================================== 2 . 13.83 |==================================================================== 3 . 13.70 |=================================================================== NCNN 20210525 Target: CPU - Model: resnet50 ms < Lower Is Better 1 . 26.31 |================================================================ 2 . 27.74 |==================================================================== 3 . 27.83 |==================================================================== NCNN 20210525 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 1 . 27.26 |============================================================== 2 . 29.93 |==================================================================== 3 . 29.44 |=================================================================== NCNN 20210525 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better 1 . 19.65 |================================================================ 2 . 20.94 |==================================================================== 3 . 20.91 |==================================================================== NCNN 20210525 Target: CPU - Model: regnety_400m ms < Lower Is Better 1 . 9.31 |=============================================================== 2 . 9.73 |================================================================== 3 . 10.04 |==================================================================== TNN 0.3 Target: CPU - Model: DenseNet ms < Lower Is Better 1 . 3120.89 |================================================================= 2 . 3147.92 |================================================================== 3 . 3140.92 |================================================================== TNN 0.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better 1 . 293.19 |=================================================================== 2 . 293.47 |=================================================================== 3 . 293.98 |=================================================================== TNN 0.3 Target: CPU - Model: SqueezeNet v2 ms < Lower Is Better 1 . 62.97 |=================================================================== 2 . 63.43 |==================================================================== 3 . 63.61 |==================================================================== TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better 1 . 269.27 |=================================================================== 2 . 268.11 |=================================================================== 3 . 268.40 |===================================================================