whiskey nn

Intel Core i7-8565U testing with a Dell 0KTW76 (1.11.0 BIOS) and Intel UHD 620 WHL GT2 3GB on Ubuntu 21.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2106184-IB-WHISKEYNN53.

whiskey nnProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution1213Intel Core i7-8565U @ 4.60GHz (4 Cores / 8 Threads)Dell 0KTW76 (1.11.0 BIOS)Intel Cannon Point-LP16GBSK hynix PC401 NVMe 256GBIntel UHD 620 WHL GT2 3GB (1150MHz)Realtek ALC3271Qualcomm Atheros QCA6174 802.11acUbuntu 21.045.11.0-17-generic (x86_64)GNOME Shell 3.38.4X Server + Wayland4.6 Mesa 21.0.11.2.145GCC 10.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xde - Thermald 2.4.3 Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

whiskey nnmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mtnn: CPU - DenseNettnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v2tnn: CPU - SqueezeNet v1.112134.2138.15969.70711.4297.3496.92687.35031.667.886.555.587.3912.392.8427.78124.7028.6928.4550.8148.7333.9316.184999.351361.71079.297322.2624.6697.71470.07012.3967.7977.33787.92131.097.736.535.336.6112.292.4324.41122.4228.0028.8351.0248.1133.9814.635016.957361.83479.287322.4944.4388.02072.44011.8197.5028.02691.17134.629.287.846.707.9312.942.8229.33122.2229.2428.3651.3349.7236.0016.895008.610364.84379.095322.557OpenBenchmarking.org

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV312131.05052.1013.15154.2025.2525SE +/- 0.097, N = 6SE +/- 0.294, N = 9SE +/- 0.290, N = 64.2134.6694.438MIN: 2.75 / MAX: 37.92MIN: 2.76 / MAX: 41.29MIN: 2.73 / MAX: 37.331. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.11213246810SE +/- 0.516, N = 6SE +/- 0.134, N = 9SE +/- 0.560, N = 68.1597.7148.020MIN: 5.31 / MAX: 45.6MIN: 5.08 / MAX: 42.88MIN: 5.28 / MAX: 42.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-5012131632486480SE +/- 2.04, N = 6SE +/- 1.34, N = 9SE +/- 1.94, N = 669.7170.0772.44MIN: 45.06 / MAX: 120.73MIN: 45.59 / MAX: 144.43MIN: 43.03 / MAX: 123.711. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.012133691215SE +/- 0.58, N = 6SE +/- 0.59, N = 9SE +/- 0.69, N = 611.4312.4011.82MIN: 6.92 / MAX: 46.82MIN: 7.09 / MAX: 47.17MIN: 7.45 / MAX: 47.021. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_2241213246810SE +/- 0.410, N = 6SE +/- 0.322, N = 9SE +/- 0.424, N = 67.3497.7977.502MIN: 4.91 / MAX: 42.87MIN: 4.49 / MAX: 44.32MIN: 4.78 / MAX: 42.091. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.01213246810SE +/- 0.266, N = 6SE +/- 0.325, N = 9SE +/- 0.460, N = 66.9267.3378.026MIN: 4.53 / MAX: 42MIN: 4.41 / MAX: 56.93MIN: 4.54 / MAX: 42.441. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v3121320406080100SE +/- 2.16, N = 6SE +/- 1.50, N = 9SE +/- 2.30, N = 687.3587.9291.17MIN: 58.7 / MAX: 149.43MIN: 60.18 / MAX: 216MIN: 63.01 / MAX: 157.681. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet1213816243240SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 1.00, N = 1231.6631.0934.62MIN: 29.89 / MAX: 45.3MIN: 29.41 / MAX: 50.31MIN: 29.5 / MAX: 66.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v212133691215SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.30, N = 127.887.739.28MIN: 6.75 / MAX: 28.72MIN: 6.78 / MAX: 20.75MIN: 6.77 / MAX: 28.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v31213246810SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.29, N = 126.556.537.84MIN: 5.67 / MAX: 21.89MIN: 5.62 / MAX: 20.36MIN: 5.64 / MAX: 27.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v21213246810SE +/- 0.24, N = 3SE +/- 0.19, N = 3SE +/- 0.32, N = 125.585.336.70MIN: 4.46 / MAX: 19.28MIN: 4.44 / MAX: 19.23MIN: 4.45 / MAX: 26.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet1213246810SE +/- 0.76, N = 3SE +/- 0.13, N = 3SE +/- 0.32, N = 127.396.617.93MIN: 5.71 / MAX: 25.8MIN: 5.51 / MAX: 24.81MIN: 5.38 / MAX: 27.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b012133691215SE +/- 0.93, N = 3SE +/- 1.21, N = 3SE +/- 0.53, N = 1212.3912.2912.94MIN: 9.87 / MAX: 31.5MIN: 9.7 / MAX: 32.14MIN: 9.37 / MAX: 32.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface12130.6391.2781.9172.5563.195SE +/- 0.25, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 122.842.432.82MIN: 2.17 / MAX: 20.17MIN: 1.78 / MAX: 14.77MIN: 1.73 / MAX: 19.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet1213714212835SE +/- 1.74, N = 3SE +/- 0.33, N = 3SE +/- 0.79, N = 1227.7824.4129.33MIN: 21.61 / MAX: 49.25MIN: 21.34 / MAX: 46.45MIN: 21.64 / MAX: 54.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg161213306090120150SE +/- 1.58, N = 3SE +/- 2.06, N = 3SE +/- 0.51, N = 12124.70122.42122.22MIN: 119.06 / MAX: 152.75MIN: 116.55 / MAX: 143.59MIN: 115.33 / MAX: 151.41. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet181213714212835SE +/- 0.45, N = 3SE +/- 0.15, N = 3SE +/- 0.44, N = 1128.6928.0029.24MIN: 25.68 / MAX: 47.58MIN: 24.66 / MAX: 43.73MIN: 24.54 / MAX: 48.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet1213714212835SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 1228.4528.8328.36MIN: 23.5 / MAX: 44.61MIN: 25.07 / MAX: 44.17MIN: 24.11 / MAX: 50.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet5012131224364860SE +/- 0.17, N = 3SE +/- 0.45, N = 3SE +/- 0.53, N = 1250.8151.0251.33MIN: 47.16 / MAX: 73.01MIN: 47.43 / MAX: 65.65MIN: 46.72 / MAX: 85.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny12131122334455SE +/- 2.79, N = 3SE +/- 3.26, N = 3SE +/- 1.23, N = 1248.7348.1149.72MIN: 43.36 / MAX: 72.47MIN: 42.7 / MAX: 72.39MIN: 41.6 / MAX: 82.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd1213816243240SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 1.12, N = 1233.9333.9836.00MIN: 31.43 / MAX: 47.03MIN: 31.42 / MAX: 49.93MIN: 31.1 / MAX: 68.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m121348121620SE +/- 1.42, N = 3SE +/- 1.52, N = 3SE +/- 0.48, N = 1216.1814.6316.89MIN: 12.17 / MAX: 34.3MIN: 11.9 / MAX: 34.3MIN: 11.52 / MAX: 35.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet121311002200330044005500SE +/- 13.13, N = 3SE +/- 54.64, N = 3SE +/- 41.96, N = 34999.355016.965008.61MIN: 4742.47 / MAX: 6145.4MIN: 4713.73 / MAX: 6219.08MIN: 4652.95 / MAX: 6187.161. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2121380160240320400SE +/- 1.80, N = 3SE +/- 2.48, N = 3SE +/- 0.21, N = 3361.71361.83364.84MIN: 353.14 / MAX: 377.98MIN: 352.84 / MAX: 371.32MIN: 355.61 / MAX: 374.781. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2121320406080100SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.11, N = 379.3079.2979.10MIN: 78.07 / MAX: 80.36MIN: 78.29 / MAX: 85.04MIN: 78.44 / MAX: 88.281. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1121370140210280350SE +/- 0.35, N = 3SE +/- 0.12, N = 3SE +/- 0.23, N = 3322.26322.49322.56MIN: 319.35 / MAX: 330.28MIN: 319.86 / MAX: 323.93MIN: 320.48 / MAX: 326.491. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

Phoronix Test Suite v10.8.4