ncnn updated 5950x + rx 6800 xt

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS) and AMD SIENNA_CICHLID 16GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2012187-PTS-NCNNUPDA37&rdt.

ncnn updated 5950x + rx 6800 xtProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3003 BIOS)AMD Starship/Matisse16GB2000GB Corsair Force MP600 + 2000GBAMD SIENNA_CICHLID 16GB (2575/1000MHz)AMD Device ab28ASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 20.045.10.0-051000rc6daily20201205-generic (x86_64) 20201204GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 21.0.0-devel (git-e6a6620 2020-12-17 focal-oibaf-ppa) (LLVM 11.0.0)1.2.145GCC 9.3.0ext43840x2160OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa201009Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

ncnn updated 5950x + rx 6800 xtncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - shufflenet-v2ncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123412.554.464.154.015.401.8412.9957.9314.5611.3025.4721.7314.6717.954.4612.204.464.134.483.995.381.8413.0357.6114.5311.4024.8320.8714.3318.2412.394.404.103.925.301.8212.6957.9614.3911.0225.2121.3414.5617.894.4312.564.494.224.454.055.391.8413.1457.6814.7911.4826.0721.9214.5217.9312.254.494.174.055.451.9313.2957.7214.6411.2525.1121.5014.4518.254.4412.394.424.174.464.085.521.8513.5157.4614.7111.5425.4721.4514.3118.4112.634.464.194.025.381.8413.2657.8614.6111.2225.9322.0414.6317.974.4512.514.524.184.444.045.441.8413.3157.6814.5811.2325.4921.6914.4118.13OpenBenchmarking.org

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet12343691215SE +/- 0.14, N = 15SE +/- 0.17, N = 4SE +/- 0.20, N = 3SE +/- 0.11, N = 1512.5512.3912.2512.63MIN: 11.79 / MAX: 49.77MIN: 11.78 / MAX: 13.07MIN: 11.91 / MAX: 13.08MIN: 11.82 / MAX: 22.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v212341.01032.02063.03094.04125.0515SE +/- 0.03, N = 15SE +/- 0.02, N = 4SE +/- 0.08, N = 3SE +/- 0.03, N = 154.464.404.494.46MIN: 4.22 / MAX: 15.2MIN: 4.18 / MAX: 5.95MIN: 4.24 / MAX: 6.18MIN: 4.22 / MAX: 8.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v312340.94281.88562.82843.77124.714SE +/- 0.03, N = 15SE +/- 0.03, N = 4SE +/- 0.07, N = 3SE +/- 0.03, N = 154.154.104.174.19MIN: 4.02 / MAX: 6.24MIN: 3.99 / MAX: 5.46MIN: 4.03 / MAX: 5.48MIN: 4.06 / MAX: 27.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet12340.91131.82262.73393.64524.5565SE +/- 0.04, N = 15SE +/- 0.02, N = 4SE +/- 0.11, N = 3SE +/- 0.04, N = 154.013.924.054.02MIN: 3.81 / MAX: 6.1MIN: 3.77 / MAX: 4.94MIN: 3.79 / MAX: 4.82MIN: 3.8 / MAX: 5.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012341.22632.45263.67894.90526.1315SE +/- 0.04, N = 15SE +/- 0.02, N = 4SE +/- 0.11, N = 3SE +/- 0.03, N = 155.405.305.455.38MIN: 5.21 / MAX: 11.8MIN: 5.2 / MAX: 6.55MIN: 5.22 / MAX: 15.71MIN: 5.21 / MAX: 8.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface12340.43430.86861.30291.73722.1715SE +/- 0.02, N = 15SE +/- 0.03, N = 4SE +/- 0.13, N = 3SE +/- 0.01, N = 151.841.821.931.84MIN: 1.77 / MAX: 3.69MIN: 1.76 / MAX: 2.22MIN: 1.78 / MAX: 54.82MIN: 1.77 / MAX: 2.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet12343691215SE +/- 0.15, N = 15SE +/- 0.04, N = 4SE +/- 0.59, N = 3SE +/- 0.22, N = 1512.9912.6913.2913.26MIN: 12.32 / MAX: 24.45MIN: 12.3 / MAX: 13.33MIN: 12.37 / MAX: 45.24MIN: 12.33 / MAX: 24.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1612341326395265SE +/- 0.07, N = 15SE +/- 0.10, N = 4SE +/- 0.35, N = 3SE +/- 0.06, N = 1557.9357.9657.7257.86MIN: 56.29 / MAX: 191.26MIN: 56.88 / MAX: 68.65MIN: 56.04 / MAX: 62.77MIN: 56.32 / MAX: 97.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet18123448121620SE +/- 0.07, N = 15SE +/- 0.09, N = 4SE +/- 0.33, N = 3SE +/- 0.08, N = 1514.5614.3914.6414.61MIN: 14.13 / MAX: 27.65MIN: 14.18 / MAX: 18.31MIN: 14.21 / MAX: 16.42MIN: 14.2 / MAX: 46.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet12343691215SE +/- 0.08, N = 15SE +/- 0.14, N = 4SE +/- 0.35, N = 3SE +/- 0.08, N = 1511.3011.0211.2511.22MIN: 10.78 / MAX: 33.73MIN: 10.77 / MAX: 11.72MIN: 10.82 / MAX: 12.32MIN: 10.81 / MAX: 32.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet501234612182430SE +/- 0.18, N = 15SE +/- 0.34, N = 4SE +/- 0.48, N = 3SE +/- 0.21, N = 1525.4725.2125.1125.93MIN: 24.19 / MAX: 49.11MIN: 24.42 / MAX: 36.51MIN: 24.35 / MAX: 26.82MIN: 24.27 / MAX: 38.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny1234510152025SE +/- 0.24, N = 15SE +/- 0.42, N = 4SE +/- 0.65, N = 3SE +/- 0.24, N = 1521.7321.3421.5022.04MIN: 20.42 / MAX: 55.87MIN: 20.53 / MAX: 27.41MIN: 20.57 / MAX: 31MIN: 20.45 / MAX: 31.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd123448121620SE +/- 0.06, N = 13SE +/- 0.05, N = 4SE +/- 0.06, N = 3SE +/- 0.07, N = 1414.6714.5614.4514.63MIN: 14.05 / MAX: 17.24MIN: 14.05 / MAX: 30.66MIN: 14.1 / MAX: 18.73MIN: 13.7 / MAX: 25.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123448121620SE +/- 0.04, N = 15SE +/- 0.10, N = 4SE +/- 0.38, N = 3SE +/- 0.05, N = 1517.9517.8918.2517.97MIN: 17.59 / MAX: 28.89MIN: 17.51 / MAX: 19.12MIN: 17.57 / MAX: 28.63MIN: 17.57 / MAX: 24.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v212341.00352.0073.01054.0145.0175SE +/- 0.01, N = 13SE +/- 0.02, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 144.464.434.444.45MIN: 4.38 / MAX: 15.65MIN: 4.34 / MAX: 5.3MIN: 4.39 / MAX: 5.93MIN: 4.38 / MAX: 9.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet12343691215SE +/- 0.16, N = 3SE +/- 0.17, N = 4SE +/- 0.01, N = 3SE +/- 0.14, N = 1512.2012.5612.3912.51MIN: 11.86 / MAX: 12.96MIN: 11.93 / MAX: 13.44MIN: 11.87 / MAX: 40.91MIN: 11.8 / MAX: 30.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v212341.0172.0343.0514.0685.085SE +/- 0.04, N = 3SE +/- 0.06, N = 4SE +/- 0.01, N = 3SE +/- 0.06, N = 154.464.494.424.52MIN: 4.2 / MAX: 5.95MIN: 4.24 / MAX: 6.12MIN: 4.23 / MAX: 5.89MIN: 4.19 / MAX: 45.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v312340.94951.8992.84853.7984.7475SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.04, N = 3SE +/- 0.04, N = 154.134.224.174.18MIN: 4.05 / MAX: 5.58MIN: 4.12 / MAX: 5.78MIN: 4.02 / MAX: 35.81MIN: 4 / MAX: 5.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v212341.0082.0163.0244.0325.04SE +/- 0.02, N = 3SE +/- 0.01, N = 4SE +/- 0.01, N = 3SE +/- 0.01, N = 154.484.454.464.44MIN: 4.41 / MAX: 5.45MIN: 4.37 / MAX: 7.43MIN: 4.4 / MAX: 6.53MIN: 4.33 / MAX: 9.441. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet12340.9181.8362.7543.6724.59SE +/- 0.04, N = 3SE +/- 0.09, N = 4SE +/- 0.08, N = 3SE +/- 0.05, N = 153.994.054.084.04MIN: 3.83 / MAX: 5.27MIN: 3.83 / MAX: 5.37MIN: 3.84 / MAX: 9.46MIN: 3.79 / MAX: 16.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012341.2422.4843.7264.9686.21SE +/- 0.02, N = 3SE +/- 0.07, N = 4SE +/- 0.10, N = 3SE +/- 0.05, N = 155.385.395.525.44MIN: 5.28 / MAX: 6.9MIN: 5.21 / MAX: 7.2MIN: 5.31 / MAX: 7.1MIN: 5.23 / MAX: 9.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12340.41630.83261.24891.66522.0815SE +/- 0.03, N = 3SE +/- 0.04, N = 4SE +/- 0.03, N = 3SE +/- 0.01, N = 151.841.841.851.84MIN: 1.79 / MAX: 2MIN: 1.77 / MAX: 3.2MIN: 1.78 / MAX: 2.35MIN: 1.77 / MAX: 4.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet12343691215SE +/- 0.12, N = 3SE +/- 0.48, N = 4SE +/- 0.57, N = 3SE +/- 0.21, N = 1513.0313.1413.5113.31MIN: 12.5 / MAX: 15.43MIN: 12.31 / MAX: 23.44MIN: 12.55 / MAX: 15.7MIN: 12.22 / MAX: 21.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1612341326395265SE +/- 0.15, N = 3SE +/- 0.10, N = 4SE +/- 0.20, N = 3SE +/- 0.08, N = 1557.6157.6857.4657.68MIN: 56.32 / MAX: 71.44MIN: 56.61 / MAX: 63.83MIN: 56.2 / MAX: 65.71MIN: 56.28 / MAX: 76.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet18123448121620SE +/- 0.03, N = 3SE +/- 0.27, N = 4SE +/- 0.24, N = 3SE +/- 0.11, N = 1514.5314.7914.7114.58MIN: 14.36 / MAX: 16.66MIN: 14.17 / MAX: 27.11MIN: 14.34 / MAX: 15.61MIN: 14 / MAX: 25.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet12343691215SE +/- 0.11, N = 3SE +/- 0.21, N = 4SE +/- 0.04, N = 3SE +/- 0.08, N = 1511.4011.4811.5411.23MIN: 11.13 / MAX: 23.55MIN: 10.83 / MAX: 51.16MIN: 11.24 / MAX: 11.92MIN: 10.76 / MAX: 22.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet501234612182430SE +/- 0.04, N = 3SE +/- 0.30, N = 4SE +/- 0.65, N = 3SE +/- 0.22, N = 1524.8326.0725.4725.49MIN: 24.5 / MAX: 25.66MIN: 24.45 / MAX: 57.42MIN: 24.4 / MAX: 28.74MIN: 24.17 / MAX: 47.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1234510152025SE +/- 0.04, N = 3SE +/- 0.56, N = 4SE +/- 0.61, N = 3SE +/- 0.22, N = 1520.8721.9221.4521.69MIN: 20.56 / MAX: 23.42MIN: 20.74 / MAX: 31.66MIN: 20.47 / MAX: 75.48MIN: 20.33 / MAX: 31.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd123448121620SE +/- 0.04, N = 3SE +/- 0.06, N = 4SE +/- 0.26, N = 3SE +/- 0.06, N = 1514.3314.5214.3114.41MIN: 14.03 / MAX: 18.14MIN: 14.15 / MAX: 15.06MIN: 13.61 / MAX: 22.82MIN: 13.63 / MAX: 25.571. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m1234510152025SE +/- 0.37, N = 3SE +/- 0.07, N = 4SE +/- 0.07, N = 3SE +/- 0.09, N = 1518.2417.9318.4118.13MIN: 17.68 / MAX: 52.19MIN: 17.68 / MAX: 28.35MIN: 18.12 / MAX: 20.01MIN: 17.55 / MAX: 31.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread


Phoronix Test Suite v10.8.4