nn

AMD Ryzen 9 5900X 12-Core testing with a ASUS ROG CROSSHAIR VIII HERO (3501 BIOS) and AMD Radeon RX 6800/6800 XT / 6900 16GB on Ubuntu 21.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2106189-PTS-NN67322042&sor&grs.

nnProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution11a23AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads)ASUS ROG CROSSHAIR VIII HERO (3501 BIOS)AMD Starship/Matisse16GB1000GB Sabrent Rocket 4.0 Plus + 2000GBAMD Radeon RX 6800/6800 XT / 6900 16GB (2475/1000MHz)AMD Navi 21 HDMI AudioASUS VP28URealtek RTL8125 2.5GbE + Intel I211Ubuntu 21.045.13.0-051300rc6daily20210617-generic (x86_64) 20210616GNOME Shell 3.38.4X Server 1.20.11 + Wayland4.6 Mesa 21.2.0-devel (git-849ab4e 2021-06-17 hirsute-oibaf-ppa) (LLVM 12.0.0)1.2.180GCC 10.3.0 + CUDA 11.3ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa201009Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

nnncnn: CPU - blazefacencnn: CPU - mnasnetncnn: CPU - efficientnet-b0mnn: resnet-v2-50mnn: squeezenetv1.1mnn: mobilenetV3ncnn: CPU - shufflenet-v2ncnn: CPU - yolov4-tinyncnn: CPU-v3-v3 - mobilenet-v3mnn: inception-v3mnn: MobileNetV2_224mnn: SqueezeNetV1.0ncnn: CPU - regnety_400mncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU-v2-v2 - mobilenet-v2mnn: mobilenet-v1-1.0tnn: CPU - MobileNet v2ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - googlenettnn: CPU - SqueezeNet v1.1tnn: CPU - SqueezeNet v2ncnn: CPU - mobilenetncnn: CPU - squeezenet_ssdtnn: CPU - DenseNet11a2327.9443.7432.12926.1033.2775.0574.384226.928212.47650.9302510.7621.713.675.104.0021.483.919.4255.0713.744.1011.0722.8012.3812.1414.801.793.825.2827.4033.7362.1164.1022.004.0026.1693.2465.1219.5055.2613.524.164.352226.52311.2022.5512.45212.73851.11312.1214.782504.4421.703.795.1327.0103.6192.0594.0521.913.9625.6163.2115.0239.3455.9813.614.134.325224.05111.1322.6912.51211.08650.71812.0514.752505.204OpenBenchmarking.org

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface31a20.40280.80561.20841.61122.014SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 31.701.711.79MIN: 1.6 / MAX: 9.42MIN: 1.62 / MAX: 8.08MIN: 1.65 / MAX: 9.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet1a320.85951.7192.57853.4384.2975SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 33.673.793.82MIN: 3.5 / MAX: 11.58MIN: 3.51 / MAX: 12.14MIN: 3.57 / MAX: 11.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b01a321.1882.3763.5644.7525.94SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 35.105.135.28MIN: 4.83 / MAX: 13.32MIN: 4.8 / MAX: 38.8MIN: 4.9 / MAX: 13.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-50321714212835SE +/- 0.04, N = 7SE +/- 0.15, N = 3SE +/- 0.51, N = 327.0127.4027.94MIN: 25.86 / MAX: 50.68MIN: 26.03 / MAX: 50.79MIN: 25.6 / MAX: 40.371. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.13210.84221.68442.52663.36884.211SE +/- 0.058, N = 7SE +/- 0.012, N = 3SE +/- 0.068, N = 33.6193.7363.743MIN: 3.25 / MAX: 12.54MIN: 3.56 / MAX: 11.48MIN: 3.36 / MAX: 12.791. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV33210.4790.9581.4371.9162.395SE +/- 0.019, N = 7SE +/- 0.009, N = 3SE +/- 0.027, N = 32.0592.1162.129MIN: 1.88 / MAX: 10.15MIN: 2.01 / MAX: 10.13MIN: 1.91 / MAX: 11.331. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v21a320.92251.8452.76753.694.6125SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 34.004.054.10MIN: 3.74 / MAX: 11.71MIN: 3.86 / MAX: 11.94MIN: 3.89 / MAX: 11.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny1a32510152025SE +/- 0.28, N = 3SE +/- 0.11, N = 3SE +/- 0.18, N = 321.4821.9122.00MIN: 19.65 / MAX: 48.26MIN: 19.58 / MAX: 57.14MIN: 20.67 / MAX: 30.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v31a320.91.82.73.64.5SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 33.913.964.00MIN: 3.73 / MAX: 11.8MIN: 3.75 / MAX: 12.14MIN: 3.76 / MAX: 12.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v3312612182430SE +/- 0.13, N = 7SE +/- 0.23, N = 3SE +/- 0.24, N = 325.6226.1026.17MIN: 24.49 / MAX: 42.77MIN: 24.2 / MAX: 62.16MIN: 24.88 / MAX: 34.41. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_2243210.73731.47462.21192.94923.6865SE +/- 0.032, N = 7SE +/- 0.041, N = 3SE +/- 0.035, N = 33.2113.2463.277MIN: 2.97 / MAX: 11MIN: 3.07 / MAX: 10.44MIN: 3.07 / MAX: 11.361. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.03121.15222.30443.45664.60885.761SE +/- 0.049, N = 7SE +/- 0.054, N = 3SE +/- 0.050, N = 35.0235.0575.121MIN: 4.59 / MAX: 14.33MIN: 4.64 / MAX: 33.19MIN: 4.85 / MAX: 13.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m31a23691215SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 39.349.429.50MIN: 8.86 / MAX: 17.28MIN: 9.01 / MAX: 26.23MIN: 9.03 / MAX: 17.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg161a231326395265SE +/- 0.20, N = 3SE +/- 0.21, N = 3SE +/- 0.90, N = 355.0755.2655.98MIN: 52.29 / MAX: 67.12MIN: 52.4 / MAX: 85.07MIN: 51.31 / MAX: 862.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18231a48121620SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.16, N = 313.5213.6113.74MIN: 12.87 / MAX: 22.24MIN: 12.65 / MAX: 21.63MIN: 12.93 / MAX: 22.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v21a320.9361.8722.8083.7444.68SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 34.104.134.16MIN: 3.86 / MAX: 12.56MIN: 3.88 / MAX: 12.67MIN: 3.87 / MAX: 12.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.03210.98641.97282.95923.94564.932SE +/- 0.022, N = 7SE +/- 0.051, N = 3SE +/- 0.070, N = 34.3254.3524.384MIN: 4.09 / MAX: 11.49MIN: 4.08 / MAX: 11.71MIN: 4.07 / MAX: 13.171. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v232150100150200250SE +/- 1.38, N = 3SE +/- 2.57, N = 3SE +/- 0.40, N = 3224.05226.52226.93MIN: 218.93 / MAX: 236.84MIN: 218.62 / MAX: 239.35MIN: 222.06 / MAX: 239.491. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet1a323691215SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 311.0711.1311.20MIN: 10.16 / MAX: 19.67MIN: 10.19 / MAX: 19.44MIN: 10.37 / MAX: 19.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet50231a510152025SE +/- 0.28, N = 3SE +/- 0.18, N = 3SE +/- 0.36, N = 322.5522.6922.80MIN: 20.93 / MAX: 31.12MIN: 21.25 / MAX: 31.38MIN: 20.6 / MAX: 104.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet1a233691215SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.17, N = 312.3812.4512.51MIN: 11.66 / MAX: 20.8MIN: 11.62 / MAX: 30.43MIN: 11.61 / MAX: 32.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.131250100150200250SE +/- 0.10, N = 3SE +/- 0.82, N = 3SE +/- 3.04, N = 3211.09212.48212.74MIN: 210.04 / MAX: 211.62MIN: 210.54 / MAX: 219.75MIN: 206.57 / MAX: 219.721. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v23121224364860SE +/- 0.25, N = 3SE +/- 0.28, N = 3SE +/- 0.11, N = 350.7250.9351.11MIN: 50.05 / MAX: 51.13MIN: 50.31 / MAX: 51.63MIN: 50.74 / MAX: 51.461. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet321a3691215SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 312.0512.1212.14MIN: 11.3 / MAX: 29.68MIN: 11.38 / MAX: 34.52MIN: 11.26 / MAX: 38.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd321a48121620SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 314.7514.7814.80MIN: 13.81 / MAX: 23.13MIN: 13.64 / MAX: 45.78MIN: 13.52 / MAX: 64.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet2315001000150020002500SE +/- 3.49, N = 3SE +/- 1.51, N = 3SE +/- 3.60, N = 32504.442505.202510.76MIN: 2433.14 / MAX: 2583.96MIN: 2430 / MAX: 2579.39MIN: 2446.86 / MAX: 2649.041. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

Phoronix Test Suite v10.8.5