nn gravity 5950X

AMD Ryzen 9 5950X 16-Core testing with a ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3302 BIOS) and AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB on Ubuntu 21.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2106192-IB-NNGRAVITY71
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 3 Tests
Machine Learning 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
June 18 2021
  2 Hours, 32 Minutes
2
June 18 2021
  3 Hours, 24 Minutes
3
June 18 2021
  2 Hours, 31 Minutes
4
June 18 2021
  2 Hours, 44 Minutes
Invert Hiding All Results Option
  2 Hours, 48 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


nn gravity 5950XProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution1234AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR VIII HERO (WI-FI) (3302 BIOS)AMD Starship/Matisse32GB500GB Western Digital WDS500G3X0C-00SJG0AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB (2100/875MHz)AMD Navi 10 HDMI AudioASUS MG28URealtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200Ubuntu 21.045.11.0-18-generic (x86_64)GNOME Shell 3.38.4X Server + Wayland4.6 Mesa 21.0.1 (LLVM 11.0.1)1.2.145GCC 10.3.0ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa201009 Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected

1234Result OverviewPhoronix Test Suite100%101%101%102%102%Mobile Neural NetworkTNNNCNNGravityMark

nn gravity 5950Xgravitymark: 1920 x 1080 - OpenGLgravitymark: 1920 x 1080 - Vulkangravitymark: 1920 x 1200 - OpenGLgravitymark: 1920 x 1200 - Vulkangravitymark: 2560 x 1440 - OpenGLgravitymark: 2560 x 1440 - Vulkangravitymark: 3840 x 2160 - OpenGLgravitymark: 3840 x 2160 - Vulkanmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mtnn: CPU - DenseNettnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v2tnn: CPU - SqueezeNet v1.1123493.793.693.294.481.483.960.363.62.1624.45423.5355.4673.6392.73527.73712.984.344.154.153.925.441.8114.2260.2115.5212.1325.8523.9615.699.962400.991225.07351.177211.65993.893.893.594.081.683.760.963.52.1324.42523.1885.6053.6132.67328.03712.734.374.134.163.935.341.7913.6860.4015.1311.9125.5923.3915.619.942402.099223.85551.646212.99394.393.992.794.181.683.960.663.62.1104.43023.0945.6133.5482.61327.94312.594.354.154.153.965.361.8114.0460.2015.4412.0525.3823.0915.5510.032396.494223.15550.548210.13494.894.093.794.182.183.359.963.62.1204.32522.7355.4753.5792.65427.49112.604.334.154.183.985.391.8113.7860.2415.3112.0725.3822.9115.1310.002402.680223.91351.705213.410OpenBenchmarking.org

GravityMark

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1080 - Renderer: OpenGL123420406080100SE +/- 0.52, N = 3SE +/- 0.60, N = 3SE +/- 0.83, N = 3SE +/- 0.23, N = 393.793.894.394.8
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1080 - Renderer: OpenGL123420406080100Min: 92.7 / Avg: 93.73 / Max: 94.4Min: 93.1 / Avg: 93.8 / Max: 95Min: 92.7 / Avg: 94.3 / Max: 95.5Min: 94.4 / Avg: 94.77 / Max: 95.2

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1080 - Renderer: Vulkan123420406080100SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.29, N = 3SE +/- 0.38, N = 393.693.893.994.0
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1080 - Renderer: Vulkan123420406080100Min: 93.4 / Avg: 93.63 / Max: 93.8Min: 93.6 / Avg: 93.83 / Max: 94.2Min: 93.4 / Avg: 93.9 / Max: 94.4Min: 93.3 / Avg: 93.97 / Max: 94.6

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1200 - Renderer: OpenGL123420406080100SE +/- 0.64, N = 3SE +/- 0.55, N = 3SE +/- 0.64, N = 3SE +/- 0.56, N = 393.293.592.793.7
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1200 - Renderer: OpenGL123420406080100Min: 92.2 / Avg: 93.23 / Max: 94.4Min: 92.5 / Avg: 93.5 / Max: 94.4Min: 91.7 / Avg: 92.73 / Max: 93.9Min: 92.9 / Avg: 93.73 / Max: 94.8

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1200 - Renderer: Vulkan123420406080100SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.38, N = 394.494.094.194.1
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 1920 x 1200 - Renderer: Vulkan123420406080100Min: 94.2 / Avg: 94.4 / Max: 94.8Min: 93.7 / Avg: 93.97 / Max: 94.2Min: 93.6 / Avg: 94.13 / Max: 94.5Min: 93.7 / Avg: 94.13 / Max: 94.9

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 2560 x 1440 - Renderer: OpenGL123420406080100SE +/- 0.50, N = 3SE +/- 0.43, N = 3SE +/- 0.86, N = 3SE +/- 0.45, N = 381.481.681.682.1
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 2560 x 1440 - Renderer: OpenGL12341632486480Min: 80.5 / Avg: 81.43 / Max: 82.2Min: 80.8 / Avg: 81.57 / Max: 82.3Min: 79.9 / Avg: 81.57 / Max: 82.8Min: 81.2 / Avg: 82.1 / Max: 82.6

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 2560 x 1440 - Renderer: Vulkan123420406080100SE +/- 0.30, N = 3SE +/- 0.31, N = 3SE +/- 0.58, N = 3SE +/- 0.21, N = 383.983.783.983.3
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 2560 x 1440 - Renderer: Vulkan12341632486480Min: 83.3 / Avg: 83.87 / Max: 84.3Min: 83.1 / Avg: 83.7 / Max: 84.1Min: 83.3 / Avg: 83.93 / Max: 85.1Min: 83 / Avg: 83.3 / Max: 83.7

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 3840 x 2160 - Renderer: OpenGL12341428425670SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.26, N = 3SE +/- 0.15, N = 360.360.960.659.9
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 3840 x 2160 - Renderer: OpenGL12341224364860Min: 59.9 / Avg: 60.33 / Max: 60.6Min: 60.4 / Avg: 60.87 / Max: 61.2Min: 60.2 / Avg: 60.63 / Max: 61.1Min: 59.7 / Avg: 59.9 / Max: 60.2

OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 3840 x 2160 - Renderer: Vulkan12341428425670SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 3SE +/- 0.07, N = 363.663.563.663.6
OpenBenchmarking.orgFrames Per Second, More Is BetterGravityMark 1.1bResolution: 3840 x 2160 - Renderer: Vulkan12341224364860Min: 63.5 / Avg: 63.63 / Max: 63.8Min: 63.4 / Avg: 63.47 / Max: 63.6Min: 63.5 / Avg: 63.57 / Max: 63.7Min: 63.5 / Avg: 63.63 / Max: 63.7

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV312340.48650.9731.45951.9462.4325SE +/- 0.016, N = 3SE +/- 0.018, N = 8SE +/- 0.009, N = 3SE +/- 0.021, N = 32.1622.1322.1102.120MIN: 2.08 / MAX: 12.03MIN: 1.96 / MAX: 11.61MIN: 2.04 / MAX: 2.79MIN: 2.02 / MAX: 11.831. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV31234246810Min: 2.14 / Avg: 2.16 / Max: 2.19Min: 2.03 / Avg: 2.13 / Max: 2.18Min: 2.09 / Avg: 2.11 / Max: 2.12Min: 2.08 / Avg: 2.12 / Max: 2.141. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.112341.00222.00443.00664.00885.011SE +/- 0.006, N = 3SE +/- 0.058, N = 8SE +/- 0.022, N = 3SE +/- 0.081, N = 34.4544.4254.4304.325MIN: 4.2 / MAX: 13.68MIN: 3.95 / MAX: 13.7MIN: 4.19 / MAX: 13.77MIN: 4.06 / MAX: 13.141. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.11234246810Min: 4.44 / Avg: 4.45 / Max: 4.46Min: 4.07 / Avg: 4.43 / Max: 4.6Min: 4.39 / Avg: 4.43 / Max: 4.47Min: 4.18 / Avg: 4.32 / Max: 4.461. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-501234612182430SE +/- 0.14, N = 3SE +/- 0.17, N = 8SE +/- 0.18, N = 3SE +/- 0.16, N = 323.5423.1923.0922.74MIN: 22.51 / MAX: 34.52MIN: 21.62 / MAX: 34.11MIN: 21.99 / MAX: 33.51MIN: 21.81 / MAX: 33.051. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-501234510152025Min: 23.37 / Avg: 23.54 / Max: 23.82Min: 22.27 / Avg: 23.19 / Max: 23.76Min: 22.74 / Avg: 23.09 / Max: 23.35Min: 22.46 / Avg: 22.74 / Max: 231. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.012341.26292.52583.78875.05166.3145SE +/- 0.014, N = 3SE +/- 0.093, N = 8SE +/- 0.009, N = 3SE +/- 0.046, N = 35.4675.6055.6135.475MIN: 5.2 / MAX: 15.12MIN: 5.18 / MAX: 15.5MIN: 5.27 / MAX: 15.21MIN: 5.22 / MAX: 14.581. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.01234246810Min: 5.44 / Avg: 5.47 / Max: 5.49Min: 5.31 / Avg: 5.61 / Max: 6.01Min: 5.6 / Avg: 5.61 / Max: 5.63Min: 5.39 / Avg: 5.47 / Max: 5.541. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_22412340.81881.63762.45643.27524.094SE +/- 0.056, N = 3SE +/- 0.036, N = 8SE +/- 0.041, N = 3SE +/- 0.021, N = 33.6393.6133.5483.579MIN: 3.45 / MAX: 13.35MIN: 3.31 / MAX: 12.85MIN: 3.38 / MAX: 4.56MIN: 3.41 / MAX: 13.051. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_2241234246810Min: 3.54 / Avg: 3.64 / Max: 3.74Min: 3.41 / Avg: 3.61 / Max: 3.71Min: 3.47 / Avg: 3.55 / Max: 3.62Min: 3.54 / Avg: 3.58 / Max: 3.611. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.012340.61541.23081.84622.46163.077SE +/- 0.043, N = 3SE +/- 0.021, N = 8SE +/- 0.029, N = 3SE +/- 0.019, N = 32.7352.6732.6132.654MIN: 2.59 / MAX: 3.52MIN: 2.49 / MAX: 11.38MIN: 2.48 / MAX: 11.22MIN: 2.54 / MAX: 3.341. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.01234246810Min: 2.67 / Avg: 2.74 / Max: 2.82Min: 2.57 / Avg: 2.67 / Max: 2.74Min: 2.56 / Avg: 2.61 / Max: 2.65Min: 2.62 / Avg: 2.65 / Max: 2.681. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v31234714212835SE +/- 0.57, N = 3SE +/- 0.21, N = 8SE +/- 0.17, N = 3SE +/- 0.21, N = 327.7428.0427.9427.49MIN: 25.63 / MAX: 38.02MIN: 26.28 / MAX: 38.11MIN: 26.8 / MAX: 37.92MIN: 26.2 / MAX: 114.441. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v31234612182430Min: 26.61 / Avg: 27.74 / Max: 28.42Min: 27.08 / Avg: 28.04 / Max: 28.8Min: 27.6 / Avg: 27.94 / Max: 28.15Min: 27.16 / Avg: 27.49 / Max: 27.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet12343691215SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.16, N = 412.9812.7312.5912.60MIN: 12.02 / MAX: 45.58MIN: 11.88 / MAX: 21.2MIN: 11.76 / MAX: 13.68MIN: 11.66 / MAX: 13.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet123448121620Min: 12.71 / Avg: 12.98 / Max: 13.12Min: 12.54 / Avg: 12.73 / Max: 13.08Min: 12.51 / Avg: 12.59 / Max: 12.7Min: 12.3 / Avg: 12.6 / Max: 13.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v212340.98331.96662.94993.93324.9165SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 44.344.374.354.33MIN: 4.13 / MAX: 5.23MIN: 4.14 / MAX: 12.66MIN: 4.13 / MAX: 5.11MIN: 4.12 / MAX: 5.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v21234246810Min: 4.34 / Avg: 4.34 / Max: 4.35Min: 4.34 / Avg: 4.37 / Max: 4.4Min: 4.34 / Avg: 4.35 / Max: 4.37Min: 4.31 / Avg: 4.33 / Max: 4.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v312340.93381.86762.80143.73524.669SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 44.154.134.154.15MIN: 4 / MAX: 4.93MIN: 3.99 / MAX: 4.74MIN: 4 / MAX: 4.97MIN: 3.98 / MAX: 4.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v31234246810Min: 4.12 / Avg: 4.15 / Max: 4.17Min: 4.11 / Avg: 4.13 / Max: 4.14Min: 4.13 / Avg: 4.15 / Max: 4.19Min: 4.09 / Avg: 4.15 / Max: 4.231. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v212340.94051.8812.82153.7624.7025SE +/- 0.01, N = 3SE +/- 0.00, N = 2SE +/- 0.02, N = 3SE +/- 0.04, N = 34.154.164.154.18MIN: 4.04 / MAX: 4.79MIN: 4.05 / MAX: 4.74MIN: 4.02 / MAX: 4.84MIN: 4.04 / MAX: 4.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v21234246810Min: 4.14 / Avg: 4.15 / Max: 4.16Min: 4.16 / Avg: 4.16 / Max: 4.16Min: 4.13 / Avg: 4.15 / Max: 4.18Min: 4.13 / Avg: 4.18 / Max: 4.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet12340.89551.7912.68653.5824.4775SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 43.923.933.963.98MIN: 3.82 / MAX: 4.57MIN: 3.81 / MAX: 4.46MIN: 3.8 / MAX: 10.68MIN: 3.81 / MAX: 12.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet1234246810Min: 3.92 / Avg: 3.92 / Max: 3.93Min: 3.92 / Avg: 3.93 / Max: 3.94Min: 3.92 / Avg: 3.96 / Max: 4.01Min: 3.9 / Avg: 3.98 / Max: 4.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b012341.2242.4483.6724.8966.12SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 45.445.345.365.39MIN: 5.13 / MAX: 13.04MIN: 5.11 / MAX: 6.02MIN: 5.13 / MAX: 6.14MIN: 5.11 / MAX: 6.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b01234246810Min: 5.33 / Avg: 5.44 / Max: 5.59Min: 5.33 / Avg: 5.34 / Max: 5.36Min: 5.32 / Avg: 5.36 / Max: 5.41Min: 5.33 / Avg: 5.39 / Max: 5.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface12340.40730.81461.22191.62922.0365SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 41.811.791.811.81MIN: 1.76 / MAX: 2.24MIN: 1.74 / MAX: 2.35MIN: 1.73 / MAX: 2.34MIN: 1.74 / MAX: 2.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface1234246810Min: 1.79 / Avg: 1.81 / Max: 1.84Min: 1.78 / Avg: 1.79 / Max: 1.79Min: 1.77 / Avg: 1.81 / Max: 1.87Min: 1.78 / Avg: 1.81 / Max: 1.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet123448121620SE +/- 0.50, N = 3SE +/- 0.18, N = 3SE +/- 0.52, N = 3SE +/- 0.33, N = 414.2213.6814.0413.78MIN: 12.76 / MAX: 16.22MIN: 12.81 / MAX: 14.91MIN: 12.63 / MAX: 22.69MIN: 12.5 / MAX: 22.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet123448121620Min: 13.37 / Avg: 14.22 / Max: 15.11Min: 13.47 / Avg: 13.68 / Max: 14.05Min: 13.42 / Avg: 14.04 / Max: 15.07Min: 13.34 / Avg: 13.78 / Max: 14.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg1612341428425670SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 460.2160.4060.2060.24MIN: 59.16 / MAX: 68.71MIN: 59.24 / MAX: 67.73MIN: 58.58 / MAX: 68.87MIN: 58.54 / MAX: 69.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg1612341224364860Min: 60.08 / Avg: 60.21 / Max: 60.4Min: 60.3 / Avg: 60.4 / Max: 60.52Min: 59.93 / Avg: 60.2 / Max: 60.42Min: 60.02 / Avg: 60.24 / Max: 60.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18123448121620SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.30, N = 3SE +/- 0.17, N = 415.5215.1315.4415.31MIN: 14.6 / MAX: 25.5MIN: 14.5 / MAX: 16.23MIN: 14.48 / MAX: 25.18MIN: 14.42 / MAX: 23.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18123448121620Min: 15.1 / Avg: 15.52 / Max: 15.96Min: 14.98 / Avg: 15.13 / Max: 15.42Min: 14.96 / Avg: 15.44 / Max: 15.98Min: 14.99 / Avg: 15.31 / Max: 15.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet12343691215SE +/- 0.27, N = 3SE +/- 0.29, N = 3SE +/- 0.25, N = 3SE +/- 0.17, N = 412.1311.9112.0512.07MIN: 11.21 / MAX: 13.9MIN: 11.22 / MAX: 20.72MIN: 11.15 / MAX: 13.2MIN: 11.19 / MAX: 21.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet123448121620Min: 11.6 / Avg: 12.13 / Max: 12.47Min: 11.61 / Avg: 11.91 / Max: 12.49Min: 11.55 / Avg: 12.05 / Max: 12.31Min: 11.55 / Avg: 12.07 / Max: 12.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet501234612182430SE +/- 0.44, N = 3SE +/- 0.64, N = 3SE +/- 0.06, N = 3SE +/- 0.38, N = 425.8525.5925.3825.38MIN: 24.4 / MAX: 35.2MIN: 24.1 / MAX: 36MIN: 24.45 / MAX: 34.42MIN: 23.94 / MAX: 34.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet501234612182430Min: 25.24 / Avg: 25.85 / Max: 26.7Min: 24.93 / Avg: 25.59 / Max: 26.87Min: 25.3 / Avg: 25.38 / Max: 25.49Min: 24.93 / Avg: 25.38 / Max: 26.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny1234612182430SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.04, N = 3SE +/- 0.29, N = 423.9623.3923.0922.91MIN: 21.75 / MAX: 26.72MIN: 21.61 / MAX: 102.02MIN: 21.77 / MAX: 30.9MIN: 21.2 / MAX: 31.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny1234612182430Min: 23.02 / Avg: 23.96 / Max: 25.02Min: 22.93 / Avg: 23.39 / Max: 24.02Min: 23.05 / Avg: 23.09 / Max: 23.16Min: 22.43 / Avg: 22.91 / Max: 23.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd123448121620SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 415.6915.6115.5515.13MIN: 14.8 / MAX: 17MIN: 14.82 / MAX: 24.94MIN: 14.74 / MAX: 16.92MIN: 14.03 / MAX: 24.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd123448121620Min: 15.45 / Avg: 15.69 / Max: 15.97Min: 15.49 / Avg: 15.61 / Max: 15.76Min: 15.44 / Avg: 15.55 / Max: 15.64Min: 14.51 / Avg: 15.13 / Max: 15.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m12343691215SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 49.969.9410.0310.00MIN: 9.61 / MAX: 10.66MIN: 9.61 / MAX: 18.41MIN: 9.71 / MAX: 10.66MIN: 9.64 / MAX: 18.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m12343691215Min: 9.88 / Avg: 9.96 / Max: 10.01Min: 9.91 / Avg: 9.94 / Max: 9.96Min: 10 / Avg: 10.03 / Max: 10.08Min: 9.94 / Avg: 10 / Max: 10.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

TNN is an open-source deep learning reasoning framework developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet12345001000150020002500SE +/- 3.21, N = 3SE +/- 2.66, N = 3SE +/- 4.60, N = 3SE +/- 3.84, N = 32400.992402.102396.492402.68MIN: 2340.25 / MAX: 2486.65MIN: 2335.18 / MAX: 2487.17MIN: 2350.03 / MAX: 2475.58MIN: 2336.02 / MAX: 2481.491. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet1234400800120016002000Min: 2396.93 / Avg: 2400.99 / Max: 2407.33Min: 2399.06 / Avg: 2402.1 / Max: 2407.41Min: 2387.77 / Avg: 2396.49 / Max: 2403.36Min: 2395.64 / Avg: 2402.68 / Max: 2408.851. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2123450100150200250SE +/- 0.17, N = 3SE +/- 0.83, N = 3SE +/- 2.10, N = 3SE +/- 0.52, N = 3225.07223.86223.16223.91MIN: 221.35 / MAX: 236.01MIN: 221.25 / MAX: 235.85MIN: 215.11 / MAX: 245.22MIN: 222.1 / MAX: 228.251. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v212344080120160200Min: 224.87 / Avg: 225.07 / Max: 225.42Min: 222.57 / Avg: 223.86 / Max: 225.42Min: 218.96 / Avg: 223.15 / Max: 225.37Min: 223.36 / Avg: 223.91 / Max: 224.961. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v212341224364860SE +/- 0.29, N = 3SE +/- 0.15, N = 3SE +/- 0.62, N = 3SE +/- 0.02, N = 351.1851.6550.5551.71MIN: 50.67 / MAX: 52.1MIN: 51.22 / MAX: 52.21MIN: 49.21 / MAX: 51.4MIN: 51.45 / MAX: 51.951. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v212341020304050Min: 50.82 / Avg: 51.18 / Max: 51.76Min: 51.35 / Avg: 51.65 / Max: 51.82Min: 49.31 / Avg: 50.55 / Max: 51.28Min: 51.68 / Avg: 51.71 / Max: 51.741. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1123450100150200250SE +/- 0.68, N = 3SE +/- 0.49, N = 3SE +/- 0.15, N = 3SE +/- 0.35, N = 3211.66212.99210.13213.41MIN: 210.66 / MAX: 213.22MIN: 212.06 / MAX: 214.18MIN: 209.71 / MAX: 210.55MIN: 212.77 / MAX: 214.351. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl
OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.112344080120160200Min: 210.77 / Avg: 211.66 / Max: 212.99Min: 212.26 / Avg: 212.99 / Max: 213.92Min: 209.89 / Avg: 210.13 / Max: 210.4Min: 212.95 / Avg: 213.41 / Max: 214.11. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl