11900k nn

Intel Core i9-11900K testing with a ASUS ROG MAXIMUS XIII HERO (0707 BIOS) and AMD Radeon VII 16GB on Fedora 34 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2106186-IB-11900KNN693&grs&sro.

11900k nnProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen Resolution12345Intel Core i9-11900K @ 5.10GHz (8 Cores / 16 Threads)ASUS ROG MAXIMUS XIII HERO (0707 BIOS)Intel Tiger Lake-H32GB2000GB Corsair Force MP600 + 257GB Flash DriveAMD Radeon VII 16GB (1801/1000MHz)Intel Tiger Lake-H HD AudioASUS MG28U2 x Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Fedora 345.12.9-300.fc34.x86_64 (x86_64)GNOME Shell 40.1X Server + Wayland4.6 Mesa 21.1.1 (LLVM 12.0.0)GCC 11.1.1 20210531 + Clang 12.0.0btrfs3840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x3c - Thermald 2.4.4 Security Details- SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

11900k nnncnn: CPU - yolov4-tinyncnn: CPU - resnet18ncnn: CPU - blazefacencnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU - googlenetncnn: CPU - resnet50ncnn: CPU - mobilenetmnn: SqueezeNetV1.0ncnn: CPU - regnety_400mncnn: CPU - mnasnetncnn: CPU-v3-v3 - mobilenet-v3mnn: MobileNetV2_224mnn: squeezenetv1.1mnn: mobilenet-v1-1.0ncnn: CPU - shufflenet-v2ncnn: CPU - efficientnet-b0mnn: inception-v3ncnn: CPU - squeezenet_ssdtnn: CPU - DenseNetmnn: resnet-v2-50ncnn: CPU - vgg16ncnn: CPU - alexnetmnn: mobilenetV3tnn: CPU - SqueezeNet v2tnn: CPU - SqueezeNet v1.1tnn: CPU - MobileNet v21234519.8511.551.103.6210.6219.4213.013.7146.182.582.831.9202.3091.7892.564.6025.02715.902729.91518.39655.169.921.05447.581236.356247.94619.3811.211.073.5910.3519.1812.863.6926.122.602.811.9062.2981.7852.554.6024.93515.832742.15218.43155.099.931.05447.644236.412247.98119.5411.031.083.6810.3718.9413.023.7326.142.622.821.9332.3271.7862.574.6124.99415.802732.99218.48254.959.931.05247.541236.576247.95719.0811.031.083.5810.3519.0012.883.7546.132.62.811.9292.3261.7792.574.5925.09315.802725.75118.47354.969.901.05547.651236.648247.96820.3311.241.063.5810.3818.9413.153.6996.082.582.791.9222.3161.7732.554.5824.97315.842729.31818.40154.929.941.05247.569236.689247.967OpenBenchmarking.org

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny12345510152025SE +/- 0.41, N = 3SE +/- 0.34, N = 3SE +/- 0.45, N = 3SE +/- 0.01, N = 3SE +/- 0.13, N = 319.8519.3819.5419.0820.33MIN: 18.93 / MAX: 25.28MIN: 18.88 / MAX: 23.58MIN: 18.94 / MAX: 23.96MIN: 18.9 / MAX: 24.61MIN: 19.92 / MAX: 28.221. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18123453691215SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 311.5511.2111.0311.0311.24MIN: 11.44 / MAX: 15.01MIN: 10.93 / MAX: 16.12MIN: 10.91 / MAX: 14.54MIN: 10.92 / MAX: 14.53MIN: 10.97 / MAX: 15.061. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface123450.24750.4950.74250.991.2375SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 31.101.071.081.081.06MIN: 1.05 / MAX: 1.5MIN: 1.04 / MAX: 2.99MIN: 1.05 / MAX: 1.6MIN: 1.05 / MAX: 4.51MIN: 1.04 / MAX: 1.761. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v2123450.8281.6562.4843.3124.14SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 33.623.593.683.583.58MIN: 3.48 / MAX: 7.05MIN: 3.44 / MAX: 7.21MIN: 3.48 / MAX: 7.42MIN: 3.45 / MAX: 7.01MIN: 3.45 / MAX: 7.231. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet123453691215SE +/- 0.22, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6210.3510.3710.3510.38MIN: 10.29 / MAX: 15.75MIN: 10.25 / MAX: 13.93MIN: 10.26 / MAX: 14.08MIN: 10.25 / MAX: 13.87MIN: 10.26 / MAX: 13.981. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet5012345510152025SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.21, N = 319.4219.1818.9419.0018.94MIN: 19.18 / MAX: 24.09MIN: 18.58 / MAX: 23MIN: 18.52 / MAX: 22.93MIN: 18.49 / MAX: 23.09MIN: 18.56 / MAX: 23.021. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet123453691215SE +/- 0.16, N = 3SE +/- 0.00, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 313.0112.8613.0212.8813.15MIN: 12.71 / MAX: 16.87MIN: 12.74 / MAX: 16.45MIN: 12.72 / MAX: 16.75MIN: 12.7 / MAX: 16.62MIN: 12.74 / MAX: 16.851. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.0123450.84471.68942.53413.37884.2235SE +/- 0.043, N = 3SE +/- 0.072, N = 3SE +/- 0.036, N = 3SE +/- 0.030, N = 3SE +/- 0.050, N = 33.7143.6923.7323.7543.699MIN: 3.58 / MAX: 10.87MIN: 3.51 / MAX: 11.39MIN: 3.64 / MAX: 7.94MIN: 3.66 / MAX: 7.94MIN: 3.56 / MAX: 8.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m12345246810SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 36.186.126.146.136.08MIN: 6.06 / MAX: 14.1MIN: 6 / MAX: 10.83MIN: 6.04 / MAX: 9.7MIN: 6.03 / MAX: 9.7MIN: 5.99 / MAX: 9.681. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet123450.58951.1791.76852.3582.9475SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.582.602.622.602.58MIN: 2.54 / MAX: 3.06MIN: 2.54 / MAX: 6.09MIN: 2.54 / MAX: 7.34MIN: 2.54 / MAX: 6.17MIN: 2.53 / MAX: 6.121. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v3123450.63681.27361.91042.54723.184SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 32.832.812.822.812.79MIN: 2.76 / MAX: 6.36MIN: 2.74 / MAX: 6.27MIN: 2.76 / MAX: 6.38MIN: 2.74 / MAX: 6.36MIN: 2.74 / MAX: 6.271. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_224123450.43490.86981.30471.73962.1745SE +/- 0.007, N = 3SE +/- 0.020, N = 3SE +/- 0.019, N = 3SE +/- 0.019, N = 3SE +/- 0.007, N = 31.9201.9061.9331.9291.922MIN: 1.86 / MAX: 6.12MIN: 1.84 / MAX: 6.13MIN: 1.88 / MAX: 6.1MIN: 1.87 / MAX: 6.18MIN: 1.86 / MAX: 6.491. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.1123450.52361.04721.57082.09442.618SE +/- 0.019, N = 3SE +/- 0.016, N = 3SE +/- 0.006, N = 3SE +/- 0.010, N = 3SE +/- 0.023, N = 32.3092.2982.3272.3262.316MIN: 2.25 / MAX: 8.08MIN: 2.25 / MAX: 6.43MIN: 2.29 / MAX: 8.21MIN: 2.29 / MAX: 6.5MIN: 2.25 / MAX: 6.421. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.0123450.40250.8051.20751.612.0125SE +/- 0.007, N = 3SE +/- 0.002, N = 3SE +/- 0.011, N = 3SE +/- 0.006, N = 3SE +/- 0.003, N = 31.7891.7851.7861.7791.773MIN: 1.76 / MAX: 8.17MIN: 1.75 / MAX: 5.99MIN: 1.74 / MAX: 7.77MIN: 1.75 / MAX: 5.99MIN: 1.75 / MAX: 5.971. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v2123450.57831.15661.73492.31322.8915SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.562.552.572.572.55MIN: 2.51 / MAX: 6.11MIN: 2.5 / MAX: 6.12MIN: 2.52 / MAX: 6.06MIN: 2.5 / MAX: 6.11MIN: 2.5 / MAX: 6.131. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b0123451.03732.07463.11194.14925.1865SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 34.604.604.614.594.58MIN: 4.52 / MAX: 8.2MIN: 4.52 / MAX: 15.48MIN: 4.52 / MAX: 8.15MIN: 4.51 / MAX: 8.13MIN: 4.51 / MAX: 8.141. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v312345612182430SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 325.0324.9424.9925.0924.97MIN: 24.71 / MAX: 47.27MIN: 24.2 / MAX: 32.34MIN: 24.49 / MAX: 30.91MIN: 24.64 / MAX: 30.76MIN: 24.66 / MAX: 31.871. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd1234548121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 315.9015.8315.8015.8015.84MIN: 15.75 / MAX: 19.49MIN: 15.68 / MAX: 19.42MIN: 15.61 / MAX: 21.35MIN: 15.62 / MAX: 21.44MIN: 15.66 / MAX: 21.491. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet123456001200180024003000SE +/- 1.83, N = 3SE +/- 13.01, N = 3SE +/- 4.47, N = 3SE +/- 2.38, N = 3SE +/- 4.23, N = 32729.922742.152732.992725.752729.32MIN: 2687.25 / MAX: 2798.77MIN: 2686.2 / MAX: 4541.51MIN: 2680.56 / MAX: 3092.99MIN: 2677.6 / MAX: 2798.43MIN: 2681.16 / MAX: 2806.061. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-5012345510152025SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 318.4018.4318.4818.4718.40MIN: 18.12 / MAX: 22.71MIN: 18.1 / MAX: 24.51MIN: 18.32 / MAX: 25.47MIN: 18.24 / MAX: 24.7MIN: 18.16 / MAX: 23.671. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg16123451224364860SE +/- 0.04, N = 3SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 355.1655.0954.9554.9654.92MIN: 54.78 / MAX: 61.42MIN: 54.47 / MAX: 60.23MIN: 54.46 / MAX: 58.49MIN: 54.51 / MAX: 58.77MIN: 54.42 / MAX: 61.331. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet123453691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 39.929.939.939.909.94MIN: 9.83 / MAX: 13.41MIN: 9.81 / MAX: 13.7MIN: 9.84 / MAX: 14.56MIN: 9.81 / MAX: 13.39MIN: 9.83 / MAX: 13.451. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV3123450.23740.47480.71220.94961.187SE +/- 0.003, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.004, N = 31.0541.0541.0521.0551.052MIN: 1.03 / MAX: 5.15MIN: 1.03 / MAX: 5.12MIN: 1.03 / MAX: 3.1MIN: 1.03 / MAX: 5.16MIN: 1.03 / MAX: 5.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2123451122334455SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 347.5847.6447.5447.6547.57MIN: 47.16 / MAX: 48.91MIN: 47.11 / MAX: 49.66MIN: 47.01 / MAX: 48.19MIN: 47.15 / MAX: 48.9MIN: 47.17 / MAX: 48.041. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.11234550100150200250SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3236.36236.41236.58236.65236.69MIN: 235.09 / MAX: 237.42MIN: 235.25 / MAX: 237.65MIN: 235.32 / MAX: 238.16MIN: 235.17 / MAX: 237.76MIN: 235.56 / MAX: 237.661. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v21234550100150200250SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3247.95247.98247.96247.97247.97MIN: 246.98 / MAX: 251.87MIN: 246.76 / MAX: 250.95MIN: 246.77 / MAX: 250.93MIN: 246.44 / MAX: 251.35MIN: 246.64 / MAX: 251.211. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

Phoronix Test Suite v10.8.5