11900k nn

Intel Core i9-11900K testing with a ASUS ROG MAXIMUS XIII HERO (0707 BIOS) and AMD Radeon VII 16GB on Fedora 34 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2106186-IB-11900KNN693&sor.

11900k nnProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen Resolution12345Intel Core i9-11900K @ 5.10GHz (8 Cores / 16 Threads)ASUS ROG MAXIMUS XIII HERO (0707 BIOS)Intel Tiger Lake-H32GB2000GB Corsair Force MP600 + 257GB Flash DriveAMD Radeon VII 16GB (1801/1000MHz)Intel Tiger Lake-H HD AudioASUS MG28U2 x Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Fedora 345.12.9-300.fc34.x86_64 (x86_64)GNOME Shell 40.1X Server + Wayland4.6 Mesa 21.1.1 (LLVM 12.0.0)GCC 11.1.1 20210531 + Clang 12.0.0btrfs3840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x3c - Thermald 2.4.4 Security Details- SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

11900k nnmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mtnn: CPU - DenseNettnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v2tnn: CPU - SqueezeNet v1.1123451.0542.30918.3963.7141.9201.78925.02713.013.622.832.562.584.601.1010.6255.1611.559.9219.4219.8515.906.182729.915247.94647.581236.3561.0542.29818.4313.6921.9061.78524.93512.863.592.812.552.604.601.0710.3555.0911.219.9319.1819.3815.836.122742.152247.98147.644236.4121.0522.32718.4823.7321.9331.78624.99413.023.682.822.572.624.611.0810.3754.9511.039.9318.9419.5415.806.142732.992247.95747.541236.5761.0552.32618.4733.7541.9291.77925.09312.883.582.812.572.64.591.0810.3554.9611.039.9019.0019.0815.806.132725.751247.96847.651236.6481.0522.31618.4013.6991.9221.77324.97313.153.582.792.552.584.581.0610.3854.9211.249.9418.9420.3315.846.082729.318247.96747.569236.689OpenBenchmarking.org

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV3351240.23740.47480.71220.94961.187SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.003, N = 3SE +/- 0.004, N = 3SE +/- 0.003, N = 31.0521.0521.0541.0541.055MIN: 1.03 / MAX: 3.1MIN: 1.03 / MAX: 5.16MIN: 1.03 / MAX: 5.15MIN: 1.03 / MAX: 5.12MIN: 1.03 / MAX: 5.161. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.1215430.52361.04721.57082.09442.618SE +/- 0.016, N = 3SE +/- 0.019, N = 3SE +/- 0.023, N = 3SE +/- 0.010, N = 3SE +/- 0.006, N = 32.2982.3092.3162.3262.327MIN: 2.25 / MAX: 6.43MIN: 2.25 / MAX: 8.08MIN: 2.25 / MAX: 6.42MIN: 2.29 / MAX: 6.5MIN: 2.29 / MAX: 8.211. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-5015243510152025SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 318.4018.4018.4318.4718.48MIN: 18.12 / MAX: 22.71MIN: 18.16 / MAX: 23.67MIN: 18.1 / MAX: 24.51MIN: 18.24 / MAX: 24.7MIN: 18.32 / MAX: 25.471. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.0251340.84471.68942.53413.37884.2235SE +/- 0.072, N = 3SE +/- 0.050, N = 3SE +/- 0.043, N = 3SE +/- 0.036, N = 3SE +/- 0.030, N = 33.6923.6993.7143.7323.754MIN: 3.51 / MAX: 11.39MIN: 3.56 / MAX: 8.16MIN: 3.58 / MAX: 10.87MIN: 3.64 / MAX: 7.94MIN: 3.66 / MAX: 7.941. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_224215430.43490.86981.30471.73962.1745SE +/- 0.020, N = 3SE +/- 0.007, N = 3SE +/- 0.007, N = 3SE +/- 0.019, N = 3SE +/- 0.019, N = 31.9061.9201.9221.9291.933MIN: 1.84 / MAX: 6.13MIN: 1.86 / MAX: 6.12MIN: 1.86 / MAX: 6.49MIN: 1.87 / MAX: 6.18MIN: 1.88 / MAX: 6.11. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.0542310.40250.8051.20751.612.0125SE +/- 0.003, N = 3SE +/- 0.006, N = 3SE +/- 0.002, N = 3SE +/- 0.011, N = 3SE +/- 0.007, N = 31.7731.7791.7851.7861.789MIN: 1.75 / MAX: 5.97MIN: 1.75 / MAX: 5.99MIN: 1.75 / MAX: 5.99MIN: 1.74 / MAX: 7.77MIN: 1.76 / MAX: 8.171. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v325314612182430SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 324.9424.9724.9925.0325.09MIN: 24.2 / MAX: 32.34MIN: 24.66 / MAX: 31.87MIN: 24.49 / MAX: 30.91MIN: 24.71 / MAX: 47.27MIN: 24.64 / MAX: 30.761. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -O2 -rdynamic -pthread -ldl

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet241353691215SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.16, N = 3SE +/- 0.16, N = 3SE +/- 0.14, N = 312.8612.8813.0113.0213.15MIN: 12.74 / MAX: 16.45MIN: 12.7 / MAX: 16.62MIN: 12.71 / MAX: 16.87MIN: 12.72 / MAX: 16.75MIN: 12.74 / MAX: 16.851. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v2452130.8281.6562.4843.3124.14SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 33.583.583.593.623.68MIN: 3.45 / MAX: 7.01MIN: 3.45 / MAX: 7.23MIN: 3.44 / MAX: 7.21MIN: 3.48 / MAX: 7.05MIN: 3.48 / MAX: 7.421. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v3524310.63681.27361.91042.54723.184SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.792.812.812.822.83MIN: 2.74 / MAX: 6.27MIN: 2.74 / MAX: 6.27MIN: 2.74 / MAX: 6.36MIN: 2.76 / MAX: 6.38MIN: 2.76 / MAX: 6.361. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v2251340.57831.15661.73492.31322.8915SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.552.552.562.572.57MIN: 2.5 / MAX: 6.12MIN: 2.5 / MAX: 6.13MIN: 2.51 / MAX: 6.11MIN: 2.52 / MAX: 6.06MIN: 2.5 / MAX: 6.111. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet152430.58951.1791.76852.3582.9475SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.582.582.602.602.62MIN: 2.54 / MAX: 3.06MIN: 2.53 / MAX: 6.12MIN: 2.54 / MAX: 6.09MIN: 2.54 / MAX: 6.17MIN: 2.54 / MAX: 7.341. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b0541231.03732.07463.11194.14925.1865SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 34.584.594.604.604.61MIN: 4.51 / MAX: 8.14MIN: 4.51 / MAX: 8.13MIN: 4.52 / MAX: 8.2MIN: 4.52 / MAX: 15.48MIN: 4.52 / MAX: 8.151. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface523410.24750.4950.74250.991.2375SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 31.061.071.081.081.10MIN: 1.04 / MAX: 1.76MIN: 1.04 / MAX: 2.99MIN: 1.05 / MAX: 1.6MIN: 1.05 / MAX: 4.51MIN: 1.05 / MAX: 1.51. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet243513691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.22, N = 310.3510.3510.3710.3810.62MIN: 10.25 / MAX: 13.93MIN: 10.25 / MAX: 13.87MIN: 10.26 / MAX: 14.08MIN: 10.26 / MAX: 13.98MIN: 10.29 / MAX: 15.751. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg16534211224364860SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.04, N = 354.9254.9554.9655.0955.16MIN: 54.42 / MAX: 61.33MIN: 54.46 / MAX: 58.49MIN: 54.51 / MAX: 58.77MIN: 54.47 / MAX: 60.23MIN: 54.78 / MAX: 61.421. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet18342513691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 311.0311.0311.2111.2411.55MIN: 10.91 / MAX: 14.54MIN: 10.92 / MAX: 14.53MIN: 10.93 / MAX: 16.12MIN: 10.97 / MAX: 15.06MIN: 11.44 / MAX: 15.011. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet412353691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.909.929.939.939.94MIN: 9.81 / MAX: 13.39MIN: 9.83 / MAX: 13.41MIN: 9.81 / MAX: 13.7MIN: 9.84 / MAX: 14.56MIN: 9.83 / MAX: 13.451. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet5035421510152025SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 3SE +/- 0.03, N = 318.9418.9419.0019.1819.42MIN: 18.52 / MAX: 22.93MIN: 18.56 / MAX: 23.02MIN: 18.49 / MAX: 23.09MIN: 18.58 / MAX: 23MIN: 19.18 / MAX: 24.091. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny42315510152025SE +/- 0.01, N = 3SE +/- 0.34, N = 3SE +/- 0.45, N = 3SE +/- 0.41, N = 3SE +/- 0.13, N = 319.0819.3819.5419.8520.33MIN: 18.9 / MAX: 24.61MIN: 18.88 / MAX: 23.58MIN: 18.94 / MAX: 23.96MIN: 18.93 / MAX: 25.28MIN: 19.92 / MAX: 28.221. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd3425148121620SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 315.8015.8015.8315.8415.90MIN: 15.61 / MAX: 21.35MIN: 15.62 / MAX: 21.44MIN: 15.68 / MAX: 19.42MIN: 15.66 / MAX: 21.49MIN: 15.75 / MAX: 19.491. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m52431246810SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 36.086.126.136.146.18MIN: 5.99 / MAX: 9.68MIN: 6 / MAX: 10.83MIN: 6.03 / MAX: 9.7MIN: 6.04 / MAX: 9.7MIN: 6.06 / MAX: 14.11. (CXX) g++ options: -O2 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet451326001200180024003000SE +/- 2.38, N = 3SE +/- 4.23, N = 3SE +/- 1.83, N = 3SE +/- 4.47, N = 3SE +/- 13.01, N = 32725.752729.322729.922732.992742.15MIN: 2677.6 / MAX: 2798.43MIN: 2681.16 / MAX: 2806.06MIN: 2687.25 / MAX: 2798.77MIN: 2680.56 / MAX: 3092.99MIN: 2686.2 / MAX: 4541.511. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v21354250100150200250SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.10, N = 3247.95247.96247.97247.97247.98MIN: 246.98 / MAX: 251.87MIN: 246.77 / MAX: 250.93MIN: 246.64 / MAX: 251.21MIN: 246.44 / MAX: 251.35MIN: 246.76 / MAX: 250.951. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2351241122334455SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.20, N = 3SE +/- 0.17, N = 347.5447.5747.5847.6447.65MIN: 47.01 / MAX: 48.19MIN: 47.17 / MAX: 48.04MIN: 47.16 / MAX: 48.91MIN: 47.11 / MAX: 49.66MIN: 47.15 / MAX: 48.91. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.11234550100150200250SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3236.36236.41236.58236.65236.69MIN: 235.09 / MAX: 237.42MIN: 235.25 / MAX: 237.65MIN: 235.32 / MAX: 238.16MIN: 235.17 / MAX: 237.76MIN: 235.56 / MAX: 237.661. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O2 -rdynamic -ldl

Phoronix Test Suite v10.8.4