NCNN Haswell

Intel Core i7-4558U testing with a ASUS UX301LAA v1.0 (UX301LAA.209 BIOS) and ASUS Intel Iris 5100 2GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2009241-FI-NCNNHASWE87
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
HSW 1
September 24 2020
  5 Hours, 44 Minutes
HSW 2
September 24 2020
  5 Hours, 45 Minutes
HSW 3
September 24 2020
  5 Hours, 44 Minutes
Invert Hiding All Results Option
  5 Hours, 44 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


NCNN HaswellOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-4558U @ 3.30GHz (2 Cores / 4 Threads)ASUS UX301LAA v1.0 (UX301LAA.209 BIOS)Intel Haswell-ULT DRAM8GB2 x 128GB SanDisk SD6SP1M1ASUS Intel Iris 5100 2GB (1200MHz)Intel Haswell-ULT HD AudioLQ133T1JW14Intel 7260Ubuntu 20.045.9.0-050900rc6daily20200922-generic (x86_64) 20200921GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.5 Mesa 20.0.8GCC 9.3.0ext42560x1440ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionNCNN Haswell BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_cpufreq ondemand - CPU Microcode: 0x26- itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

HSW 1HSW 2HSW 3Result OverviewPhoronix Test Suite100%101%101%102%102%NCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNNCNNCPU - yolov4-tinyCPU-v3-v3 - mobilenet-v3CPU - shufflenet-v2CPU-v2-v2 - mobilenet-v2CPU - mnasnetCPU - alexnetCPU - vgg16CPU - squeezenetCPU - blazefaceCPU - resnet18CPU - resnet50CPU - googlenetCPU - efficientnet-b0CPU - mobilenet

NCNN Haswellncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyHSW 1HSW 2HSW 387.1360.0115.1813.339.1214.0022.063.71119.03634.8685.0739.72253.7882.2986.9360.0215.2313.399.1213.9822.043.72119.19637.0484.9139.83254.2283.5787.3259.9715.1513.279.1713.9322.063.72119.05637.7384.8839.64254.0381.90OpenBenchmarking.org

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenetHSW 3HSW 2HSW 120406080100SE +/- 0.32, N = 3SE +/- 0.24, N = 3SE +/- 0.32, N = 387.3286.9387.13MIN: 86.1 / MAX: 107.42MIN: 85.88 / MAX: 107.27MIN: 85.97 / MAX: 106.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenetHSW 3HSW 2HSW 120406080100Min: 86.74 / Avg: 87.32 / Max: 87.83Min: 86.51 / Avg: 86.93 / Max: 87.35Min: 86.64 / Avg: 87.13 / Max: 87.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenetHSW 3HSW 2HSW 11326395265SE +/- 0.33, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 359.9760.0260.01MIN: 58.97 / MAX: 80.74MIN: 59.09 / MAX: 82.03MIN: 59.06 / MAX: 82.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenetHSW 3HSW 2HSW 11224364860Min: 59.57 / Avg: 59.97 / Max: 60.62Min: 59.92 / Avg: 60.02 / Max: 60.13Min: 59.76 / Avg: 60.01 / Max: 60.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2HSW 3HSW 2HSW 148121620SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 315.1515.2315.18MIN: 14.7 / MAX: 37.96MIN: 14.88 / MAX: 20.65MIN: 14.77 / MAX: 38.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2HSW 3HSW 2HSW 148121620Min: 14.92 / Avg: 15.15 / Max: 15.28Min: 15.18 / Avg: 15.23 / Max: 15.31Min: 15.06 / Avg: 15.18 / Max: 15.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3HSW 3HSW 2HSW 13691215SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.16, N = 313.2713.3913.33MIN: 13.04 / MAX: 15.63MIN: 12.93 / MAX: 33.66MIN: 12.91 / MAX: 17.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3HSW 3HSW 2HSW 148121620Min: 13.17 / Avg: 13.27 / Max: 13.34Min: 13.32 / Avg: 13.39 / Max: 13.49Min: 13.09 / Avg: 13.33 / Max: 13.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2HSW 3HSW 2HSW 13691215SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 39.179.129.12MIN: 9.03 / MAX: 11.2MIN: 8.96 / MAX: 11.36MIN: 8.95 / MAX: 12.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2HSW 3HSW 2HSW 13691215Min: 9.1 / Avg: 9.17 / Max: 9.24Min: 9.04 / Avg: 9.12 / Max: 9.28Min: 9.02 / Avg: 9.12 / Max: 9.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnetHSW 3HSW 2HSW 148121620SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 313.9313.9814.00MIN: 13.68 / MAX: 18.15MIN: 13.58 / MAX: 17.05MIN: 13.66 / MAX: 27.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnetHSW 3HSW 2HSW 148121620Min: 13.83 / Avg: 13.93 / Max: 14.01Min: 13.78 / Avg: 13.98 / Max: 14.08Min: 13.93 / Avg: 14 / Max: 14.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0HSW 3HSW 2HSW 1510152025SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 322.0622.0422.06MIN: 21.69 / MAX: 41.65MIN: 21.6 / MAX: 27.12MIN: 21.71 / MAX: 25.521. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0HSW 3HSW 2HSW 1510152025Min: 21.97 / Avg: 22.06 / Max: 22.13Min: 21.86 / Avg: 22.04 / Max: 22.39Min: 21.88 / Avg: 22.06 / Max: 22.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazefaceHSW 3HSW 2HSW 10.8371.6742.5113.3484.185SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.723.723.71MIN: 3.62 / MAX: 9.06MIN: 3.61 / MAX: 6.1MIN: 3.61 / MAX: 6.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazefaceHSW 3HSW 2HSW 1246810Min: 3.69 / Avg: 3.72 / Max: 3.75Min: 3.7 / Avg: 3.72 / Max: 3.75Min: 3.7 / Avg: 3.71 / Max: 3.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenetHSW 3HSW 2HSW 1306090120150SE +/- 0.09, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3119.05119.19119.03MIN: 117.86 / MAX: 181.17MIN: 118.04 / MAX: 144.95MIN: 117.98 / MAX: 140.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenetHSW 3HSW 2HSW 120406080100Min: 118.94 / Avg: 119.05 / Max: 119.23Min: 119.08 / Avg: 119.19 / Max: 119.36Min: 118.9 / Avg: 119.03 / Max: 119.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16HSW 3HSW 2HSW 1140280420560700SE +/- 2.20, N = 3SE +/- 1.46, N = 3SE +/- 3.58, N = 3637.73637.04634.86MIN: 630.45 / MAX: 668.59MIN: 632.43 / MAX: 665.9MIN: 625.9 / MAX: 664.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16HSW 3HSW 2HSW 1110220330440550Min: 633.4 / Avg: 637.73 / Max: 640.59Min: 635.29 / Avg: 637.04 / Max: 639.93Min: 628.96 / Avg: 634.86 / Max: 641.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18HSW 3HSW 2HSW 120406080100SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 384.8884.9185.07MIN: 84.12 / MAX: 103.77MIN: 84.04 / MAX: 104.37MIN: 84.18 / MAX: 133.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18HSW 3HSW 2HSW 11632486480Min: 84.8 / Avg: 84.88 / Max: 84.98Min: 84.82 / Avg: 84.91 / Max: 84.98Min: 84.94 / Avg: 85.07 / Max: 85.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnetHSW 3HSW 2HSW 1918273645SE +/- 0.05, N = 3SE +/- 0.15, N = 3SE +/- 0.12, N = 339.6439.8339.72MIN: 39.22 / MAX: 60.54MIN: 39.16 / MAX: 55.99MIN: 39.22 / MAX: 59.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnetHSW 3HSW 2HSW 1816243240Min: 39.54 / Avg: 39.64 / Max: 39.72Min: 39.54 / Avg: 39.83 / Max: 40.06Min: 39.49 / Avg: 39.72 / Max: 39.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50HSW 3HSW 2HSW 160120180240300SE +/- 0.22, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3254.03254.22253.78MIN: 252.18 / MAX: 274.96MIN: 252.27 / MAX: 359.83MIN: 252.24 / MAX: 273.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50HSW 3HSW 2HSW 150100150200250Min: 253.67 / Avg: 254.03 / Max: 254.43Min: 253.9 / Avg: 254.22 / Max: 254.53Min: 253.75 / Avg: 253.78 / Max: 253.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tinyHSW 3HSW 2HSW 120406080100SE +/- 0.23, N = 3SE +/- 0.41, N = 3SE +/- 0.45, N = 381.9083.5782.29MIN: 80.6 / MAX: 97.66MIN: 81.93 / MAX: 102.86MIN: 80.49 / MAX: 104.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tinyHSW 3HSW 2HSW 11632486480Min: 81.56 / Avg: 81.9 / Max: 82.33Min: 82.99 / Avg: 83.57 / Max: 84.36Min: 81.45 / Avg: 82.29 / Max: 82.981. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread