Intel Tiger Lake Mitigation COmparison Tests for a possible future article by Michael Larabel. The "Ice Lake" and "Tiger Lake" numbers are from prior article testing. The "TGL ReRun 58" is from re-testing on Ubuntu 20.10 with all latest stable updates as of latest testing (notable significant update since then is newer Firefox as worth mentioning for any Firefox changes compared to original numbers, due to their new Warp JS). The "TGL Linux 5.10" results are when using the Linux 5.10 Git kernel from the Ubuntu Mainline Kernel PPA. Linux 5.10 results more in line with expectations.
HTML result view exported from: https://openbenchmarking.org/result/2102245-HA-2012136HA60&grs .
Intel Tiger Lake Mitigation COmparison Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL Vulkan Compiler File-System Screen Resolution OpenCL Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads) Dell 06CDVY (1.0.9 BIOS) Intel Device 34ef 16GB Toshiba KBG40ZPZ512G NVMe 512GB Intel Iris Plus G7 3GB (1100MHz) Realtek ALC289 Intel Killer Wi-Fi 6 AX1650i 160MHz Ubuntu 20.10 5.8.0-25-generic (x86_64) GNOME Shell 3.38.1 X Server 1.20.9 modesetting 1.20.9 4.6 Mesa 20.2.1 1.2.145 GCC 10.2.0 ext4 1920x1200 Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads) Dell 0GG9PT (1.0.3 BIOS) Intel Tiger Lake-LP Kioxia KBG40ZNS256G NVMe 256GB Intel UHD 3GB (1300MHz) Intel Wi-Fi 6 AX201 5.8.0-31-generic (x86_64) 5.10.0-051000rc7daily20201213-generic (x86_64) 20201212 LENOVO LNVNB161216 (FBCN23WW BIOS) 8GB 512GB SAMSUNG MZVL2512HCJQ-00BL2 Intel Iris Xe 3GB (1300MHz) Realtek ALC287 ManjaroLinux 20.2.1 5.11.1-1-MANJARO (x86_64) GNOME Shell 3.38.3 X Server 1.20.10 intel 4.6 Mesa 20.3.4 OpenCL 3.0 GCC 10.2.0 + Clang 11.1.0 1600x900 OpenBenchmarking.org Compiler Details - Ice Lake: Default, Ice Lake: mitigations=off, Tiger Lake: Default, Tiger Lake: mitigations=off, TGL ReRun 58: Default, TGL ReRun 58: mitigations=off, TGL Linux 5.10: Default, TGL Linux 5.10: mitigations=off: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details - Ice Lake: Default: NONE / errors=remount-ro,relatime,rw - Ice Lake: mitigations=off: NONE / errors=remount-ro,relatime,rw - Tiger Lake: Default: NONE / errors=remount-ro,relatime,rw - Tiger Lake: mitigations=off: NONE / errors=remount-ro,relatime,rw - TGL ReRun 58: Default: NONE / errors=remount-ro,relatime,rw / Block Size: 4096 Processor Details - Ice Lake: Default: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x78 - Thermald 2.3 - Ice Lake: mitigations=off: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x78 - Thermald 2.3 - Tiger Lake: Default: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3 - Tiger Lake: mitigations=off: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3 - TGL ReRun 58: Default: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3 - TGL ReRun 58: mitigations=off: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3 - TGL Linux 5.10: Default: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3 - TGL Linux 5.10: mitigations=off: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3 - my tiger lake, default: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x66 - Thermald 2.4.2 - my tiger lake, unmitigated: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x66 - Thermald 2.4.2 Java Details - Ice Lake: Default: OpenJDK Runtime Environment (build 11.0.9+10-post-Ubuntu-0ubuntu1) - Ice Lake: mitigations=off: OpenJDK Runtime Environment (build 11.0.9+10-post-Ubuntu-0ubuntu1) - Tiger Lake: Default: OpenJDK Runtime Environment (build 11.0.9+10-post-Ubuntu-0ubuntu1) - Tiger Lake: mitigations=off: OpenJDK Runtime Environment (build 11.0.9+10-post-Ubuntu-0ubuntu1) - TGL ReRun 58: Default: OpenJDK Runtime Environment (build 11.0.9.1+1-Ubuntu-0ubuntu1.20.10) - TGL ReRun 58: mitigations=off: OpenJDK Runtime Environment (build 11.0.9.1+1-Ubuntu-0ubuntu1.20.10) - TGL Linux 5.10: Default: OpenJDK Runtime Environment (build 11.0.9.1+1-Ubuntu-0ubuntu1.20.10) - TGL Linux 5.10: mitigations=off: OpenJDK Runtime Environment (build 11.0.9.1+1-Ubuntu-0ubuntu1.20.10) Python Details - Ice Lake: Default: Python 3.8.6 - Ice Lake: mitigations=off: Python 3.8.6 - Tiger Lake: Default: Python 3.8.6 - Tiger Lake: mitigations=off: Python 3.8.6 - TGL ReRun 58: Default: Python 3.8.6 - TGL ReRun 58: mitigations=off: Python 3.8.6 - TGL Linux 5.10: Default: Python 3.8.6 - TGL Linux 5.10: mitigations=off: Python 3.8.6 - my tiger lake, default: Python 3.9.1 - my tiger lake, unmitigated: Python 3.9.1 Security Details - Ice Lake: Default: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Ice Lake: mitigations=off: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected - Tiger Lake: Default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Tiger Lake: mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected - TGL ReRun 58: Default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - TGL ReRun 58: mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected - TGL Linux 5.10: Default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - TGL Linux 5.10: mitigations=off: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected - my tiger lake, default: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - my tiger lake, unmitigated: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled + srbds: Not affected + tsx_async_abort: Not affected Kernel Details - my tiger lake, default, my tiger lake, unmitigated: Transparent Huge Pages: madvise
Intel Tiger Lake Mitigation COmparison rocksdb: Rand Read mnn: resnet-v2-50 mnn: inception-v3 tensorflow-lite: NASNet Mobile tensorflow-lite: Inception ResNet V2 tensorflow-lite: SqueezeNet tensorflow-lite: Mobilenet Quant selenium: Kraken - Firefox ncnn: CPU - yolov4-tiny ncnn: CPU - resnet18 renaissance: Twitter HTTP Requests dacapobench: Jython selenium: CanvasMark - Google Chrome caffe: AlexNet - CPU - 100 sockperf: Throughput selenium: Jetstream 2 - Firefox pyperformance: pathlib selenium: StyleBench - Google Chrome caffe: GoogleNet - CPU - 100 selenium: WebXPRT - Google Chrome sqlite-speedtest: Timed Time - Size 1,000 selenium: WebXPRT - Firefox selenium: ARES-6 - Google Chrome selenium: Kraken - Google Chrome selenium: Jetstream 2 - Google Chrome selenium: Jetstream - Google Chrome ncnn: CPU - alexnet gimp: unsharp-mask gimp: auto-levels selenium: Octane - Google Chrome ncnn: CPU - vgg16 selenium: WASM imageConvolute - Google Chrome gimp: unsharp-mask gimp: auto-levels ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - squeezenet mnn: SqueezeNetV1.0 ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU - mobilenet ncnn: CPU - efficientnet-b0 ncnn: CPU - resnet50 ncnn: CPU - blazeface mnn: mobilenet-v1-1.0 ncnn: CPU - mnasnet mnn: MobileNetV2_224 ncnn: CPU - googlenet ncnn: CPU - shufflenet-v2 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 12925515 66.588 80.481 494187 8917553 674153 455175 830.7 47.55 25.02 3842.164 5101 14994 66912 554537 91.648 16.8 33.5 179934 225 61.215 241 19.76 799.3 138.439 242.78 22.05 15.709 13.008 53717 80.68 32.6245 13732080 63.444 77.032 495179 8905090 646988 456401 752.7 46.83 24.33 3525.294 4414 15149 64140 582151 99.720 16.1 34.0 176908 227 59.986 264 19.77 806.0 140.146 250.94 21.47 15.740 12.313 53635 75.59 32.6082 15791136 54.541 68.288 406430 7382540 564437 372045 671.9 40.44 21.30 2487.367 3843 17698 84931 767117 108.423 13.9 39.6 216420 281 51.251 288 16.60 668.2 165.909 289.55 18.64 13.345 11.266 61608 71.04 28.2575 15304072 57.668 73.116 430449 7765500 588506 394514 610.5 43.82 23.20 2533.808 4113 16864 89846 738032 115.080 14.2 38.5 226788 269 53.138 299 17.32 701.8 158.473 276.88 20.15 13.990 11.670 58235 75.98 29.2972 15871303 53.954 67.671 409558 7434223 567661 376005 1005.7 40.02 21.21 2515.071 3425 20485 84246 773590 86.921 13.7 42.6 214784 279 51.006 267 16.19 661.7 165.154 289.93 18.6 13.415 11.160 61369 70.42 28.699 15589035.71 56.10 70.12 411997.95918367 7525608.8435374 581732.98611111 378435.37414966 938.67 41.28 21.93 2593.01 3630.21 19667 85939.795918367 741680.92 93.32499 14.26 39.576 225830.52631579 253 53.13 292 17.80 680.40 153.70846 272.2531 19.21 13.486 11.180 57008 72.64 29.38 16151167 53.814 67.698 404421 7349897 559412 369926 1004.1 39.89 21.15 2540.388 3471 21237 84009 760189 87.346 13.9 42.9 213883 278 50.848 268 16.16 656.8 164.687 292.24 18.47 13.317 11.087 62304 69.82 28.6120 15900784 53.201 66.247 403126 7352977 558600 368982 886.9 40.29 21.20 2443.830 3460 21010 83965 733327 96.285 13.9 43.0 213543 277 50.685 296 16.07 678.0 166.769 292.30 18.57 13.326 11.068 62405 70.11 28.2868 24236402 35.891 44.125 286649 5231100 395875 270998 890.0 29.58 15.63 644502 97.481 12.8 49.886 20.28 70.45 12.691 10.970 4.79 19.12 7.354 5.63 22.17 7.49 33.42 1.52 5.555 5.19 4.018 16.42 3.75 24016638 36.059 43.627 289256 5268597 396356 272762 796.8 29.11 15.63 636293 106.771 13.0 49.294 19.32 69.68 12.290 10.666 4.70 18.77 7.222 5.56 21.95 7.44 33.64 1.53 5.567 5.18 4.012 16.41 3.75 OpenBenchmarking.org
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 6.3.6 Test: Random Read Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 5M 10M 15M 20M 25M SE +/- 123171.35, N = 15 SE +/- 208149.62, N = 15 SE +/- 224908.53, N = 3 SE +/- 150814.30, N = 3 SE +/- 113483.52, N = 12 SE +/- 120229.46, N = 10 SE +/- 228211.34, N = 3 SE +/- 127649.37, N = 9 SE +/- 240154.22, N = 3 SE +/- 172073.57, N = 3 12925515.00 13732080.00 15791136.00 15304072.00 15871303.00 15589035.71 16151167.00 15900784.00 24236402.00 24016638.00 1. (CXX) g++ options: -O3 -march=native -std=c++11 -fno-builtin-memcmp -fno-rtti -rdynamic -lpthread
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: resnet-v2-50 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 15 30 45 60 75 SE +/- 0.34, N = 3 SE +/- 0.20, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 66.59 63.44 54.54 57.67 53.95 56.10 53.81 53.20 35.89 36.06 MIN: 62.42 / MAX: 109.96 MIN: 56.81 / MAX: 91.45 MIN: 52.47 / MAX: 71.35 MIN: 52.17 / MAX: 88 MIN: 51.83 / MAX: 69.79 MIN: 52.22 / MAX: 69.59 MIN: 51.25 / MAX: 70.06 MIN: 34.72 / MAX: 48.94 MIN: 35.06 / MAX: 48.88 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: inception-v3 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 20 40 60 80 100 SE +/- 0.50, N = 3 SE +/- 0.72, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.29, N = 3 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 SE +/- 0.31, N = 3 80.48 77.03 68.29 73.12 67.67 70.12 67.70 66.25 44.13 43.63 MIN: 77.49 / MAX: 99.85 MIN: 70.4 / MAX: 108.37 MIN: 66.59 / MAX: 84.15 MIN: 68.33 / MAX: 117.84 MIN: 65.82 / MAX: 84.07 MIN: 65.66 / MAX: 83.26 MIN: 64.97 / MAX: 87.52 MIN: 41.39 / MAX: 57.22 MIN: 40.55 / MAX: 67.13 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
TensorFlow Lite Model: NASNet Mobile OpenBenchmarking.org Microseconds, Fewer Is Better TensorFlow Lite 2020-08-23 Model: NASNet Mobile Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 110K 220K 330K 440K 550K SE +/- 3688.05, N = 3 SE +/- 2851.71, N = 3 SE +/- 2818.20, N = 3 SE +/- 3141.38, N = 3 SE +/- 3076.30, N = 3 SE +/- 3203.98, N = 3 SE +/- 2967.19, N = 3 SE +/- 2843.05, N = 3 SE +/- 960.49, N = 3 SE +/- 1561.84, N = 3 494187.00 495179.00 406430.00 430449.00 409558.00 411997.96 404421.00 403126.00 286649.00 289256.00
TensorFlow Lite Model: Inception ResNet V2 OpenBenchmarking.org Microseconds, Fewer Is Better TensorFlow Lite 2020-08-23 Model: Inception ResNet V2 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 2M 4M 6M 8M 10M SE +/- 2473.50, N = 3 SE +/- 14703.15, N = 3 SE +/- 5564.33, N = 3 SE +/- 1537.93, N = 3 SE +/- 8367.51, N = 3 SE +/- 6570.47, N = 3 SE +/- 6529.42, N = 3 SE +/- 7453.09, N = 3 SE +/- 10551.93, N = 3 SE +/- 5371.66, N = 3 8917553.00 8905090.00 7382540.00 7765500.00 7434223.00 7525608.84 7349897.00 7352977.00 5231100.00 5268597.00
TensorFlow Lite Model: SqueezeNet OpenBenchmarking.org Microseconds, Fewer Is Better TensorFlow Lite 2020-08-23 Model: SqueezeNet Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 140K 280K 420K 560K 700K SE +/- 5183.16, N = 15 SE +/- 12430.05, N = 14 SE +/- 4132.54, N = 3 SE +/- 6328.07, N = 3 SE +/- 3215.23, N = 3 SE +/- 4523.41, N = 3 SE +/- 4476.17, N = 3 SE +/- 4682.82, N = 3 SE +/- 2335.83, N = 3 SE +/- 2537.13, N = 3 674153.00 646988.00 564437.00 588506.00 567661.00 581732.99 559412.00 558600.00 395875.00 396356.00
TensorFlow Lite Model: Mobilenet Quant OpenBenchmarking.org Microseconds, Fewer Is Better TensorFlow Lite 2020-08-23 Model: Mobilenet Quant Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 100K 200K 300K 400K 500K SE +/- 3093.36, N = 3 SE +/- 3375.54, N = 3 SE +/- 2509.46, N = 3 SE +/- 2832.59, N = 3 SE +/- 2667.17, N = 3 SE +/- 2912.75, N = 3 SE +/- 2976.32, N = 3 SE +/- 2493.36, N = 3 SE +/- 670.99, N = 3 SE +/- 677.12, N = 3 455175.00 456401.00 372045.00 394514.00 376005.00 378435.37 369926.00 368982.00 270998.00 272762.00
Selenium Benchmark: Kraken - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Firefox Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 200 400 600 800 1000 SE +/- 1.20, N = 3 SE +/- 1.72, N = 3 SE +/- 1.35, N = 3 SE +/- 0.73, N = 3 SE +/- 2.62, N = 3 SE +/- 1.19, N = 3 SE +/- 2.10, N = 3 SE +/- 2.55, N = 3 SE +/- 5.50, N = 3 SE +/- 3.47, N = 3 830.70 752.70 671.90 610.50 1005.70 938.67 1004.10 886.90 890.00 796.80 1. Ice Lake: Default: firefox 82.0 2. Ice Lake: mitigations=off: firefox 82.0 3. Tiger Lake: Default: firefox 81.0.2 4. Tiger Lake: mitigations=off: firefox 81.0.2 5. TGL ReRun 58: Default: firefox 83.0 6. TGL ReRun 58: mitigations=off: firefox 83.0 7. TGL Linux 5.10: Default: firefox 83.0 8. TGL Linux 5.10: mitigations=off: firefox 83.0 9. my tiger lake, default: firefox 86.0 10. my tiger lake, unmitigated: firefox 86.0
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: yolov4-tiny Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 11 22 33 44 55 SE +/- 0.04, N = 3 SE +/- 0.64, N = 4 SE +/- 0.19, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 SE +/- 0.41, N = 3 SE +/- 0.08, N = 3 47.55 46.83 40.44 43.82 40.02 41.28 39.89 40.29 29.58 29.11 MIN: 45.86 / MAX: 62.55 MIN: 42.33 / MAX: 59.43 MIN: 38.52 / MAX: 52.97 MIN: 41.38 / MAX: 88.84 MIN: 38.59 / MAX: 48.41 MIN: 38.41 / MAX: 50.73 MIN: 38.49 / MAX: 52.32 MIN: 28.89 / MAX: 32.82 MIN: 28.66 / MAX: 31.99 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet18 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.51, N = 4 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 25.02 24.33 21.30 23.20 21.21 21.93 21.15 21.20 15.63 15.63 MIN: 22.42 / MAX: 37.92 MIN: 20.42 / MAX: 41.66 MIN: 18.47 / MAX: 34.83 MIN: 20.27 / MAX: 38 MIN: 18.54 / MAX: 23.48 MIN: 18.49 / MAX: 32.54 MIN: 18.49 / MAX: 34.99 MIN: 15.35 / MAX: 17.48 MIN: 15.31 / MAX: 17.59 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Renaissance Test: Twitter HTTP Requests Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.10.0 Test: Twitter HTTP Requests Default mitigations=off 800 1600 2400 3200 4000 SE +/- 45.02, N = 5 SE +/- 33.64, N = 25 SE +/- 10.30, N = 5 SE +/- 11.39, N = 5 SE +/- 16.33, N = 5 SE +/- 18.14, N = 5 SE +/- 14.45, N = 5 SE +/- 11.73, N = 5 3842.16 3525.29 2487.37 2533.81 2515.07 2593.01 2540.39 2443.83
DaCapo Benchmark Java Test: Jython Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 9.12-MR1 Java Test: Jython Default mitigations=off 1100 2200 3300 4400 5500 SE +/- 93.22, N = 16 SE +/- 45.07, N = 4 SE +/- 38.95, N = 20 SE +/- 50.55, N = 5 SE +/- 7.95, N = 4 SE +/- 25.57, N = 4 SE +/- 39.09, N = 4 SE +/- 33.94, N = 5 5101.00 4414.00 3843.00 4113.00 3425.00 3630.21 3471.00 3460.00
Selenium Benchmark: CanvasMark - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Score, More Is Better Selenium Benchmark: CanvasMark - Browser: Google Chrome Default mitigations=off 5K 10K 15K 20K 25K SE +/- 144.97, N = 9 SE +/- 107.22, N = 3 SE +/- 200.87, N = 12 SE +/- 151.73, N = 10 SE +/- 254.54, N = 4 SE +/- 145.83, N = 3 SE +/- 209.48, N = 3 SE +/- 293.33, N = 3 14994 15149 17698 16864 20485 19667 21237 21010 1. chrome 87.0.4280.88
Caffe Model: AlexNet - Acceleration: CPU - Iterations: 100 Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Milli-Seconds, Fewer Is Better Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 100 Default mitigations=off 20K 40K 60K 80K 100K SE +/- 396.22, N = 3 SE +/- 873.74, N = 3 SE +/- 561.91, N = 3 SE +/- 434.17, N = 3 SE +/- 380.75, N = 3 SE +/- 414.84, N = 3 SE +/- 593.84, N = 3 SE +/- 455.74, N = 3 66912.00 64140.00 84931.00 89846.00 84246.00 85939.80 84009.00 83965.00 1. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas
Sockperf Test: Throughput OpenBenchmarking.org Messages Per Second, More Is Better Sockperf 3.4 Test: Throughput Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 170K 340K 510K 680K 850K SE +/- 2421.79, N = 5 SE +/- 6985.56, N = 5 SE +/- 9040.07, N = 25 SE +/- 8183.20, N = 5 SE +/- 5771.94, N = 11 SE +/- 9852.43, N = 20 SE +/- 5678.70, N = 5 SE +/- 6828.62, N = 25 SE +/- 2778.53, N = 5 SE +/- 3620.61, N = 5 554537.00 582151.00 767117.00 738032.00 773590.00 741680.92 760189.00 733327.00 644502.00 636293.00 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
Selenium Benchmark: Jetstream 2 - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Jetstream 2 - Browser: Firefox Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 30 60 90 120 150 SE +/- 0.36, N = 3 SE +/- 0.55, N = 3 SE +/- 0.86, N = 3 SE +/- 1.47, N = 5 SE +/- 0.76, N = 3 SE +/- 1.14, N = 3 SE +/- 0.14, N = 3 SE +/- 0.42, N = 3 SE +/- 1.19, N = 4 SE +/- 0.55, N = 3 91.65 99.72 108.42 115.08 86.92 93.32 87.35 96.29 97.48 106.77 1. Ice Lake: Default: firefox 82.0 2. Ice Lake: mitigations=off: firefox 82.0 3. Tiger Lake: Default: firefox 81.0.2 4. Tiger Lake: mitigations=off: firefox 81.0.2 5. TGL ReRun 58: Default: firefox 83.0 6. TGL ReRun 58: mitigations=off: firefox 83.0 7. TGL Linux 5.10: Default: firefox 83.0 8. TGL Linux 5.10: mitigations=off: firefox 83.0 9. my tiger lake, default: firefox 86.0 10. my tiger lake, unmitigated: firefox 86.0
PyPerformance Benchmark: pathlib OpenBenchmarking.org Milliseconds, Fewer Is Better PyPerformance 1.0.0 Benchmark: pathlib Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 4 8 12 16 20 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 5 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.19, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 16.80 16.10 13.90 14.20 13.70 14.26 13.90 13.90 12.80 13.00
Selenium Benchmark: StyleBench - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Runs / Minute, More Is Better Selenium Benchmark: StyleBench - Browser: Google Chrome Default mitigations=off 10 20 30 40 50 SE +/- 0.13, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 33.50 34.00 39.60 38.50 42.60 39.58 42.90 43.00 1. chrome 87.0.4280.88
Caffe Model: GoogleNet - Acceleration: CPU - Iterations: 100 Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Milli-Seconds, Fewer Is Better Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 100 Default mitigations=off 50K 100K 150K 200K 250K SE +/- 269.90, N = 3 SE +/- 739.79, N = 3 SE +/- 393.32, N = 3 SE +/- 351.65, N = 3 SE +/- 543.36, N = 3 SE +/- 626.06, N = 3 SE +/- 553.87, N = 3 SE +/- 455.98, N = 3 179934.00 176908.00 216420.00 226788.00 214784.00 225830.53 213883.00 213543.00 1. (CXX) g++ options: -fPIC -O3 -rdynamic -lglog -lgflags -lprotobuf -lpthread -lsz -lz -ldl -lm -llmdb -lopenblas
Selenium Benchmark: WebXPRT - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Score, More Is Better Selenium Benchmark: WebXPRT - Browser: Google Chrome Default mitigations=off 60 120 180 240 300 SE +/- 2.08, N = 3 SE +/- 0.58, N = 3 SE +/- 1.00, N = 3 SE +/- 2.91, N = 3 SE +/- 1.86, N = 3 SE +/- 2.08, N = 3 SE +/- 3.06, N = 3 225 227 281 269 279 253 278 277 1. chrome 87.0.4280.88
SQLite Speedtest Timed Time - Size 1,000 OpenBenchmarking.org Seconds, Fewer Is Better SQLite Speedtest 3.30 Timed Time - Size 1,000 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 14 28 42 56 70 SE +/- 0.96, N = 3 SE +/- 0.22, N = 3 SE +/- 0.29, N = 3 SE +/- 0.50, N = 3 SE +/- 0.28, N = 3 SE +/- 0.56, N = 3 SE +/- 0.53, N = 3 SE +/- 0.33, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 61.22 59.99 51.25 53.14 51.01 53.13 50.85 50.69 49.89 49.29 1. (CC) gcc options: -O2 -ldl -lz -lpthread
Selenium Benchmark: WebXPRT - Browser: Firefox Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Score, More Is Better Selenium Benchmark: WebXPRT - Browser: Firefox Default mitigations=off 70 140 210 280 350 SE +/- 0.88, N = 3 SE +/- 1.53, N = 3 SE +/- 1.00, N = 2 SE +/- 0.33, N = 3 SE +/- 2.03, N = 3 SE +/- 0.58, N = 3 241 264 288 299 267 292 268 296 1. firefox 83.0
Selenium Benchmark: ARES-6 - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: ARES-6 - Browser: Google Chrome Default mitigations=off 5 10 15 20 25 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.13, N = 3 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.08, N = 3 SE +/- 0.14, N = 3 19.76 19.77 16.60 17.32 16.19 17.80 16.16 16.07 1. chrome 87.0.4280.88
Selenium Benchmark: Kraken - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Google Chrome Default mitigations=off 200 400 600 800 1000 SE +/- 2.47, N = 3 SE +/- 3.34, N = 3 SE +/- 1.55, N = 3 SE +/- 9.46, N = 3 SE +/- 1.95, N = 3 SE +/- 1.46, N = 3 SE +/- 3.01, N = 3 SE +/- 4.40, N = 3 799.30 806.00 668.20 701.80 661.70 680.40 656.80 678.00 1. chrome 87.0.4280.88
Selenium Benchmark: Jetstream 2 - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Jetstream 2 - Browser: Google Chrome Default mitigations=off 40 80 120 160 200 SE +/- 0.40, N = 3 SE +/- 0.64, N = 3 SE +/- 0.51, N = 3 SE +/- 0.72, N = 3 SE +/- 2.37, N = 3 SE +/- 0.42, N = 3 SE +/- 0.37, N = 3 SE +/- 1.14, N = 3 138.44 140.15 165.91 158.47 165.15 153.71 164.69 166.77 1. chrome 87.0.4280.88
Selenium Benchmark: Jetstream - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Jetstream - Browser: Google Chrome Default mitigations=off 60 120 180 240 300 SE +/- 0.87, N = 3 SE +/- 0.84, N = 3 SE +/- 1.20, N = 3 SE +/- 0.73, N = 3 SE +/- 0.22, N = 3 SE +/- 0.75, N = 3 SE +/- 0.43, N = 3 SE +/- 0.18, N = 3 242.78 250.94 289.55 276.88 289.93 272.25 292.24 292.30 1. chrome 87.0.4280.88
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: alexnet Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.38, N = 4 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 22.05 21.47 18.64 20.15 18.60 19.21 18.47 18.57 20.28 19.32 MIN: 20.64 / MAX: 34.28 MIN: 19.64 / MAX: 34.78 MIN: 17.18 / MAX: 29.18 MIN: 18.45 / MAX: 58.96 MIN: 17.18 / MAX: 27.55 MIN: 17.18 / MAX: 24.96 MIN: 17.14 / MAX: 25.33 MIN: 19.88 / MAX: 30.06 MIN: 18.89 / MAX: 28.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
GIMP Test: unsharp-mask Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.18 Test: unsharp-mask Default mitigations=off 4 8 12 16 20 SE +/- 0.21, N = 5 SE +/- 0.16, N = 15 SE +/- 0.13, N = 9 SE +/- 0.14, N = 9 SE +/- 0.09, N = 15 SE +/- 0.14, N = 12 SE +/- 0.12, N = 12 SE +/- 0.10, N = 12 15.71 15.74 13.35 13.99 13.42 13.49 13.32 13.33
GIMP Test: auto-levels Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.18 Test: auto-levels Default mitigations=off 3 6 9 12 15 SE +/- 0.15, N = 7 SE +/- 0.12, N = 3 SE +/- 0.11, N = 9 SE +/- 0.12, N = 8 SE +/- 0.10, N = 8 SE +/- 0.11, N = 6 SE +/- 0.14, N = 3 SE +/- 0.10, N = 3 13.01 12.31 11.27 11.67 11.16 11.18 11.09 11.07
Selenium Benchmark: Octane - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org Geometric Mean, More Is Better Selenium Benchmark: Octane - Browser: Google Chrome Default mitigations=off 13K 26K 39K 52K 65K SE +/- 67.56, N = 3 SE +/- 159.67, N = 3 SE +/- 1033.11, N = 3 SE +/- 745.81, N = 5 SE +/- 422.22, N = 13 SE +/- 605.64, N = 5 SE +/- 780.90, N = 3 SE +/- 817.53, N = 3 53717 53635 61608 58235 61369 57008 62304 62405 1. chrome 87.0.4280.88
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: vgg16 Ice Lake: Default Ice Lake: mitigations=off Tiger Lake: Default Tiger Lake: mitigations=off TGL ReRun 58: Default TGL ReRun 58: mitigations=off TGL Linux 5.10: Default TGL Linux 5.10: mitigations=off my tiger lake, default my tiger lake, unmitigated 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 1.31, N = 4 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 SE +/- 0.24, N = 3 SE +/- 0.05, N = 3 80.68 75.59 71.04 75.98 70.42 72.64 69.82 70.11 70.45 69.68 MIN: 76.5 / MAX: 103.41 MIN: 70.5 / MAX: 95.89 MIN: 67.45 / MAX: 85.82 MIN: 71.7 / MAX: 102.99 MIN: 66.85 / MAX: 83.65 MIN: 66.13 / MAX: 82.99 MIN: 65.99 / MAX: 84.04 MIN: 69.47 / MAX: 79.89 MIN: 68.86 / MAX: 80.75 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome Ice Lake Tiger Lake TGL ReRun 58 TGL Linux 5.10 OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome Default mitigations=off 8 16 24 32 40 SE +/- 0.34, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.25, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 32.62 32.61 28.26 29.30 28.70 29.38 28.61 28.29 1. chrome 87.0.4280.88
GIMP Test: unsharp-mask OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.22 Test: unsharp-mask my tiger lake, default my tiger lake, unmitigated 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 12.69 12.29
GIMP Test: auto-levels OpenBenchmarking.org Seconds, Fewer Is Better GIMP 2.10.22 Test: auto-levels my tiger lake, default my tiger lake, unmitigated 3 6 9 12 15 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 10.97 10.67
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 my tiger lake, default my tiger lake, unmitigated 1.0778 2.1556 3.2334 4.3112 5.389 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 4.79 4.70 MIN: 4.69 / MAX: 6.7 MIN: 4.61 / MAX: 6.48 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: squeezenet my tiger lake, default my tiger lake, unmitigated 5 10 15 20 25 SE +/- 0.19, N = 3 SE +/- 0.03, N = 3 19.12 18.77 MIN: 18.68 / MAX: 21.45 MIN: 18.46 / MAX: 20.95 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: SqueezeNetV1.0 my tiger lake, default my tiger lake, unmitigated 2 4 6 8 10 SE +/- 0.047, N = 3 SE +/- 0.029, N = 3 7.354 7.222 MIN: 7.11 / MAX: 19.8 MIN: 7 / MAX: 20.12 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 my tiger lake, default my tiger lake, unmitigated 1.2668 2.5336 3.8004 5.0672 6.334 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 5.63 5.56 MIN: 5.55 / MAX: 7.27 MIN: 5.47 / MAX: 7.25 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mobilenet my tiger lake, default my tiger lake, unmitigated 5 10 15 20 25 SE +/- 0.30, N = 3 SE +/- 0.12, N = 3 22.17 21.95 MIN: 21.51 / MAX: 31.99 MIN: 21.45 / MAX: 31.62 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: efficientnet-b0 my tiger lake, default my tiger lake, unmitigated 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 7.49 7.44 MIN: 7.39 / MAX: 9.4 MIN: 7.3 / MAX: 9.87 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: resnet50 my tiger lake, default my tiger lake, unmitigated 8 16 24 32 40 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 33.42 33.64 MIN: 32.84 / MAX: 43 MIN: 32.82 / MAX: 43.79 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: blazeface my tiger lake, default my tiger lake, unmitigated 0.3443 0.6886 1.0329 1.3772 1.7215 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.52 1.53 MIN: 1.51 / MAX: 3.02 MIN: 1.5 / MAX: 3.52 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: mobilenet-v1-1.0 my tiger lake, default my tiger lake, unmitigated 1.2526 2.5052 3.7578 5.0104 6.263 SE +/- 0.005, N = 3 SE +/- 0.026, N = 3 5.555 5.567 MIN: 5.35 / MAX: 17.38 MIN: 5.36 / MAX: 18.02 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: mnasnet my tiger lake, default my tiger lake, unmitigated 1.1678 2.3356 3.5034 4.6712 5.839 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 5.19 5.18 MIN: 5.11 / MAX: 7.11 MIN: 5.09 / MAX: 7.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2020-09-17 Model: MobileNetV2_224 my tiger lake, default my tiger lake, unmitigated 0.9041 1.8082 2.7123 3.6164 4.5205 SE +/- 0.003, N = 3 SE +/- 0.021, N = 3 4.018 4.012 MIN: 3.9 / MAX: 16.8 MIN: 3.87 / MAX: 16.89 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: googlenet my tiger lake, default my tiger lake, unmitigated 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 16.42 16.41 MIN: 16.19 / MAX: 18.48 MIN: 16.04 / MAX: 19.41 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20200916 Target: CPU - Model: shufflenet-v2 my tiger lake, default my tiger lake, unmitigated 0.8438 1.6876 2.5314 3.3752 4.219 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 3.75 3.75 MIN: 3.68 / MAX: 5.17 MIN: 3.69 / MAX: 5.51 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Phoronix Test Suite v10.8.4