onnx ie

Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 3GB on Ubuntu 21.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2203274-NE-ONNXIE34857.

onnx ieProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionIntel Ice Lake-LP PCH CNVi WiFiIcelakeIceIntel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads)Dell 06CDVY (1.0.9 BIOS)Intel Ice Lake-LP DRAM16GBToshiba KBG40ZPZ512G NVMe 512GBIntel Iris Plus ICL GT2 3GB (1100MHz)Realtek ALC289Intel Ice Lake-LP PCH CNVi WiFiUbuntu 21.105.13.0-35-generic (x86_64)GNOME Shell 40.5X Server + Wayland4.6 Mesa 21.2.21.2.182GCC 11.2.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-ZPT0kp/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-ZPT0kp/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xa6 - Thermald 2.4.6Python Details- Python 3.9.7Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

onnx iefast-cli: Internet Download Speedfast-cli: Internet Upload Speedfast-cli: Internet Latencyfast-cli: Internet Loaded Latency (Bufferbloat)speedtest-cli: Internet Download Speedspeedtest-cli: Internet Upload Speedspeedtest-cli: Internet Latencyonnx: GPT-2 - CPUonnx: yolov4 - CPUonnx: bertsquad-12 - CPUonnx: fcn-resnet101-11 - CPUonnx: ArcFace ResNet-100 - CPUonnx: super-resolution-10 - CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce19026441138.063.1330.4745371521902341312712562.51939213.673.5924.12235921361622340712852432.31938196.213.3136.8674691157173234071300OpenBenchmarking.org

fast-cli

Internet Download Speed

OpenBenchmarking.orgMbit/s, More Is Betterfast-cliInternet Download SpeedIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce60120180240300SE +/- 5.92, N = 15SE +/- 3.33, N = 3190256243

fast-cli

Internet Upload Speed

OpenBenchmarking.orgMbit/s, More Is Betterfast-cliInternet Upload SpeedIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce0.56251.1251.68752.252.8125SE +/- 0.04, N = 15SE +/- 0.03, N = 32.02.52.3

fast-cli

Internet Latency

OpenBenchmarking.orgms, Fewer Is Betterfast-cliInternet LatencyIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce1428425670SE +/- 0.47, N = 15SE +/- 2.03, N = 3641919

fast-cli

Internet Loaded Latency (Bufferbloat)

OpenBenchmarking.orgms, Fewer Is Betterfast-cliInternet Loaded Latency (Bufferbloat)Intel Ice Lake-LP PCH CNVi WiFiIcelakeIce918273645SE +/- 1.46, N = 15SE +/- 0.88, N = 3413938

speedtest-cli

Internet Download Speed

OpenBenchmarking.orgMbit/s, More Is Betterspeedtest-cli 2.1.3Internet Download SpeedIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce50100150200250SE +/- 7.91, N = 15SE +/- 10.66, N = 15138.06213.67196.21

speedtest-cli

Internet Upload Speed

OpenBenchmarking.orgMbit/s, More Is Betterspeedtest-cli 2.1.3Internet Upload SpeedIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce0.80781.61562.42343.23124.039SE +/- 0.06, N = 15SE +/- 0.04, N = 153.133.593.31

speedtest-cli

Internet Latency

OpenBenchmarking.orgms, Fewer Is Betterspeedtest-cli 2.1.3Internet LatencyIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce816243240SE +/- 1.17, N = 15SE +/- 1.03, N = 1530.4724.1236.87

ONNX Runtime

Model: GPT-2 - Device: CPU

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce10002000300040005000SE +/- 92.64, N = 12SE +/- 4.91, N = 34537359246911. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: yolov4 - Device: CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce306090120150SE +/- 1.56, N = 4SE +/- 2.37, N = 121521361571. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce4080120160200SE +/- 1.99, N = 12SE +/- 2.58, N = 121901621731. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce612182430SE +/- 0.00, N = 3SE +/- 0.29, N = 32323231. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce90180270360450SE +/- 2.19, N = 3SE +/- 2.20, N = 34134074071. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPUIntel Ice Lake-LP PCH CNVi WiFiIcelakeIce30060090012001500SE +/- 3.62, N = 3SE +/- 9.86, N = 31271128513001. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

Phoronix Test Suite v10.8.4