onnx hp zbook Intel Core i9-10885H testing with a HP 8736 (S91 Ver. 01.02.01 BIOS) and NVIDIA Quadro RTX 5000 with Max-Q Design 16GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2101170-PTS-ONNXHPZB35&sor&grs .
onnx hp zbook Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution 1 2 3 4 Intel Core i9-10885H @ 5.30GHz (8 Cores / 16 Threads) HP 8736 (S91 Ver. 01.02.01 BIOS) Intel Comet Lake PCH 32GB 2048GB KXG50PNV2T04 KIOXIA NVIDIA Quadro RTX 5000 with Max-Q Design 16GB (300/405MHz) Intel Comet Lake PCH cAVS Intel Wi-Fi 6 AX201 Ubuntu 20.04 5.6.0-1042-oem (x86_64) GNOME Shell 3.36.4 X Server 1.20.8 NVIDIA 450.102.04 4.6.0 OpenCL 1.2 CUDA 11.0.228 1.2.133 GCC 9.3.0 + CUDA 10.1 ext4 1920x1080 NVIDIA Quadro RTX 5000 with Max-Q Design 16GB (600/6000MHz) OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave - CPU Microcode: 0xe0 - Thermald 1.9.1 Python Details - Python 3.8.3 Security Details - itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected
onnx hp zbook onnx: super-resolution-10 - OpenMP CPU onnx: bertsquad-10 - OpenMP CPU onnx: shufflenet-v2-10 - OpenMP CPU onnx: fcn-resnet101-11 - OpenMP CPU onnx: yolov4 - OpenMP CPU 1 2 3 4 2658 362 12302 40 255 2670 364 12357 40 254 2673 364 12327 40 256 2645 363 12310 40 249 OpenBenchmarking.org
ONNX Runtime Model: super-resolution-10 - Device: OpenMP CPU OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.6 Model: super-resolution-10 - Device: OpenMP CPU 3 2 1 4 600 1200 1800 2400 3000 SE +/- 6.99, N = 3 SE +/- 19.94, N = 3 SE +/- 5.07, N = 3 SE +/- 6.56, N = 3 2673 2670 2658 2645 1. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
ONNX Runtime Model: bertsquad-10 - Device: OpenMP CPU OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.6 Model: bertsquad-10 - Device: OpenMP CPU 3 2 4 1 80 160 240 320 400 SE +/- 1.26, N = 3 SE +/- 1.42, N = 3 SE +/- 1.32, N = 3 SE +/- 1.26, N = 3 364 364 363 362 1. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
ONNX Runtime Model: shufflenet-v2-10 - Device: OpenMP CPU OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.6 Model: shufflenet-v2-10 - Device: OpenMP CPU 2 3 4 1 3K 6K 9K 12K 15K SE +/- 20.22, N = 3 SE +/- 45.09, N = 3 SE +/- 66.71, N = 3 SE +/- 27.25, N = 3 12357 12327 12310 12302 1. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: OpenMP CPU OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.6 Model: fcn-resnet101-11 - Device: OpenMP CPU 4 3 2 1 9 18 27 36 45 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 40 40 40 40 1. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
ONNX Runtime Model: yolov4 - Device: OpenMP CPU OpenBenchmarking.org Inferences Per Minute, More Is Better ONNX Runtime 1.6 Model: yolov4 - Device: OpenMP CPU 3 1 2 4 60 120 180 240 300 SE +/- 3.42, N = 3 SE +/- 3.06, N = 4 SE +/- 2.26, N = 7 SE +/- 5.36, N = 10 256 255 254 249 1. (CXX) g++ options: -fopenmp -ffunction-sections -fdata-sections -O3 -ldl -lrt
Phoronix Test Suite v10.8.5