Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.
Linux 5.10.130 Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210
OS: Ubuntu 20.10, Kernel: 5.10.130-0510130-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Linux 5.15.83 OS: Ubuntu 20.10, Kernel: 5.15.83-051583-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Linux 6.1 OS: Ubuntu 20.10, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks OpenBenchmarking.org Phoronix Test Suite 10.8.4 Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads) Supermicro X11SPL-F v1.02 (3.1 BIOS) Intel Sky Lake-E DMI3 Registers 192GB 280GB INTEL SSDPED1D280GA ASPEED VE228 2 x Intel I210 Ubuntu 20.10 5.10.130-0510130-generic (x86_64) 5.15.83-051583-generic (x86_64) 6.1.0-phx (x86_64) GNOME Shell 3.38.1 X Server 1.20.9 GCC 10.3.0 ext4 1920x1080 Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernels Desktop Display Server Compiler File-System Screen Resolution - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102 - Python 3.8.10 - Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Linux 5.10.130 Linux 5.15.83 Linux 6.1 Result Overview Phoronix Test Suite 10.8.4 100% 107% 115% 122% 130% ctx_clock Dragonflydb JPEG XL Decoding libjxl EnCodec PostgreSQL GraphicsMagick C-Blosc Stress-NG AOM AV1 JPEG XL libjxl Facebook RocksDB Timed Linux Kernel Compilation Stargate Digital Audio Workstation spaCy ClickHouse Timed Erlang/OTP Compilation Timed Godot Game Engine Compilation libavif avifenc Mobile Neural Network Timed Node.js Compilation FLAC Audio Encoding Timed PHP Compilation miniBUDE Timed CPython Compilation 7-Zip Compression NCNN BRL-CAD Neural Magic DeepSparse srsRAN SVT-AV1 nekRS OpenVINO Y-Cruncher Xmrig Cpuminer-Opt WebP Image Encode OpenRadioss LAMMPS Molecular Dynamics Simulator TensorFlow Numenta Anomaly Benchmark Blender oneDNN ASTC Encoder Primesieve Aircrack-ng OpenFOAM OSPRay Studio Natron
Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks blosc: blosclz shuffle blosc: blosclz bitshuffle minibude: OpenMP - BM1 minibude: OpenMP - BM1 minibude: OpenMP - BM2 minibude: OpenMP - BM2 nekrs: TurboPipe Periodic openfoam: drivaerFastback, Small Mesh Size - Mesh Time openfoam: drivaerFastback, Small Mesh Size - Execution Time openfoam: drivaerFastback, Medium Mesh Size - Mesh Time openfoam: drivaerFastback, Medium Mesh Size - Execution Time openradioss: Bumper Beam openradioss: Cell Phone Drop Test openradioss: Bird Strike on Windshield openradioss: Rubber O-Ring Seal Installation openradioss: INIVOL and Fluid Structure Interaction Drop Container lammps: 20k Atoms lammps: Rhodopsin Protein xmrig: Monero - 1M xmrig: Wownero - 1M jpegxl: PNG - 80 jpegxl: PNG - 90 jpegxl: JPEG - 80 jpegxl: JPEG - 90 jpegxl: PNG - 100 jpegxl: JPEG - 100 jpegxl-decode: 1 jpegxl-decode: All webp: Default webp: Quality 100 webp: Quality 100, Lossless webp: Quality 100, Highest Compression webp: Quality 100, Lossless, Highest Compression srsran: OFDM_Test srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM graphics-magick: Swirl graphics-magick: Rotate graphics-magick: Sharpen graphics-magick: Enhanced graphics-magick: Resizing graphics-magick: Noise-Gaussian graphics-magick: HWB Color Space aom-av1: Speed 6 Two-Pass - Bosphorus 4K aom-av1: Speed 8 Realtime - Bosphorus 4K aom-av1: Speed 9 Realtime - Bosphorus 4K aom-av1: Speed 10 Realtime - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p compress-7zip: Compression Rating compress-7zip: Decompression Rating stargate: 44100 - 512 stargate: 96000 - 512 stargate: 192000 - 512 stargate: 44100 - 1024 stargate: 480000 - 512 stargate: 96000 - 1024 stargate: 192000 - 1024 stargate: 480000 - 1024 avifenc: 0 avifenc: 2 avifenc: 6 avifenc: 6, Lossless avifenc: 10, Lossless build-godot: Time To Compile build-linux-kernel: defconfig build-linux-kernel: allmodconfig build-nodejs: Time To Compile build-php: Time To Compile build-python: Default build-python: Released Build, PGO + LTO Optimized primesieve: 1e12 primesieve: 1e13 y-cruncher: 1B y-cruncher: 500M onednn: IP Shapes 1D - f32 - CPU onednn: IP Shapes 3D - f32 - CPU onednn: IP Shapes 1D - u8s8f32 - CPU onednn: IP Shapes 3D - u8s8f32 - CPU onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Recurrent Neural Network Training - u8s8f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU ospray-studio: 1 - 4K - 1 - Path Tracer ospray-studio: 2 - 4K - 1 - Path Tracer ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 1 - 4K - 16 - Path Tracer ospray-studio: 1 - 4K - 32 - Path Tracer ospray-studio: 2 - 4K - 16 - Path Tracer ospray-studio: 2 - 4K - 32 - Path Tracer ospray-studio: 3 - 4K - 16 - Path Tracer ospray-studio: 3 - 4K - 32 - Path Tracer ospray-studio: 1 - 1080p - 1 - Path Tracer ospray-studio: 2 - 1080p - 1 - Path Tracer ospray-studio: 3 - 1080p - 1 - Path Tracer ospray-studio: 1 - 1080p - 16 - Path Tracer ospray-studio: 1 - 1080p - 32 - Path Tracer ospray-studio: 2 - 1080p - 16 - Path Tracer ospray-studio: 2 - 1080p - 32 - Path Tracer ospray-studio: 3 - 1080p - 16 - Path Tracer ospray-studio: 3 - 1080p - 32 - Path Tracer build-erlang: Time To Compile encode-flac: WAV To FLAC aircrack-ng: cpuminer-opt: Magi cpuminer-opt: x25x cpuminer-opt: scrypt cpuminer-opt: Deepcoin cpuminer-opt: Ringcoin cpuminer-opt: Blake-2 S cpuminer-opt: Garlicoin cpuminer-opt: Skeincoin cpuminer-opt: Myriad-Groestl cpuminer-opt: LBC, LBRY Credits cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: Triple SHA-256, Onecoin clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cache clickhouse: 100M Rows Web Analytics Dataset, Second Run clickhouse: 100M Rows Web Analytics Dataset, Third Run dragonflydb: 50 - 1:1 dragonflydb: 50 - 1:5 dragonflydb: 50 - 5:1 dragonflydb: 200 - 1:1 dragonflydb: 200 - 1:5 dragonflydb: 200 - 5:1 astcenc: Fast astcenc: Medium astcenc: Thorough astcenc: Exhaustive pgbench: 100 - 100 - Read Only pgbench: 100 - 100 - Read Only - Average Latency pgbench: 100 - 250 - Read Only pgbench: 100 - 250 - Read Only - Average Latency pgbench: 100 - 500 - Read Only pgbench: 100 - 500 - Read Only - Average Latency pgbench: 100 - 100 - Read Write pgbench: 100 - 100 - Read Write - Average Latency pgbench: 100 - 250 - Read Write pgbench: 100 - 250 - Read Write - Average Latency pgbench: 100 - 500 - Read Write pgbench: 100 - 500 - Read Write - Average Latency tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 32 - AlexNet tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 32 - GoogLeNet tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream stress-ng: MMAP stress-ng: NUMA stress-ng: Futex stress-ng: MEMFD stress-ng: Mutex stress-ng: Atomic stress-ng: Crypto stress-ng: Malloc stress-ng: Forking stress-ng: IO_uring stress-ng: SENDFILE stress-ng: CPU Cache stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Vector Math stress-ng: x86_64 RdRand stress-ng: Memory Copying stress-ng: Socket Activity stress-ng: Context Switching stress-ng: Glibc C String Functions stress-ng: Glibc Qsort Data Sorting stress-ng: System V Message Passing spacy: en_core_web_lg spacy: en_core_web_trf mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet blender: BMW27 - CPU-Only blender: Classroom - CPU-Only blender: Fishy Cat - CPU-Only blender: Barbershop - CPU-Only blender: Pabellon Barcelona - CPU-Only ctx-clock: Context Switch Time openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU rocksdb: Rand Fill rocksdb: Rand Read rocksdb: Update Rand rocksdb: Seq Fill rocksdb: Rand Fill Sync rocksdb: Read While Writing rocksdb: Read Rand Write Rand natron: Spaceship encodec: 3 kbps encodec: 6 kbps encodec: 24 kbps encodec: 1.5 kbps brl-cad: VGR Performance Metric numenta-nab: KNN CAD numenta-nab: Relative Entropy numenta-nab: Windowed Gaussian numenta-nab: Earthgecko Skyline numenta-nab: Bayesian Changepoint numenta-nab: Contextual Anomaly Detector OSE Linux 5.10.130 Linux 5.15.83 Linux 6.1 15238.1 10158.9 530.266 21.211 534.738 21.389 70649766667 38.53511 188.28208 241.48551 1598.6991 152.41 96.21 256.43 159.75 443.72 10.427 10.659 6794.5 9492.2 7.70 7.58 7.45 7.30 0.54 0.53 38.17 208.79 14.37 9.00 1.27 3.07 0.48 122000000 279.8 117.3 279.8 123.3 303.4 126.9 307.0 131.0 98.6 65.9 502 757 199 315 1333 335 976 11.70 37.88 48.05 48.34 2.475 34.519 126.497 120.794 7.046 95.493 415.136 423.649 106357 86432 3.909552 2.537891 1.536255 4.385893 3.726933 2.999611 1.889268 4.199568 145.012 70.517 6.689 11.376 6.637 97.246 70.169 907.748 453.613 65.325 19.449 383.514 14.443 174.722 24.449 11.345 2.29636 3.10144 0.496613 1.25271 4.29153 4.70699 3.30606 4.15869 0.540654 0.851455 1613.12 909.632 1621.84 911.816 0.956399 0.313238 7055 7242 8633 121467 234216 124428 239935 146583 284699 1778 1826 2178 28409 65271 29172 66823 34786 78016 91.560 21.110 50605.559 374.94 640.06 491.90 14497 2833.09 1149103 6572.81 135103 17363 96820 218830 315913 205.76 212.60 212.42 978963.31 1047699.23 989148.97 971725.25 1021149.38 918617.37 193.1315 72.1595 9.3225 0.9371 465422 0.215 413949 0.604 370238 1.350 53656 1.864 47676 5.244 38503 12.986 166.55 211.25 243.30 278.63 114.41 37.68 121.72 40.23 125.79 41.90 130.21 43.50 10.5210 758.0277 9.5996 104.1622 55.4233 144.2410 43.7612 22.8396 86.6567 92.2142 75.2616 13.2689 219.3569 36.4390 132.6485 7.5265 108.5475 73.6759 73.6039 13.5771 55.5433 144.0062 38.4438 26.0011 10.5403 752.8319 9.6153 103.9960 390.20 358.05 1498828.70 1008.62 8606774.99 223731.70 18742.67 22392194.28 56719.51 36489.15 241610.68 116.33 34273.52 3214994.83 55915.36 55351.58 252390.56 4201.02 10160.91 5500706.76 911917.94 194.36 6490812.35 11314 2446 14.910 2.091 2.592 10.148 4.892 3.855 2.678 22.733 14.54 5.56 4.95 5.66 4.91 7.06 2.38 11.57 26.95 8.09 5.46 14.20 23.60 17.13 18.83 160.27 7.02 106.13 318.28 144.25 1145.90 373.74 154 5.88 1357.37 3.31 2400.02 3.25 2436.30 272.09 29.37 19.11 417.71 969.33 8.24 625.50 25.53 64.82 123.34 1991.75 8.02 485.36 16.47 15259.86 1.04 31167.81 0.50 983199 65094239 625695 1204255 216464 3100899 2132608 3.6 29.141 29.495 34.162 28.208 167771 185.330 15.803 9.070 114.813 41.392 55.734 15998.6 10555.7 529.240 21.170 532.924 21.317 70923633333 38.235781 186.39843 242.25487 1611.5943 151.82 96.31 256.19 159.15 445.17 10.414 10.639 6829.8 9531.3 7.71 7.54 7.40 7.25 0.54 0.53 37.90 209.18 14.40 9.02 1.28 3.09 0.48 122633333 282.7 118.3 282.0 123.9 310.0 128.0 307.9 131.6 98.6 66.0 499 731 199 314 1321 331 957 11.77 37.86 47.66 48.33 2.483 34.818 127.534 122.978 6.985 95.043 418.022 425.263 108058 86735 3.972591 2.579045 1.567049 4.431098 3.790321 3.063511 1.989680 4.270897 144.709 71.065 6.749 11.425 6.666 97.568 70.488 911.083 453.307 65.143 19.493 383.962 14.429 174.658 24.562 11.366 2.29385 3.08561 0.497248 1.25174 4.31178 4.70834 3.29633 4.20343 0.540452 0.846543 1611.14 912.066 1614.87 908.188 0.961682 0.316005 7046 7246 8628 121486 234142 124556 240311 146570 284853 1778 1826 2176 28417 65242 29206 66817 34801 77997 91.754 21.098 50607.738 373.55 641.61 489.83 14500 2812.34 1150583 6594.18 134833 17610 96663 218493 313917 204.26 209.58 215.02 1123953.55 1186278.25 1068662.91 1060251.05 1117321.90 993337.90 193.0244 72.1219 9.3267 0.9375 515273 0.194 475175 0.526 426428 1.173 56230 1.779 45922 5.444 33824 14.783 166.90 211.47 242.73 279.05 115.15 38.09 122.18 40.41 126.29 42.05 130.40 43.41 10.4539 759.3525 9.6141 104.0054 55.5849 143.8065 42.9013 23.3139 86.9402 91.9860 75.0401 13.3089 219.0088 36.4973 134.1326 7.4408 108.3377 73.8216 72.0552 13.8679 54.4332 146.9505 37.7602 26.4774 10.4339 760.8374 9.6111 104.0376 381.23 335.58 2364278.75 879.67 9013626.15 225144.33 18733.10 20930090.96 60087.36 32758.89 285766.99 128.31 34238.77 3314461.38 55890.23 55415.01 252393.88 4129.34 17786.17 2284154.16 916397.13 194.88 8257907.06 11236 2416 14.880 2.071 2.537 9.850 4.897 3.752 2.639 22.438 14.71 5.53 4.95 5.59 4.85 6.99 2.29 11.46 27.69 8.05 5.48 14.21 23.89 16.85 18.67 161.23 6.91 106.38 317.07 144.34 1144.82 373.54 179 5.88 1356.35 3.30 2401.74 3.25 2441.67 272.80 29.29 19.15 416.95 957.08 8.34 623.36 25.62 64.28 124.34 1993.58 8.01 485.19 16.46 15258.56 1.03 31007.38 0.5 982848 65233649 616626 1193837 234969 3043279 2129359 3.6 28.660 29.530 33.917 28.349 166852 182.657 15.813 9.018 115.529 41.433 55.659 15256.1 10161.3 535.565 21.422 538.790 21.552 70481500000 38.361993 186.93467 242.92307 1607.4012 153.23 96.30 255.89 160.27 446.66 10.399 10.608 6767.3 9527.7 7.36 7.20 7.08 6.94 0.53 0.52 36.37 181.54 14.38 8.95 1.27 3.08 0.48 120733333 280.2 117.1 280.3 123.3 307.4 127.2 305.5 130.3 98.3 65.9 491 668 197 311 1299 322 872 11.65 36.10 45.41 45.97 2.460 34.723 126.763 121.596 7.024 95.151 409.127 419.750 106968 86680 3.817268 2.497164 1.520040 4.311382 3.718812 3.012585 1.928814 4.208880 145.036 71.201 6.798 11.580 6.909 99.420 72.558 934.265 459.753 65.964 19.777 385.5 14.424 174.977 24.455 11.294 2.29708 3.09433 0.496776 1.24871 4.28618 4.98067 3.31244 4.18096 0.541430 0.831866 1614.07 909.147 1618.86 913.943 0.963400 0.313975 7048 7245 8633 123000 234371 126341 240430 146692 284235 1779 1824 2173 28479 65894 29165 67837 34779 79804 93.739 21.376 50609.276 373.45 638.64 491.85 14420 2800.62 1137550 6571.66 134320 17477 96010 217237 315723 198.51 204.43 212.92 1130454.03 1180450.09 1074996.43 1046604.15 1099078.40 979549.43 192.9917 72.0972 9.3103 0.9368 523788 0.191 487468 0.513 467167 1.070 54365 1.839 45223 5.528 36109 13.847 166.31 211.06 242.34 279.22 116.16 38.01 123.19 40.32 126.49 42.06 130.47 43.37 10.4097 764.7425 9.5393 104.8348 55.4366 144.2114 43.3202 23.0718 86.8832 92.0462 75.2635 13.2691 218.6936 36.5392 132.5077 7.5359 108.7443 73.5456 71.8852 13.9013 54.2726 147.3804 37.2115 26.8656 10.3832 763.3064 9.6532 103.5823 310.22 256.61 2433807.14 667.82 7375258.06 225639.32 18727.61 15989079.77 53632.67 32918.80 284966.04 115.59 34059.43 3315660.88 55875.18 55344.32 252372.29 4181.80 16990.75 2054658.64 916843.52 194.30 14896082.79 11231 2341 15.122 2.083 2.606 9.932 4.969 3.831 2.640 22.789 14.45 5.57 4.95 5.63 4.89 7.04 2.36 11.48 26.52 7.85 5.46 13.83 23.35 16.76 18.70 160.39 6.96 106.46 318.71 144.29 1145.18 374.17 200 5.89 1357.10 3.28 2415.31 3.23 2451.10 267.62 29.86 19.17 416.16 957.41 8.33 620.61 25.73 63.96 124.97 1992.23 8.02 491.24 16.27 15144.32 1.04 30632.46 0.51 935285 65337175 594485 1134991 218454 2985392 2133528 3.6 30.426 32.017 36.321 30.493 168334 180.519 15.525 9.073 115.831 41.936 55.815 OpenBenchmarking.org