Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.
Linux 5.10.130 Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210
OS: Ubuntu 20.10, Kernel: 5.10.130-0510130-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Linux 5.15.83 OS: Ubuntu 20.10, Kernel: 5.15.83-051583-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Linux 6.1 OS: Ubuntu 20.10, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks OpenBenchmarking.org Phoronix Test Suite 10.8.4 Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads) Supermicro X11SPL-F v1.02 (3.1 BIOS) Intel Sky Lake-E DMI3 Registers 192GB 280GB INTEL SSDPED1D280GA ASPEED VE228 2 x Intel I210 Ubuntu 20.10 5.10.130-0510130-generic (x86_64) 5.15.83-051583-generic (x86_64) 6.1.0-phx (x86_64) GNOME Shell 3.38.1 X Server 1.20.9 GCC 10.3.0 ext4 1920x1080 Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernels Desktop Display Server Compiler File-System Screen Resolution - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102 - Python 3.8.10 - Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled
Linux 5.10.130 Linux 5.15.83 Linux 6.1 Result Overview Phoronix Test Suite 10.8.4 100% 107% 115% 122% 130% ctx_clock Dragonflydb JPEG XL Decoding libjxl EnCodec PostgreSQL GraphicsMagick C-Blosc Stress-NG AOM AV1 JPEG XL libjxl Facebook RocksDB Timed Linux Kernel Compilation Stargate Digital Audio Workstation spaCy ClickHouse Timed Erlang/OTP Compilation Timed Godot Game Engine Compilation libavif avifenc Mobile Neural Network Timed Node.js Compilation FLAC Audio Encoding Timed PHP Compilation miniBUDE Timed CPython Compilation 7-Zip Compression NCNN BRL-CAD Neural Magic DeepSparse srsRAN SVT-AV1 nekRS OpenVINO Y-Cruncher Xmrig Cpuminer-Opt WebP Image Encode OpenRadioss LAMMPS Molecular Dynamics Simulator TensorFlow Numenta Anomaly Benchmark Blender oneDNN ASTC Encoder Primesieve Aircrack-ng OSPRay Studio OpenFOAM Natron
Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks stress-ng: Context Switching stress-ng: System V Message Passing stress-ng: MEMFD stress-ng: Malloc stress-ng: NUMA ctx-clock: Context Switch Time pgbench: 100 - 500 - Read Only pgbench: 100 - 500 - Read Only - Average Latency stress-ng: MMAP stress-ng: Mutex stress-ng: SENDFILE pgbench: 100 - 250 - Read Only pgbench: 100 - 250 - Read Only - Average Latency jpegxl-decode: All pgbench: 100 - 500 - Read Write - Average Latency pgbench: 100 - 500 - Read Write graphics-magick: Rotate dragonflydb: 50 - 1:5 pgbench: 100 - 100 - Read Only - Average Latency pgbench: 100 - 100 - Read Only stress-ng: Forking graphics-magick: HWB Color Space stress-ng: IO_uring dragonflydb: 200 - 1:5 dragonflydb: 200 - 1:1 dragonflydb: 50 - 5:1 encodec: 6 kbps rocksdb: Rand Fill Sync dragonflydb: 200 - 5:1 encodec: 1.5 kbps encodec: 24 kbps encodec: 3 kbps rocksdb: Seq Fill onednn: Deconvolution Batch shapes_1d - f32 - CPU aom-av1: Speed 9 Realtime - Bosphorus 4K pgbench: 100 - 250 - Read Write pgbench: 100 - 250 - Read Write - Average Latency stargate: 192000 - 1024 jpegxl: PNG - 90 rocksdb: Update Rand jpegxl: JPEG - 80 jpegxl: JPEG - 90 aom-av1: Speed 10 Realtime - Bosphorus 4K rocksdb: Rand Fill blosc: blosclz shuffle jpegxl-decode: 1 aom-av1: Speed 8 Realtime - Bosphorus 4K pgbench: 100 - 100 - Read Write pgbench: 100 - 100 - Read Write - Average Latency jpegxl: PNG - 80 spacy: en_core_web_trf avifenc: 10, Lossless stargate: 44100 - 512 graphics-magick: Noise-Gaussian clickhouse: 100M Rows Web Analytics Dataset, Second Run ncnn: CPU - blazeface blosc: blosclz bitshuffle rocksdb: Read While Writing clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cache build-linux-kernel: defconfig deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream stargate: 96000 - 512 stress-ng: Semaphores stargate: 192000 - 512 mnn: resnet-v2-50 build-linux-kernel: allmodconfig stargate: 44100 - 1024 ncnn: CPU - resnet50 mnn: MobileNetV2_224 mnn: squeezenetv1.1 numenta-nab: KNN CAD graphics-magick: Resizing deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream build-erlang: Time To Compile onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream ospray-studio: 3 - 1080p - 32 - Path Tracer ncnn: CPU - yolov4-tiny graphics-magick: Swirl build-godot: Time To Compile ncnn: CPU - squeezenet_ssd srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM svt-av1: Preset 12 - Bosphorus 1080p stargate: 96000 - 1024 deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU jpegxl: JPEG - 100 stargate: 480000 - 512 jpegxl: PNG - 100 numenta-nab: Relative Entropy svt-av1: Preset 13 - Bosphorus 4K ncnn: CPU - mobilenet avifenc: 6, Lossless openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU stress-ng: Memory Copying stargate: 480000 - 1024 build-python: Default avifenc: 6 mnn: nasnet compress-7zip: Compression Rating ncnn: CPU - FastestDet mnn: SqueezeNetV1.0 srsran: OFDM_Test mnn: inception-v3 ospray-studio: 2 - 4K - 16 - Path Tracer tensorflow: CPU - 16 - GoogLeNet ospray-studio: 2 - 1080p - 32 - Path Tracer deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream mnn: mobilenet-v1-1.0 cpuminer-opt: Myriad-Groestl build-nodejs: Time To Compile deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU encode-flac: WAV To FLAC numenta-nab: Bayesian Changepoint svt-av1: Preset 13 - Bosphorus 1080p graphics-magick: Enhanced openvino: Vehicle Detection FP16-INT8 - CPU deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream ospray-studio: 1 - 4K - 16 - Path Tracer build-php: Time To Compile ncnn: CPU - shufflenet-v2 openvino: Person Vehicle Bike Detection FP16 - CPU ncnn: CPU - mnasnet openvino: Person Vehicle Bike Detection FP16 - CPU deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream clickhouse: 100M Rows Web Analytics Dataset, Third Run openvino: Vehicle Detection FP16-INT8 - CPU tensorflow: CPU - 32 - GoogLeNet minibude: OpenMP - BM1 minibude: OpenMP - BM1 cpuminer-opt: Ringcoin cpuminer-opt: Blake-2 S minibude: OpenMP - BM2 minibude: OpenMP - BM2 tensorflow: CPU - 16 - ResNet-50 onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM aom-av1: Speed 6 Two-Pass - Bosphorus 4K srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM graphics-magick: Sharpen openfoam: drivaerFastback, Small Mesh Size - Execution Time ncnn: CPU - efficientnet-b0 ospray-studio: 1 - 1080p - 32 - Path Tracer srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM openvino: Age Gender Recognition Retail 0013 FP16 - CPU avifenc: 2 mnn: mobilenetV3 ncnn: CPU - googlenet svt-av1: Preset 4 - Bosphorus 4K openradioss: Bumper Beam xmrig: Monero - 1M openvino: Person Detection FP16 - CPU brl-cad: VGR Performance Metric numenta-nab: Earthgecko Skyline deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU svt-av1: Preset 4 - Bosphorus 1080p srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM svt-av1: Preset 8 - Bosphorus 4K ncnn: CPU - regnety_400m stress-ng: Atomic cpuminer-opt: LBC, LBRY Credits svt-av1: Preset 12 - Bosphorus 4K openfoam: drivaerFastback, Medium Mesh Size - Execution Time deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream openvino: Weld Porosity Detection FP16 - CPU webp: Quality 100, Lossless srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream openvino: Weld Porosity Detection FP16 - CPU openfoam: drivaerFastback, Small Mesh Size - Mesh Time webp: Quality 100 openvino: Age Gender Recognition Retail 0013 FP16 - CPU spacy: en_core_web_lg cpuminer-opt: Quad SHA-256, Pyrite onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU ncnn: CPU-v2-v2 - mobilenet-v2 openradioss: Rubber O-Ring Seal Installation openradioss: INIVOL and Fluid Structure Interaction Drop Container webp: Quality 100, Highest Compression y-cruncher: 500M openvino: Person Detection FP16 - CPU cpuminer-opt: Triple SHA-256, Onecoin onednn: Recurrent Neural Network Inference - u8s8f32 - CPU stress-ng: CPU Stress nekrs: TurboPipe Periodic openvino: Person Detection FP32 - CPU numenta-nab: Windowed Gaussian openvino: Person Detection FP32 - CPU ncnn: CPU - vision_transformer onednn: Convolution Batch Shapes Auto - f32 - CPU openfoam: drivaerFastback, Medium Mesh Size - Mesh Time cpuminer-opt: Skeincoin tensorflow: CPU - 64 - GoogLeNet cpuminer-opt: Deepcoin stress-ng: Glibc C String Functions build-python: Released Build, PGO + LTO Optimized blender: Classroom - CPU-Only onednn: IP Shapes 3D - f32 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM lammps: Rhodopsin Protein svt-av1: Preset 8 - Bosphorus 1080p cpuminer-opt: x25x y-cruncher: 1B tensorflow: CPU - 32 - ResNet-50 deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream onednn: Recurrent Neural Network Training - u8s8f32 - CPU cpuminer-opt: scrypt xmrig: Wownero - 1M cpuminer-opt: Magi tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 64 - ResNet-50 deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream rocksdb: Rand Read openvino: Face Detection FP16-INT8 - CPU ncnn: CPU - alexnet tensorflow: CPU - 16 - AlexNet compress-7zip: Decompression Rating cpuminer-opt: Garlicoin deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream onednn: Recurrent Neural Network Inference - f32 - CPU onednn: IP Shapes 3D - u8s8f32 - CPU openvino: Face Detection FP16-INT8 - CPU blender: BMW27 - CPU-Only srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream tensorflow: CPU - 256 - ResNet-50 stress-ng: Glibc Qsort Data Sorting deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream numenta-nab: Contextual Anomaly Detector OSE deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream lammps: 20k Atoms deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream ospray-studio: 1 - 1080p - 16 - Path Tracer ospray-studio: 3 - 1080p - 1 - Path Tracer avifenc: 0 ospray-studio: 3 - 4K - 32 - Path Tracer tensorflow: CPU - 256 - AlexNet openradioss: Bird Strike on Windshield webp: Default ospray-studio: 2 - 4K - 32 - Path Tracer tensorflow: CPU - 256 - GoogLeNet rocksdb: Read Rand Write Rand tensorflow: CPU - 32 - AlexNet primesieve: 1e13 onednn: Recurrent Neural Network Training - f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU astcenc: Thorough openvino: Face Detection FP16 - CPU blender: Pabellon Barcelona - CPU-Only srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM onednn: IP Shapes 1D - f32 - CPU ospray-studio: 2 - 1080p - 16 - Path Tracer primesieve: 1e12 onednn: IP Shapes 1D - u8s8f32 - CPU ospray-studio: 1 - 4K - 1 - Path Tracer stress-ng: Vector Math openvino: Weld Porosity Detection FP16-INT8 - CPU ospray-studio: 2 - 1080p - 1 - Path Tracer openradioss: Cell Phone Drop Test ospray-studio: 1 - 4K - 32 - Path Tracer blender: Barbershop - CPU-Only openvino: Weld Porosity Detection FP16-INT8 - CPU astcenc: Medium ospray-studio: 3 - 4K - 16 - Path Tracer stress-ng: Crypto openvino: Face Detection FP16 - CPU astcenc: Exhaustive astcenc: Fast stress-ng: Matrix Math ospray-studio: 3 - 1080p - 16 - Path Tracer blender: Fishy Cat - CPU-Only ospray-studio: 3 - 4K - 1 - Path Tracer ospray-studio: 1 - 1080p - 1 - Path Tracer ospray-studio: 2 - 4K - 1 - Path Tracer stress-ng: x86_64 RdRand aircrack-ng: natron: Spaceship ncnn: CPU-v3-v3 - mobilenet-v3 webp: Quality 100, Lossless, Highest Compression ncnn: CPU - resnet18 ncnn: CPU - vgg16 stress-ng: Socket Activity stress-ng: CPU Cache stress-ng: Futex dragonflydb: 50 - 1:1 Linux 5.10.130 Linux 5.15.83 Linux 6.1 5500706.76 6490812.35 1008.62 22392194.28 358.05 154 370238 1.350 390.20 8606774.99 241610.68 413949 0.604 208.79 12.986 38503 757 1047699.23 0.215 465422 56719.51 976 36489.15 1021149.38 971725.25 989148.97 29.495 216464 918617.37 28.208 34.162 29.141 1204255 4.70699 48.05 47676 5.244 1.889268 7.58 625695 7.45 7.30 48.34 983199 15238.1 38.17 37.88 53656 1.864 7.70 2446 6.637 3.909552 335 212.60 2.38 10158.9 3100899 205.76 70.169 26.0011 38.4438 2.537891 3214994.83 1.536255 10.148 907.748 4.385893 14.20 3.855 2.592 185.330 1333 73.6039 13.5771 91.560 0.851455 144.0062 55.5433 78016 23.60 502 97.246 17.13 303.4 415.136 2.999611 22.8396 43.7612 0.50 29.37 272.09 0.53 3.726933 0.54 15.803 120.794 14.54 11.376 31167.81 4201.02 4.199568 19.449 6.689 14.910 106357 7.02 4.892 122000000 22.733 124428 114.41 66823 10.5403 2.678 17363 453.613 752.8319 64.82 123.34 21.110 41.392 423.649 315 969.33 7.5265 121467 65.325 5.66 485.36 4.91 16.47 132.6485 212.42 8.24 121.72 530.266 21.211 2833.09 1149103 21.389 534.738 37.68 4.15869 10.5210 279.8 11.70 117.3 199 188.28208 7.06 65271 131.0 1.04 70.517 2.091 11.57 2.475 152.41 6794.5 3.31 167771 114.813 758.0277 0.313238 7.046 126.9 34.519 18.83 223731.70 96820 126.497 1598.6991 104.1622 625.50 1.27 279.8 307.0 9.5996 25.53 38.53511 9.00 15259.86 11314 218830 0.956399 5.56 159.75 443.72 3.07 11.345 2400.02 315913 911.816 34273.52 70649766667 3.25 9.070 2436.30 160.27 4.29153 241.48551 135103 125.79 14497 911917.94 383.514 318.28 3.10144 3.30606 123.3 10.659 95.493 640.06 24.449 40.23 103.9960 9.6153 1621.84 491.90 9492.2 374.94 243.30 41.90 108.5475 73.6759 65094239 417.71 5.46 166.55 86432 6572.81 86.6567 909.632 1.25271 19.11 106.13 98.6 219.3569 144.2410 13.2689 43.50 194.36 75.2616 55.4233 55.734 36.4390 10.427 92.2142 28409 2178 145.012 284699 278.63 256.43 14.37 239935 130.21 2132608 211.25 174.722 1613.12 0.540654 9.3225 5.88 373.74 65.9 2.29636 29172 14.443 0.496613 7055 55351.58 8.02 1826 96.21 234216 1145.90 1991.75 72.1595 146583 18742.67 1357.37 0.9371 193.1315 55915.36 34786 144.25 8633 1778 7242 252390.56 50605.559 3.6 4.95 0.48 8.09 26.95 10160.91 116.33 1498828.70 978963.31 2284154.16 8257907.06 879.67 20930090.96 335.58 179 426428 1.173 381.23 9013626.15 285766.99 475175 0.526 209.18 14.783 33824 731 1186278.25 0.194 515273 60087.36 957 32758.89 1117321.90 1060251.05 1068662.91 29.530 234969 993337.90 28.349 33.917 28.660 1193837 4.70834 47.66 45922 5.444 1.989680 7.54 616626 7.40 7.25 48.33 982848 15998.6 37.90 37.86 56230 1.779 7.71 2416 6.666 3.972591 331 209.58 2.29 10555.7 3043279 204.26 70.488 26.4774 37.7602 2.579045 3314461.38 1.567049 9.850 911.083 4.431098 14.21 3.752 2.537 182.657 1321 72.0552 13.8679 91.754 0.846543 146.9505 54.4332 77997 23.89 499 97.568 16.85 310.0 418.022 3.063511 23.3139 42.9013 0.5 29.29 272.80 0.53 3.790321 0.54 15.813 122.978 14.71 11.425 31007.38 4129.34 4.270897 19.493 6.749 14.880 108058 6.91 4.897 122633333 22.438 124556 115.15 66817 10.4339 2.639 17610 453.307 760.8374 64.28 124.34 21.098 41.433 425.263 314 957.08 7.4408 121486 65.143 5.59 485.19 4.85 16.46 134.1326 215.02 8.34 122.18 529.240 21.170 2812.34 1150583 21.317 532.924 38.09 4.20343 10.4539 282.7 11.77 118.3 199 186.39843 6.99 65242 131.6 1.03 71.065 2.071 11.46 2.483 151.82 6829.8 3.30 166852 115.529 759.3525 0.316005 6.985 128.0 34.818 18.67 225144.33 96663 127.534 1611.5943 104.0054 623.36 1.28 282.0 307.9 9.6141 25.62 38.235781 9.02 15258.56 11236 218493 0.961682 5.53 159.15 445.17 3.09 11.366 2401.74 313917 908.188 34238.77 70923633333 3.25 9.018 2441.67 161.23 4.31178 242.25487 134833 126.29 14500 916397.13 383.962 317.07 3.08561 3.29633 123.9 10.639 95.043 641.61 24.562 40.41 104.0376 9.6111 1614.87 489.83 9531.3 373.55 242.73 42.05 108.3377 73.8216 65233649 416.95 5.48 166.90 86735 6594.18 86.9402 912.066 1.25174 19.15 106.38 98.6 219.0088 143.8065 13.3089 43.41 194.88 75.0401 55.5849 55.659 36.4973 10.414 91.9860 28417 2176 144.709 284853 279.05 256.19 14.40 240311 130.40 2129359 211.47 174.658 1611.14 0.540452 9.3267 5.88 373.54 66.0 2.29385 29206 14.429 0.497248 7046 55415.01 8.01 1826 96.31 234142 1144.82 1993.58 72.1219 146570 18733.10 1356.35 0.9375 193.0244 55890.23 34801 144.34 8628 1778 7246 252393.88 50607.738 3.6 4.95 0.48 8.05 27.69 17786.17 128.31 2364278.75 1123953.55 2054658.64 14896082.79 667.82 15989079.77 256.61 200 467167 1.070 310.22 7375258.06 284966.04 487468 0.513 181.54 13.847 36109 668 1180450.09 0.191 523788 53632.67 872 32918.80 1099078.40 1046604.15 1074996.43 32.017 218454 979549.43 30.493 36.321 30.426 1134991 4.98067 45.41 45223 5.528 1.928814 7.20 594485 7.08 6.94 45.97 935285 15256.1 36.37 36.10 54365 1.839 7.36 2341 6.909 3.817268 322 204.43 2.36 10161.3 2985392 198.51 72.558 26.8656 37.2115 2.497164 3315660.88 1.520040 9.932 934.265 4.311382 13.83 3.831 2.606 180.519 1299 71.8852 13.9013 93.739 0.831866 147.3804 54.2726 79804 23.35 491 99.420 16.76 307.4 409.127 3.012585 23.0718 43.3202 0.51 29.86 267.62 0.52 3.718812 0.53 15.525 121.596 14.45 11.580 30632.46 4181.80 4.208880 19.777 6.798 15.122 106968 6.96 4.969 120733333 22.789 126341 116.16 67837 10.3832 2.640 17477 459.753 763.3064 63.96 124.97 21.376 41.936 419.750 311 957.41 7.5359 123000 65.964 5.63 491.24 4.89 16.27 132.5077 212.92 8.33 123.19 535.565 21.422 2800.62 1137550 21.552 538.790 38.01 4.18096 10.4097 280.2 11.65 117.1 197 186.93467 7.04 65894 130.3 1.04 71.201 2.083 11.48 2.460 153.23 6767.3 3.28 168334 115.831 764.7425 0.313975 7.024 127.2 34.723 18.70 225639.32 96010 126.763 1607.4012 104.8348 620.61 1.27 280.3 305.5 9.5393 25.73 38.361993 8.95 15144.32 11231 217237 0.963400 5.57 160.27 446.66 3.08 11.294 2415.31 315723 913.943 34059.43 70481500000 3.23 9.073 2451.10 160.39 4.28618 242.92307 134320 126.49 14420 916843.52 385.5 318.71 3.09433 3.31244 123.3 10.608 95.151 638.64 24.455 40.32 103.5823 9.6532 1618.86 491.85 9527.7 373.45 242.34 42.06 108.7443 73.5456 65337175 416.16 5.46 166.31 86680 6571.66 86.8832 909.147 1.24871 19.17 106.46 98.3 218.6936 144.2114 13.2691 43.37 194.30 75.2635 55.4366 55.815 36.5392 10.399 92.0462 28479 2173 145.036 284235 279.22 255.89 14.38 240430 130.47 2133528 211.06 174.977 1614.07 0.541430 9.3103 5.89 374.17 65.9 2.29708 29165 14.424 0.496776 7048 55344.32 8.02 1824 96.30 234371 1145.18 1992.23 72.0972 146692 18727.61 1357.10 0.9368 192.9917 55875.18 34779 144.29 8633 1779 7245 252372.29 50609.276 3.6 4.95 0.48 7.85 26.52 16990.75 115.59 2433807.14 1130454.03 OpenBenchmarking.org