Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks

Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2212171-PTS-XEONGOLD08
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Linux 5.10.130
December 14 2022
  1 Day, 44 Minutes
Linux 5.15.83
December 15 2022
  1 Day, 1 Hour, 38 Minutes
Linux 6.1
December 16 2022
  1 Day, 2 Hours, 3 Minutes
Invert Behavior (Only Show Selected Data)
  1 Day, 1 Hour, 28 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Linux 5.10.130

Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210

OS: Ubuntu 20.10, Kernel: 5.10.130-0510130-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Linux 5.15.83

OS: Ubuntu 20.10, Kernel: 5.15.83-051583-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Linux 6.1

OS: Ubuntu 20.10, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Xeon Gold Cascade Lake Refresh LTS Linux BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads)Supermicro X11SPL-F v1.02 (3.1 BIOS)Intel Sky Lake-E DMI3 Registers192GB280GB INTEL SSDPED1D280GAASPEEDVE2282 x Intel I210Ubuntu 20.105.10.130-0510130-generic (x86_64)5.15.83-051583-generic (x86_64)6.1.0-phx (x86_64)GNOME Shell 3.38.1X Server 1.20.9GCC 10.3.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelsDesktopDisplay ServerCompilerFile-SystemScreen ResolutionXeon Gold Cascade Lake Refresh LTS Linux Benchmarks PerformanceSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102- Python 3.8.10- Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Linux 5.10.130Linux 5.15.83Linux 6.1Result OverviewPhoronix Test Suite100%107%115%122%130%ctx_clockDragonflydbJPEG XL Decoding libjxlEnCodecPostgreSQLGraphicsMagickC-BloscStress-NGAOM AV1JPEG XL libjxlFacebook RocksDBTimed Linux Kernel CompilationStargate Digital Audio WorkstationspaCyClickHouseTimed Erlang/OTP CompilationTimed Godot Game Engine Compilationlibavif avifencMobile Neural NetworkTimed Node.js CompilationFLAC Audio EncodingTimed PHP CompilationminiBUDETimed CPython Compilation7-Zip CompressionNCNNBRL-CADNeural Magic DeepSparsesrsRANSVT-AV1nekRSOpenVINOY-CruncherXmrigCpuminer-OptWebP Image EncodeOpenRadiossLAMMPS Molecular Dynamics SimulatorTensorFlowNumenta Anomaly BenchmarkBlenderoneDNNASTC EncoderPrimesieveAircrack-ngNatronOSPRay StudioOpenFOAM

Xeon Gold Cascade Lake Refresh LTS Linux Benchmarksminibude: OpenMP - BM1minibude: OpenMP - BM2stress-ng: MMAPstress-ng: NUMAstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: x86_64 RdRandstress-ng: Memory Copyingstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUnatron: Spaceshipaom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pminibude: OpenMP - BM1minibude: OpenMP - BM2xmrig: Monero - 1Mxmrig: Wownero - 1Mtensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 64 - AlexNettensorflow: CPU - 256 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamgraphics-magick: Swirlgraphics-magick: Rotategraphics-magick: Sharpengraphics-magick: Enhancedgraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spaceaircrack-ng: cpuminer-opt: Magicpuminer-opt: x25xcpuminer-opt: scryptcpuminer-opt: Deepcoincpuminer-opt: Ringcoincpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: Myriad-Groestlcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Triple SHA-256, Onecoinblosc: blosclz shuffleblosc: blosclz bitshufflecompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingjpegxl: PNG - 80jpegxl: PNG - 90jpegxl: JPEG - 80jpegxl: JPEG - 90jpegxl: PNG - 100jpegxl: JPEG - 100jpegxl-decode: 1jpegxl-decode: Allwebp: Defaultwebp: Quality 100webp: Quality 100, Losslesswebp: Quality 100, Highest Compressionwebp: Quality 100, Lossless, Highest Compressionastcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustivelammps: 20k Atomslammps: Rhodopsin Proteinrocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randdragonflydb: 50 - 1:1dragonflydb: 50 - 1:5dragonflydb: 50 - 5:1dragonflydb: 200 - 1:1dragonflydb: 200 - 1:5dragonflydb: 200 - 5:1clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, Third Runstargate: 44100 - 512stargate: 96000 - 512stargate: 192000 - 512stargate: 44100 - 1024stargate: 480000 - 512stargate: 96000 - 1024stargate: 192000 - 1024stargate: 480000 - 1024srsran: OFDM_Testspacy: en_core_web_lgspacy: en_core_web_trfpgbench: 100 - 100 - Read Onlypgbench: 100 - 250 - Read Onlypgbench: 100 - 500 - Read Onlypgbench: 100 - 100 - Read Writepgbench: 100 - 250 - Read Writepgbench: 100 - 500 - Read Writesrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMbrl-cad: VGR Performance Metricctx-clock: Context Switch Timeonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 2 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 2 - 1080p - 16 - Path Tracerospray-studio: 2 - 1080p - 32 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerpgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 500 - Read Write - Average Latencymnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeravifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compilebuild-php: Time To Compilebuild-python: Defaultbuild-python: Released Build, PGO + LTO Optimizedprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Mbuild-erlang: Time To Compileencode-flac: WAV To FLACblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyencodec: 3 kbpsencodec: 6 kbpsencodec: 24 kbpsencodec: 1.5 kbpsnumenta-nab: KNN CADnumenta-nab: Relative Entropynumenta-nab: Windowed Gaussiannumenta-nab: Earthgecko Skylinenumenta-nab: Bayesian Changepointnumenta-nab: Contextual Anomaly Detector OSELinux 5.10.130Linux 5.15.83Linux 6.121.21121.389390.20358.051498828.701008.628606774.99223731.7018742.6722392194.2856719.5136489.15241610.68116.3334273.523214994.8355915.3655351.58252390.564201.0210160.915500706.76911917.94194.366490812.35279.8279.8303.4307.098.6706497666675.883.313.25272.0919.11969.33625.5064.821991.75485.3615259.8631167.813.611.7037.8848.0548.342.47534.519126.497120.7947.04695.493415.136423.649530.266534.7386794.59492.2166.55211.25243.30278.63114.4137.68121.7240.23125.7941.90130.2143.5010.52109.599655.423343.761286.656775.2616219.3569132.6485108.547573.603955.543338.443810.54039.6153502757199315133333597650605.559374.94640.06491.90144972833.0911491036572.81135103173639682021883031591315238.110158.9106357864327.707.587.457.300.540.5338.17208.7914.379.001.273.070.48193.131572.15959.32250.937110.42710.65998319965094239625695120425521646431008992132608978963.311047699.23989148.97971725.251021149.38918617.37205.76212.60212.423.9095522.5378911.5362554.3858933.7269332.9996111.8892684.199568122000000113142446465422413949370238536564767638503117.3123.3126.9131.065.91677711542.296363.101440.4966131.252714.291534.706993.306064.158690.5406540.8514551613.12909.6321621.84911.8160.9563990.3132387055724286331214672342161244282399351465832846991778182621782840965271291726682334786780160.2150.6041.3501.8645.24412.98614.9102.0912.59210.1484.8923.8552.67822.73314.545.564.955.664.917.062.3811.5726.958.095.4614.2023.6017.1318.83160.277.021357.372400.022436.3029.37417.718.2425.53123.348.0216.471.040.50758.0277104.1622144.241022.839692.214213.268936.43907.526573.675913.5771144.006226.0011752.8319103.996038.53511188.28208241.485511598.6991152.4196.21256.43159.75443.72145.01270.5176.68911.3766.63797.24670.169907.748453.61365.32519.449383.51414.443174.72224.44911.34591.56021.110106.13318.28144.251145.90373.7429.14129.49534.16228.208185.33015.8039.070114.81341.39255.73421.17021.317381.23335.582364278.75879.679013626.15225144.3318733.1020930090.9660087.3632758.89285766.99128.3134238.773314461.3855890.2355415.01252393.884129.3417786.172284154.16916397.13194.888257907.06282.7282.0310.0307.998.6709236333335.883.303.25272.8019.15957.08623.3664.281993.58485.1915258.5631007.383.611.7737.8647.6648.332.48334.818127.534122.9786.98595.043418.022425.263529.240532.9246829.89531.3166.90211.47242.73279.05115.1538.09122.1840.41126.2942.05130.4043.4110.45399.614155.584942.901386.940275.0401219.0088134.1326108.337772.055254.433237.760210.43399.6111499731199314132133195750607.738373.55641.61489.83145002812.3411505836594.18134833176109666321849331391715998.610555.7108058867357.717.547.407.250.540.5337.90209.1814.409.021.283.090.48193.024472.12199.32670.937510.41410.639982848652336496166261193837234969304327921293591123953.551186278.251068662.911060251.051117321.90993337.90204.26209.58215.023.9725912.5790451.5670494.4310983.7903213.0635111.9896804.270897122633333112362416515273475175426428562304592233824118.3123.9128.0131.666.01668521792.293853.085610.4972481.251744.311784.708343.296334.203430.5404520.8465431611.14912.0661614.87908.1880.9616820.3160057046724686281214862341421245562403111465702848531778182621762841765242292066681734801779970.1940.5261.1731.7795.44414.78314.8802.0712.5379.8504.8973.7522.63922.43814.715.534.955.594.856.992.2911.4627.698.055.4814.2123.8916.8518.67161.236.911356.352401.742441.6729.29416.958.3425.62124.348.0116.461.030.5759.3525104.0054143.806523.313991.986013.308936.49737.440873.821613.8679146.950526.4774760.8374104.037638.235781186.39843242.254871611.5943151.8296.31256.19159.15445.17144.70971.0656.74911.4256.66697.56870.488911.083453.30765.14319.493383.96214.429174.65824.56211.36691.75421.098106.38317.07144.341144.82373.5428.66029.53033.91728.349182.65715.8139.018115.52941.43355.65921.42221.552310.22256.612433807.14667.827375258.06225639.3218727.6115989079.7753632.6732918.80284966.04115.5934059.433315660.8855875.1855344.32252372.294181.8016990.752054658.64916843.52194.3014896082.79280.2280.3307.4305.598.3704815000005.893.283.23267.6219.17957.41620.6163.961992.23491.2415144.3230632.463.611.6536.1045.4145.972.46034.723126.763121.5967.02495.151409.127419.750535.565538.7906767.39527.7166.31211.06242.34279.22116.1638.01123.1940.32126.4942.06130.4743.3710.40979.539355.436643.320286.883275.2635218.6936132.5077108.744371.885254.272637.211510.38329.6532491668197311129932287250609.276373.45638.64491.85144202800.6211375506571.66134320174779601021723731572315256.110161.3106968866807.367.207.086.940.530.5236.37181.5414.388.951.273.080.48192.991772.09729.31030.936810.39910.608935285653371755944851134991218454298539221335281130454.031180450.091074996.431046604.151099078.40979549.43198.51204.43212.923.8172682.4971641.5200404.3113823.7188123.0125851.9288144.208880120733333112312341523788487468467167543654522336109117.1123.3127.2130.365.91683342002.297083.094330.4967761.248714.286184.980673.312444.180960.5414300.8318661614.07909.1471618.86913.9430.9634000.3139757048724586331230002343711263412404301466922842351779182421732847965894291656783734779798040.1910.5131.0701.8395.52813.84715.1222.0832.6069.9324.9693.8312.64022.78914.455.574.955.634.897.042.3611.4826.527.855.4613.8323.3516.7618.70160.396.961357.102415.312451.1029.86416.168.3325.73124.978.0216.271.040.51764.7425104.8348144.211423.071892.046213.269136.53927.535973.545613.9013147.380426.8656763.3064103.582338.361993186.93467242.923071607.4012153.2396.30255.89160.27446.66145.03671.2016.79811.5806.90999.42072.558934.265459.75365.96419.777385.514.424174.97724.45511.29493.73921.376106.46318.71144.291145.18374.1730.42632.01736.32130.493180.51915.5259.073115.83141.93655.815OpenBenchmarking.org

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 5.15.83Linux 5.10.130Linux 6.1510152025SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 321.1721.2121.421. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 5.15.83Linux 5.10.130Linux 6.1510152025SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 321.3221.3921.551. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 6.1Linux 5.15.83Linux 5.10.13080160240320400SE +/- 2.76, N = 3SE +/- 0.56, N = 3SE +/- 0.74, N = 3310.22381.23390.201. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 6.1Linux 5.15.83Linux 5.10.13080160240320400SE +/- 1.78, N = 3SE +/- 0.90, N = 3SE +/- 2.82, N = 3256.61335.58358.051. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: FutexLinux 5.10.130Linux 5.15.83Linux 6.1500K1000K1500K2000K2500KSE +/- 33488.35, N = 15SE +/- 32600.02, N = 3SE +/- 9882.04, N = 31498828.702364278.752433807.141. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDLinux 6.1Linux 5.15.83Linux 5.10.1302004006008001000SE +/- 0.28, N = 3SE +/- 0.39, N = 3SE +/- 0.88, N = 3667.82879.671008.621. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 6.1Linux 5.10.130Linux 5.15.832M4M6M8M10MSE +/- 24065.62, N = 3SE +/- 10182.54, N = 3SE +/- 112044.15, N = 157375258.068606774.999013626.151. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: AtomicLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 1447.49, N = 3SE +/- 1620.65, N = 3SE +/- 3644.44, N = 3223731.70225144.33225639.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CryptoLinux 6.1Linux 5.15.83Linux 5.10.1304K8K12K16K20KSE +/- 66.53, N = 3SE +/- 83.58, N = 3SE +/- 47.41, N = 318727.6118733.1018742.671. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MallocLinux 6.1Linux 5.15.83Linux 5.10.1305M10M15M20M25MSE +/- 91731.80, N = 3SE +/- 130302.14, N = 3SE +/- 90978.10, N = 315989079.7720930090.9622392194.281. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: ForkingLinux 6.1Linux 5.10.130Linux 5.15.8313K26K39K52K65KSE +/- 386.64, N = 3SE +/- 175.99, N = 3SE +/- 184.20, N = 353632.6756719.5160087.361. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 5.15.83Linux 6.1Linux 5.10.1308K16K24K32K40KSE +/- 501.84, N = 3SE +/- 240.39, N = 3SE +/- 401.23, N = 332758.8932918.8036489.151. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILELinux 5.10.130Linux 6.1Linux 5.15.8360K120K180K240K300KSE +/- 2449.06, N = 3SE +/- 1947.11, N = 3SE +/- 2143.98, N = 3241610.68284966.04285766.991. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU CacheLinux 6.1Linux 5.10.130Linux 5.15.83306090120150SE +/- 2.00, N = 15SE +/- 2.89, N = 15SE +/- 6.07, N = 12115.59116.33128.311. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU StressLinux 6.1Linux 5.15.83Linux 5.10.1307K14K21K28K35KSE +/- 27.28, N = 3SE +/- 3.47, N = 3SE +/- 248.24, N = 1434059.4334238.7734273.521. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 159.78, N = 3SE +/- 1860.75, N = 3SE +/- 1806.60, N = 33214994.833314461.383315660.881. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix MathLinux 6.1Linux 5.15.83Linux 5.10.13012K24K36K48K60KSE +/- 647.24, N = 3SE +/- 503.37, N = 3SE +/- 476.25, N = 355875.1855890.2355915.361. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector MathLinux 6.1Linux 5.10.130Linux 5.15.8312K24K36K48K60KSE +/- 321.30, N = 3SE +/- 337.57, N = 3SE +/- 330.15, N = 355344.3255351.5855415.011. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux 6.1Linux 5.10.130Linux 5.15.8350K100K150K200K250KSE +/- 12.63, N = 3SE +/- 0.71, N = 3SE +/- 1.57, N = 3252372.29252390.56252393.881. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory CopyingLinux 5.15.83Linux 6.1Linux 5.10.1309001800270036004500SE +/- 42.48, N = 3SE +/- 29.72, N = 3SE +/- 31.35, N = 34129.344181.804201.021. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket ActivityLinux 5.10.130Linux 6.1Linux 5.15.834K8K12K16K20KSE +/- 302.66, N = 15SE +/- 112.51, N = 3SE +/- 80.02, N = 310160.9116990.7517786.171. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 6.1Linux 5.15.83Linux 5.10.1301.2M2.4M3.6M4.8M6MSE +/- 3492.53, N = 3SE +/- 7040.94, N = 3SE +/- 72191.04, N = 32054658.642284154.165500706.761. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String FunctionsLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 6508.49, N = 3SE +/- 3709.52, N = 3SE +/- 8664.27, N = 3911917.94916397.13916843.521. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data SortingLinux 6.1Linux 5.10.130Linux 5.15.834080120160200SE +/- 1.25, N = 3SE +/- 1.58, N = 3SE +/- 1.18, N = 3194.30194.36194.881. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message PassingLinux 5.10.130Linux 5.15.83Linux 6.13M6M9M12M15MSE +/- 23387.52, N = 3SE +/- 4399.60, N = 3SE +/- 26770.64, N = 36490812.358257907.0614896082.791. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

srsRAN

srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.10.130Linux 6.1Linux 5.15.8360120180240300SE +/- 0.15, N = 3SE +/- 0.27, N = 3SE +/- 0.17, N = 3279.8280.2282.71. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.10.130Linux 6.1Linux 5.15.8360120180240300SE +/- 0.30, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3279.8280.3282.01. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.10.130Linux 6.1Linux 5.15.8370140210280350SE +/- 1.79, N = 3SE +/- 0.35, N = 3SE +/- 0.22, N = 3303.4307.4310.01. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 6.1Linux 5.10.130Linux 5.15.8370140210280350SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.15, N = 3305.5307.0307.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.15, N = 3SE +/- 0.35, N = 3SE +/- 0.10, N = 398.398.698.61. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicLinux 6.1Linux 5.10.130Linux 5.15.8315000M30000M45000M60000M75000MSE +/- 48731133.10, N = 3SE +/- 144216808.24, N = 3SE +/- 219477639.96, N = 37048150000070649766667709236333331. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -pthread -lmpi_cxx -lmpi

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11.32532.65063.97595.30126.6265SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 35.885.885.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.74481.48962.23442.97923.724SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.283.303.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.830.73131.46262.19392.92523.6565SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.233.253.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.8360120180240300SE +/- 1.20, N = 3SE +/- 1.08, N = 3SE +/- 0.06, N = 3267.62272.09272.801. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 319.1119.1519.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.15.83Linux 6.1Linux 5.10.1302004006008001000SE +/- 1.74, N = 3SE +/- 0.69, N = 3SE +/- 5.71, N = 3957.08957.41969.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.130140280420560700SE +/- 1.31, N = 3SE +/- 0.90, N = 3SE +/- 0.68, N = 3620.61623.36625.501. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1301428425670SE +/- 0.40, N = 3SE +/- 0.24, N = 3SE +/- 0.70, N = 363.9664.2864.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 6.1Linux 5.15.83400800120016002000SE +/- 1.36, N = 3SE +/- 1.06, N = 3SE +/- 0.98, N = 31991.751992.231993.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.1110220330440550SE +/- 4.62, N = 3SE +/- 4.00, N = 13SE +/- 4.29, N = 11485.19485.36491.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1303K6K9K12K15KSE +/- 96.54, N = 3SE +/- 108.60, N = 3SE +/- 110.56, N = 315144.3215258.5615259.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1307K14K21K28K35KSE +/- 16.23, N = 3SE +/- 38.88, N = 3SE +/- 85.59, N = 330632.4631007.3831167.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Natron

Natron is an open-source, cross-platform compositing software for visual effects (VFX) and motion graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipLinux 5.10.130Linux 5.15.83Linux 6.10.811.622.433.244.05SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.63.63.6

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 311.6511.7011.771. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KLinux 6.1Linux 5.15.83Linux 5.10.130918273645SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 336.1037.8637.881. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KLinux 6.1Linux 5.15.83Linux 5.10.1301122334455SE +/- 0.11, N = 3SE +/- 0.14, N = 3SE +/- 0.06, N = 345.4147.6648.051. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4KLinux 6.1Linux 5.15.83Linux 5.10.1301122334455SE +/- 0.14, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 345.9748.3348.341. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 6.1Linux 5.10.130Linux 5.15.830.55871.11741.67612.23482.7935SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.005, N = 32.4602.4752.4831. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 5.10.130Linux 6.1Linux 5.15.83816243240SE +/- 0.07, N = 3SE +/- 0.20, N = 3SE +/- 0.15, N = 334.5234.7234.821. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 5.10.130Linux 6.1Linux 5.15.83306090120150SE +/- 0.46, N = 3SE +/- 0.29, N = 3SE +/- 0.62, N = 3126.50126.76127.531. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 5.10.130Linux 6.1Linux 5.15.83306090120150SE +/- 0.69, N = 3SE +/- 0.62, N = 3SE +/- 0.32, N = 3120.79121.60122.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 5.15.83Linux 6.1Linux 5.10.130246810SE +/- 0.016, N = 3SE +/- 0.044, N = 3SE +/- 0.057, N = 36.9857.0247.0461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pLinux 5.15.83Linux 6.1Linux 5.10.13020406080100SE +/- 0.30, N = 3SE +/- 0.46, N = 3SE +/- 0.40, N = 395.0495.1595.491. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pLinux 6.1Linux 5.10.130Linux 5.15.8390180270360450SE +/- 2.62, N = 3SE +/- 0.88, N = 3SE +/- 0.85, N = 3409.13415.14418.021. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pLinux 6.1Linux 5.10.130Linux 5.15.8390180270360450SE +/- 1.64, N = 3SE +/- 0.82, N = 3SE +/- 1.29, N = 3419.75423.65425.261. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 5.15.83Linux 5.10.130Linux 6.1120240360480600SE +/- 0.39, N = 3SE +/- 0.13, N = 3SE +/- 0.30, N = 3529.24530.27535.571. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 5.15.83Linux 5.10.130Linux 6.1120240360480600SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3532.92534.74538.791. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmlrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MLinux 6.1Linux 5.10.130Linux 5.15.8315003000450060007500SE +/- 54.19, N = 3SE +/- 3.14, N = 3SE +/- 23.74, N = 36767.36794.56829.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MLinux 5.10.130Linux 6.1Linux 5.15.832K4K6K8K10KSE +/- 67.20, N = 3SE +/- 49.24, N = 3SE +/- 34.41, N = 39492.29527.79531.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetLinux 6.1Linux 5.10.130Linux 5.15.834080120160200SE +/- 0.22, N = 3SE +/- 0.44, N = 3SE +/- 0.13, N = 3166.31166.55166.90

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetLinux 6.1Linux 5.10.130Linux 5.15.8350100150200250SE +/- 0.28, N = 3SE +/- 0.47, N = 3SE +/- 0.13, N = 3211.06211.25211.47

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetLinux 6.1Linux 5.15.83Linux 5.10.13050100150200250SE +/- 0.27, N = 3SE +/- 0.39, N = 3SE +/- 0.06, N = 3242.34242.73243.30

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.53, N = 3SE +/- 0.66, N = 3SE +/- 0.40, N = 3278.63279.05279.22

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3114.41115.15116.16

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 5.10.130Linux 6.1Linux 5.15.83918273645SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 337.6838.0138.09

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3121.72122.18123.19

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 5.10.130Linux 6.1Linux 5.15.83918273645SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 340.2340.3240.41

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3125.79126.29126.49

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 341.9042.0542.06

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3130.21130.40130.47

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 6.1Linux 5.15.83Linux 5.10.1301020304050SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 343.3743.4143.50

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.1303691215SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 310.4110.4510.52

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.0848, N = 3SE +/- 0.0301, N = 3SE +/- 0.0357, N = 39.53939.59969.6141

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 6.1Linux 5.15.831224364860SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 355.4255.4455.58

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 6.1Linux 5.10.1301020304050SE +/- 0.47, N = 7SE +/- 0.21, N = 3SE +/- 0.26, N = 342.9043.3243.76

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 6.1Linux 5.15.8320406080100SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 386.6686.8886.94

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.120406080100SE +/- 0.14, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 375.0475.2675.26

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.13050100150200250SE +/- 0.45, N = 3SE +/- 0.45, N = 3SE +/- 0.10, N = 3218.69219.01219.36

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.83306090120150SE +/- 2.16, N = 3SE +/- 1.67, N = 3SE +/- 0.54, N = 3132.51132.65134.13

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 5.10.130Linux 6.120406080100SE +/- 0.53, N = 3SE +/- 0.05, N = 3SE +/- 0.47, N = 3108.34108.55108.74

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.15.83Linux 5.10.1301632486480SE +/- 0.51, N = 3SE +/- 0.33, N = 3SE +/- 0.65, N = 371.8972.0673.60

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.1301224364860SE +/- 0.16, N = 3SE +/- 0.27, N = 3SE +/- 0.12, N = 354.2754.4355.54

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.15.83Linux 5.10.130918273645SE +/- 0.31, N = 3SE +/- 0.41, N = 3SE +/- 0.15, N = 337.2137.7638.44

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.1303691215SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 310.3810.4310.54

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.0282, N = 3SE +/- 0.0549, N = 3SE +/- 0.0209, N = 39.61119.61539.6532

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlLinux 6.1Linux 5.15.83Linux 5.10.130110220330440550SE +/- 1.53, N = 3SE +/- 1.53, N = 3SE +/- 2.40, N = 34914995021. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateLinux 6.1Linux 5.15.83Linux 5.10.130160320480640800SE +/- 5.43, N = 15SE +/- 1.76, N = 3SE +/- 9.97, N = 56687317571. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenLinux 6.1Linux 5.10.130Linux 5.15.834080120160200SE +/- 1.33, N = 3SE +/- 1.33, N = 3SE +/- 1.20, N = 31971991991. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedLinux 6.1Linux 5.15.83Linux 5.10.13070140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 33113143151. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingLinux 6.1Linux 5.15.83Linux 5.10.13030060090012001500SE +/- 2.91, N = 3SE +/- 2.73, N = 3SE +/- 7.42, N = 31299132113331. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianLinux 6.1Linux 5.15.83Linux 5.10.13070140210280350SE +/- 1.76, N = 33223313351. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceLinux 6.1Linux 5.15.83Linux 5.10.1302004006008001000SE +/- 1.67, N = 3SE +/- 1.53, N = 38729579761. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Linux 5.10.130Linux 5.15.83Linux 6.111K22K33K44K55KSE +/- 129.98, N = 3SE +/- 118.77, N = 3SE +/- 144.43, N = 350605.5650607.7450609.281. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -lbsd -pthread

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiLinux 6.1Linux 5.15.83Linux 5.10.13080160240320400SE +/- 4.81, N = 3SE +/- 4.11, N = 3SE +/- 4.81, N = 3373.45373.55374.941. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xLinux 6.1Linux 5.10.130Linux 5.15.83140280420560700SE +/- 0.34, N = 3SE +/- 0.20, N = 3SE +/- 1.51, N = 3638.64640.06641.611. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptLinux 5.15.83Linux 6.1Linux 5.10.130110220330440550SE +/- 5.31, N = 3SE +/- 2.46, N = 3SE +/- 3.92, N = 3489.83491.85491.901. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinLinux 6.1Linux 5.10.130Linux 5.15.833K6K9K12K15KSE +/- 46.67, N = 3SE +/- 50.00, N = 31442014497145001. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: RingcoinLinux 6.1Linux 5.15.83Linux 5.10.1306001200180024003000SE +/- 1.62, N = 3SE +/- 0.80, N = 3SE +/- 27.91, N = 32800.622812.342833.091. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SLinux 6.1Linux 5.10.130Linux 5.15.83200K400K600K800K1000KSE +/- 3289.87, N = 3SE +/- 6874.21, N = 3SE +/- 10686.26, N = 31137550114910311505831. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinLinux 6.1Linux 5.10.130Linux 5.15.8314002800420056007000SE +/- 2.16, N = 3SE +/- 2.21, N = 3SE +/- 11.67, N = 36571.666572.816594.181. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinLinux 6.1Linux 5.15.83Linux 5.10.13030K60K90K120K150KSE +/- 283.78, N = 3SE +/- 3.33, N = 3SE +/- 169.54, N = 31343201348331351031. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlLinux 5.10.130Linux 6.1Linux 5.15.834K8K12K16K20KSE +/- 286.72, N = 3SE +/- 135.32, N = 3SE +/- 185.02, N = 31736317477176101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsLinux 6.1Linux 5.15.83Linux 5.10.13020K40K60K80K100KSE +/- 615.39, N = 3SE +/- 167.46, N = 3SE +/- 656.84, N = 39601096663968201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteLinux 6.1Linux 5.15.83Linux 5.10.13050K100K150K200K250KSE +/- 258.61, N = 3SE +/- 6.67, N = 3SE +/- 820.33, N = 32172372184932188301. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinLinux 5.15.83Linux 6.1Linux 5.10.13070K140K210K280K350KSE +/- 661.12, N = 3SE +/- 2222.66, N = 3SE +/- 2642.36, N = 33139173157233159131. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

C-Blosc

C-Blosc (c-blosc2) simple, compressed, fast and persistent data store library for C. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleLinux 5.10.130Linux 6.1Linux 5.15.833K6K9K12K15KSE +/- 62.87, N = 3SE +/- 27.75, N = 3SE +/- 51.78, N = 315238.115256.115998.61. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleLinux 5.10.130Linux 6.1Linux 5.15.832K4K6K8K10KSE +/- 20.30, N = 3SE +/- 25.18, N = 3SE +/- 12.20, N = 310158.910161.310555.71. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingLinux 5.10.130Linux 6.1Linux 5.15.8320K40K60K80K100KSE +/- 95.64, N = 3SE +/- 526.57, N = 3SE +/- 364.72, N = 31063571069681080581. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingLinux 5.10.130Linux 6.1Linux 5.15.8320K40K60K80K100KSE +/- 259.98, N = 3SE +/- 264.89, N = 3SE +/- 150.80, N = 38643286680867351. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

JPEG XL libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Linux 6.1Linux 5.10.130Linux 5.15.83246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.367.707.711. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Linux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 37.207.547.581. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Linux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.087.407.451. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Linux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.947.257.301. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Linux 6.1Linux 5.10.130Linux 5.15.830.12150.2430.36450.4860.6075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.530.540.541. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Linux 6.1Linux 5.10.130Linux 5.15.830.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.520.530.531. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL Decoding libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is suited for JPEG XL decode performance testing to PNG output file, the pts/jpexl test is for encode performance. The JPEG XL encoding/decoding is done using the libjxl codebase. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Linux 6.1Linux 5.15.83Linux 5.10.130918273645SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 336.3737.9038.17

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllLinux 6.1Linux 5.10.130Linux 5.15.8350100150200250SE +/- 2.09, N = 3SE +/- 1.38, N = 3SE +/- 0.37, N = 3181.54208.79209.18

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: DefaultLinux 5.10.130Linux 6.1Linux 5.15.8348121620SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 314.3714.3814.401. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Linux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 38.959.009.021. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, LosslessLinux 5.10.130Linux 6.1Linux 5.15.830.2880.5760.8641.1521.44SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.271.271.281. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionLinux 5.10.130Linux 6.1Linux 5.15.830.69531.39062.08592.78123.4765SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.073.083.091. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionLinux 5.10.130Linux 5.15.83Linux 6.10.1080.2160.3240.4320.54SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastLinux 6.1Linux 5.15.83Linux 5.10.1304080120160200SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3192.99193.02193.131. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumLinux 6.1Linux 5.15.83Linux 5.10.1301632486480SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 372.1072.1272.161. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.0088, N = 3SE +/- 0.0023, N = 3SE +/- 0.0055, N = 39.31039.32259.32671. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveLinux 6.1Linux 5.10.130Linux 5.15.830.21090.42180.63270.84361.0545SE +/- 0.0006, N = 3SE +/- 0.0001, N = 3SE +/- 0.0001, N = 30.93680.93710.93751. (CXX) g++ options: -O3 -flto -pthread

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsLinux 6.1Linux 5.15.83Linux 5.10.1303691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.4010.4110.431. (CXX) g++ options: -O3 -pthread -lm -ldl

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinLinux 6.1Linux 5.15.83Linux 5.10.1303691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 310.6110.6410.661. (CXX) g++ options: -O3 -pthread -lm -ldl

Facebook RocksDB

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random FillLinux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 2558.50, N = 3SE +/- 11892.65, N = 3SE +/- 10947.16, N = 39352859828489831991. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random ReadLinux 5.10.130Linux 5.15.83Linux 6.114M28M42M56M70MSE +/- 547664.44, N = 3SE +/- 139131.71, N = 3SE +/- 360247.64, N = 36509423965233649653371751. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Update RandomLinux 6.1Linux 5.15.83Linux 5.10.130130K260K390K520K650KSE +/- 2022.46, N = 3SE +/- 1069.98, N = 3SE +/- 3662.51, N = 35944856166266256951. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Sequential FillLinux 6.1Linux 5.15.83Linux 5.10.130300K600K900K1200K1500KSE +/- 11595.14, N = 3SE +/- 3547.16, N = 3SE +/- 10501.31, N = 31134991119383712042551. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fill SyncLinux 5.10.130Linux 6.1Linux 5.15.8350K100K150K200K250KSE +/- 254.19, N = 3SE +/- 160.74, N = 3SE +/- 684.45, N = 32164642184542349691. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read While WritingLinux 6.1Linux 5.15.83Linux 5.10.130700K1400K2100K2800K3500KSE +/- 14227.22, N = 3SE +/- 29968.88, N = 3SE +/- 49813.03, N = 32985392304327931008991. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read Random Write RandomLinux 5.15.83Linux 5.10.130Linux 6.1500K1000K1500K2000K2500KSE +/- 8919.50, N = 3SE +/- 16550.67, N = 3SE +/- 10651.17, N = 32129359213260821335281. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 19609.96, N = 13SE +/- 643.98, N = 3SE +/- 1471.72, N = 3978963.311123953.551130454.031. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5Linux 5.10.130Linux 6.1Linux 5.15.83300K600K900K1200K1500KSE +/- 872.80, N = 3SE +/- 1580.99, N = 3SE +/- 1515.54, N = 31047699.231180450.091186278.251. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1Linux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 8046.26, N = 3SE +/- 3987.52, N = 3SE +/- 741.75, N = 3989148.971068662.911074996.431. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:1Linux 5.10.130Linux 6.1Linux 5.15.83200K400K600K800K1000KSE +/- 1890.11, N = 3SE +/- 6338.63, N = 3SE +/- 1111.75, N = 3971725.251046604.151060251.051. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 5.10.130Linux 6.1Linux 5.15.83200K400K600K800K1000KSE +/- 515.57, N = 3SE +/- 797.47, N = 3SE +/- 3993.93, N = 31021149.381099078.401117321.901. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 5.10.130Linux 6.1Linux 5.15.83200K400K600K800K1000KSE +/- 4444.49, N = 3SE +/- 1905.52, N = 3SE +/- 845.72, N = 3918617.37979549.43993337.901. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheLinux 6.1Linux 5.15.83Linux 5.10.13050100150200250SE +/- 0.88, N = 3SE +/- 1.58, N = 14SE +/- 1.55, N = 15198.51204.26205.76MIN: 22.14 / MAX: 20000MIN: 22.52 / MAX: 20000MIN: 22.01 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunLinux 6.1Linux 5.15.83Linux 5.10.13050100150200250SE +/- 4.28, N = 3SE +/- 1.25, N = 14SE +/- 0.88, N = 15204.43209.58212.60MIN: 22.33 / MAX: 20000MIN: 22.65 / MAX: 20000MIN: 22.96 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunLinux 5.10.130Linux 6.1Linux 5.15.8350100150200250SE +/- 1.01, N = 15SE +/- 1.08, N = 3SE +/- 0.78, N = 14212.42212.92215.02MIN: 22.81 / MAX: 20000MIN: 22.26 / MAX: 20000MIN: 22.68 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Linux 6.1Linux 5.10.130Linux 5.15.830.89381.78762.68143.57524.469SE +/- 0.063340, N = 3SE +/- 0.028488, N = 3SE +/- 0.017996, N = 33.8172683.9095523.9725911. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Linux 6.1Linux 5.10.130Linux 5.15.830.58031.16061.74092.32122.9015SE +/- 0.031971, N = 3SE +/- 0.035214, N = 3SE +/- 0.013088, N = 32.4971642.5378912.5790451. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Linux 6.1Linux 5.10.130Linux 5.15.830.35260.70521.05781.41041.763SE +/- 0.006196, N = 3SE +/- 0.008212, N = 3SE +/- 0.017482, N = 31.5200401.5362551.5670491. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Linux 6.1Linux 5.10.130Linux 5.15.830.9971.9942.9913.9884.985SE +/- 0.047576, N = 3SE +/- 0.002245, N = 3SE +/- 0.011431, N = 34.3113824.3858934.4310981. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Linux 6.1Linux 5.10.130Linux 5.15.830.85281.70562.55843.41124.264SE +/- 0.044488, N = 3SE +/- 0.019070, N = 3SE +/- 0.052597, N = 33.7188123.7269333.7903211. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Linux 5.10.130Linux 6.1Linux 5.15.830.68931.37862.06792.75723.4465SE +/- 0.016716, N = 3SE +/- 0.021684, N = 3SE +/- 0.004654, N = 32.9996113.0125853.0635111. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Linux 5.10.130Linux 6.1Linux 5.15.830.44770.89541.34311.79082.2385SE +/- 0.016352, N = 3SE +/- 0.012895, N = 3SE +/- 0.011134, N = 31.8892681.9288141.9896801. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Linux 5.10.130Linux 6.1Linux 5.15.830.9611.9222.8833.8444.805SE +/- 0.030220, N = 3SE +/- 0.017869, N = 3SE +/- 0.015411, N = 34.1995684.2088804.2708971. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

srsRAN

srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_TestLinux 6.1Linux 5.10.130Linux 5.15.8330M60M90M120M150MSE +/- 417665.47, N = 3SE +/- 251661.15, N = 3SE +/- 352766.84, N = 31207333331220000001226333331. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

spaCy

The spaCy library is an open-source solution for advanced neural language processing (NLP). The spaCy library leverages Python and is a leading neural language processing solution. This test profile times the spaCy CPU performance with various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgLinux 6.1Linux 5.15.83Linux 5.10.1302K4K6K8K10KSE +/- 18.76, N = 3SE +/- 10.74, N = 3SE +/- 15.62, N = 3112311123611314

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfLinux 6.1Linux 5.15.83Linux 5.10.1305001000150020002500SE +/- 7.51, N = 3SE +/- 6.33, N = 3SE +/- 9.87, N = 3234124162446

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1110K220K330K440K550KSE +/- 1779.96, N = 3SE +/- 92.73, N = 3SE +/- 1990.45, N = 34654225152735237881. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1100K200K300K400K500KSE +/- 2810.03, N = 3SE +/- 286.86, N = 3SE +/- 5532.44, N = 34139494751754874681. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyLinux 5.10.130Linux 5.15.83Linux 6.1100K200K300K400K500KSE +/- 956.06, N = 3SE +/- 666.01, N = 3SE +/- 757.53, N = 33702384264284671671. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteLinux 5.10.130Linux 6.1Linux 5.15.8312K24K36K48K60KSE +/- 146.53, N = 3SE +/- 90.59, N = 3SE +/- 125.21, N = 35365654365562301. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteLinux 6.1Linux 5.15.83Linux 5.10.13010K20K30K40K50KSE +/- 71.67, N = 3SE +/- 31.67, N = 3SE +/- 132.15, N = 34522345922476761. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteLinux 5.15.83Linux 6.1Linux 5.10.1308K16K24K32K40KSE +/- 99.01, N = 3SE +/- 91.02, N = 3SE +/- 59.40, N = 33382436109385031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

srsRAN

srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 6.1Linux 5.10.130Linux 5.15.83306090120150SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.07, N = 3117.1117.3118.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.10.130Linux 6.1Linux 5.15.83306090120150SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3123.3123.3123.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.10.130Linux 6.1Linux 5.15.83306090120150SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.18, N = 3126.9127.2128.01. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 6.1Linux 5.10.130Linux 5.15.83306090120150SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.06, N = 3130.3131.0131.61. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.10.130Linux 6.1Linux 5.15.831530456075SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.15, N = 365.965.966.01. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance MetricLinux 5.15.83Linux 5.10.130Linux 6.140K80K120K160K200K1668521677711683341. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -pthread -ldl -lm

ctx_clock

Ctx_clock is a simple test program to measure the context switch time in clock cycles. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 6.1Linux 5.15.83Linux 5.10.1304080120160200SE +/- 0.67, N = 3200179154

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.830.51681.03361.55042.06722.584SE +/- 0.00145, N = 3SE +/- 0.00305, N = 3SE +/- 0.00109, N = 32.297082.296362.29385MIN: 2.22MIN: 2.22MIN: 2.191. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.69781.39562.09342.79123.489SE +/- 0.00480, N = 3SE +/- 0.00478, N = 3SE +/- 0.01196, N = 33.101443.094333.08561MIN: 3.06MIN: 3.06MIN: 3.051. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.1300.11190.22380.33570.44760.5595SE +/- 0.000206, N = 3SE +/- 0.000335, N = 3SE +/- 0.000232, N = 30.4972480.4967760.496613MIN: 0.48MIN: 0.48MIN: 0.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.28190.56380.84571.12761.4095SE +/- 0.00257, N = 3SE +/- 0.00241, N = 3SE +/- 0.00376, N = 31.252711.251741.24871MIN: 1.22MIN: 1.22MIN: 1.211. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.97021.94042.91063.88084.851SE +/- 0.01348, N = 3SE +/- 0.00912, N = 3SE +/- 0.00632, N = 34.311784.291534.28618MIN: 4.24MIN: 4.25MIN: 4.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPULinux 6.1Linux 5.15.83Linux 5.10.1301.12072.24143.36214.48285.6035SE +/- 0.02580, N = 3SE +/- 0.01367, N = 3SE +/- 0.01724, N = 34.980674.708344.70699MIN: 4.62MIN: 4.4MIN: 4.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.830.74531.49062.23592.98123.7265SE +/- 0.00768, N = 3SE +/- 0.00465, N = 3SE +/- 0.00438, N = 33.312443.306063.29633MIN: 3.26MIN: 3.27MIN: 3.271. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.1300.94581.89162.83743.78324.729SE +/- 0.00929, N = 3SE +/- 0.00677, N = 3SE +/- 0.01257, N = 34.203434.180964.15869MIN: 4.13MIN: 4.13MIN: 4.091. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.830.12180.24360.36540.48720.609SE +/- 0.000200, N = 3SE +/- 0.000704, N = 3SE +/- 0.000263, N = 30.5414300.5406540.540452MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.19160.38320.57480.76640.958SE +/- 0.006451, N = 3SE +/- 0.010105, N = 3SE +/- 0.003867, N = 30.8514550.8465430.831866MIN: 0.83MIN: 0.82MIN: 0.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.8330060090012001500SE +/- 0.44, N = 3SE +/- 0.83, N = 3SE +/- 0.39, N = 31614.071613.121611.14MIN: 1609.86MIN: 1608.28MIN: 1608.251. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.12004006008001000SE +/- 1.01, N = 3SE +/- 2.14, N = 3SE +/- 1.41, N = 3912.07909.63909.15MIN: 908.55MIN: 903.56MIN: 904.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.8330060090012001500SE +/- 2.14, N = 3SE +/- 1.70, N = 3SE +/- 3.87, N = 31621.841618.861614.87MIN: 1617.11MIN: 1614.3MIN: 1607.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.832004006008001000SE +/- 2.67, N = 3SE +/- 1.27, N = 3SE +/- 0.73, N = 3913.94911.82908.19MIN: 907.08MIN: 907.5MIN: 904.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.21680.43360.65040.86721.084SE +/- 0.002932, N = 3SE +/- 0.003629, N = 3SE +/- 0.001517, N = 30.9634000.9616820.956399MIN: 0.93MIN: 0.93MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.1300.07110.14220.21330.28440.3555SE +/- 0.001833, N = 3SE +/- 0.000082, N = 3SE +/- 0.000694, N = 30.3160050.3139750.313238MIN: 0.3MIN: 0.3MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 6.1Linux 5.15.8315003000450060007500SE +/- 10.90, N = 3SE +/- 1.45, N = 37055704870461. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.15.83Linux 6.1Linux 5.10.13016003200480064008000SE +/- 3.79, N = 3SE +/- 2.52, N = 3SE +/- 2.33, N = 37246724572421. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.832K4K6K8K10KSE +/- 9.45, N = 3SE +/- 5.51, N = 38633863386281. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.13030K60K90K120K150KSE +/- 1530.19, N = 5SE +/- 135.52, N = 3SE +/- 26.43, N = 31230001214861214671. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8350K100K150K200K250KSE +/- 262.34, N = 3SE +/- 254.40, N = 3SE +/- 19.15, N = 32343712342162341421. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.13030K60K90K120K150KSE +/- 1877.65, N = 3SE +/- 104.41, N = 3SE +/- 68.75, N = 31263411245561244281. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.13050K100K150K200K250KSE +/- 131.54, N = 3SE +/- 62.00, N = 3SE +/- 103.12, N = 32404302403112399351. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8330K60K90K120K150KSE +/- 27.67, N = 3SE +/- 58.33, N = 3SE +/- 69.67, N = 31466921465831465701. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.160K120K180K240K300KSE +/- 192.14, N = 3SE +/- 239.39, N = 3SE +/- 92.98, N = 32848532846992842351. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.130400800120016002000SE +/- 0.58, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 31779177817781. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.1400800120016002000SE +/- 0.67, N = 3SE +/- 1.15, N = 3SE +/- 1.00, N = 31826182618241. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 0.67, N = 3SE +/- 0.58, N = 32178217621731. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.1306K12K18K24K30KSE +/- 9.70, N = 3SE +/- 21.40, N = 3SE +/- 8.11, N = 32847928417284091. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8314K28K42K56K70KSE +/- 527.74, N = 3SE +/- 37.27, N = 3SE +/- 20.81, N = 36589465271652421. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.16K12K18K24K30KSE +/- 5.24, N = 3SE +/- 28.26, N = 32920629172291651. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8315K30K45K60K75KSE +/- 539.86, N = 14SE +/- 35.09, N = 3SE +/- 44.92, N = 36783766823668171. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.17K14K21K28K35KSE +/- 4.51, N = 3SE +/- 21.06, N = 3SE +/- 5.29, N = 33480134786347791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8320K40K60K80K100KSE +/- 964.72, N = 6SE +/- 96.91, N = 3SE +/- 75.54, N = 37980478016779971. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.04840.09680.14520.19360.242SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.2150.1940.1911. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.13590.27180.40770.54360.6795SE +/- 0.004, N = 3SE +/- 0.000, N = 3SE +/- 0.006, N = 30.6040.5260.5131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.10.30380.60760.91141.21521.519SE +/- 0.003, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 31.3501.1731.0701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 6.1Linux 5.15.830.41940.83881.25821.67762.097SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.004, N = 31.8641.8391.7791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1301.24382.48763.73144.97526.219SE +/- 0.009, N = 3SE +/- 0.004, N = 3SE +/- 0.015, N = 35.5285.4445.2441. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyLinux 5.15.83Linux 6.1Linux 5.10.13048121620SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 314.7813.8512.991. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. This MNN test profile is building the OpenMP / CPU threaded version for processor benchmarking and not any GPU-accelerated test. MNN does allow making use of AVX-512 extensions. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetLinux 6.1Linux 5.10.130Linux 5.15.8348121620SE +/- 0.15, N = 9SE +/- 0.12, N = 3SE +/- 0.10, N = 315.1214.9114.88MIN: 14.55 / MAX: 29.56MIN: 14.46 / MAX: 28.47MIN: 14.51 / MAX: 33.861. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3Linux 5.10.130Linux 6.1Linux 5.15.830.47050.9411.41151.8822.3525SE +/- 0.010, N = 3SE +/- 0.009, N = 9SE +/- 0.009, N = 32.0912.0832.071MIN: 1.99 / MAX: 3.26MIN: 1.98 / MAX: 6.07MIN: 1.99 / MAX: 4.731. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1Linux 6.1Linux 5.10.130Linux 5.15.830.58641.17281.75922.34562.932SE +/- 0.012, N = 9SE +/- 0.020, N = 3SE +/- 0.015, N = 32.6062.5922.537MIN: 2.49 / MAX: 16.46MIN: 2.48 / MAX: 5.22MIN: 2.47 / MAX: 4.141. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50Linux 5.10.130Linux 6.1Linux 5.15.833691215SE +/- 0.099, N = 3SE +/- 0.037, N = 9SE +/- 0.025, N = 310.1489.9329.850MIN: 9.88 / MAX: 23.7MIN: 9.74 / MAX: 23.92MIN: 9.74 / MAX: 31.531. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Linux 6.1Linux 5.15.83Linux 5.10.1301.1182.2363.3544.4725.59SE +/- 0.019, N = 9SE +/- 0.009, N = 3SE +/- 0.043, N = 34.9694.8974.892MIN: 4.87 / MAX: 7.19MIN: 4.84 / MAX: 18.25MIN: 4.79 / MAX: 17.741. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224Linux 5.10.130Linux 6.1Linux 5.15.830.86741.73482.60223.46964.337SE +/- 0.007, N = 3SE +/- 0.020, N = 9SE +/- 0.020, N = 33.8553.8313.752MIN: 3.65 / MAX: 16.53MIN: 3.59 / MAX: 5.87MIN: 3.56 / MAX: 17.61. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0Linux 5.10.130Linux 6.1Linux 5.15.830.60261.20521.80782.41043.013SE +/- 0.044, N = 3SE +/- 0.028, N = 9SE +/- 0.047, N = 32.6782.6402.639MIN: 2.4 / MAX: 5.22MIN: 2.36 / MAX: 16.9MIN: 2.38 / MAX: 3.731. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3Linux 6.1Linux 5.10.130Linux 5.15.83510152025SE +/- 0.32, N = 9SE +/- 0.36, N = 3SE +/- 0.38, N = 322.7922.7322.44MIN: 21.59 / MAX: 102.89MIN: 22.05 / MAX: 36.04MIN: 21.58 / MAX: 36.881. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetLinux 5.15.83Linux 5.10.130Linux 6.148121620SE +/- 0.18, N = 6SE +/- 0.03, N = 3SE +/- 0.01, N = 314.7114.5414.45MIN: 14.26 / MAX: 15.75MIN: 14.37 / MAX: 17.06MIN: 14.31 / MAX: 15.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2Linux 6.1Linux 5.10.130Linux 5.15.831.25332.50663.75995.01326.2665SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 65.575.565.53MIN: 5.49 / MAX: 6.18MIN: 5.44 / MAX: 6.03MIN: 5.41 / MAX: 10.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3Linux 6.1Linux 5.15.83Linux 5.10.1301.11382.22763.34144.45525.569SE +/- 0.01, N = 3SE +/- 0.04, N = 6SE +/- 0.01, N = 34.954.954.95MIN: 4.86 / MAX: 5.26MIN: 4.8 / MAX: 63.45MIN: 4.85 / MAX: 5.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2Linux 5.10.130Linux 6.1Linux 5.15.831.27352.5473.82055.0946.3675SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 65.665.635.59MIN: 5.54 / MAX: 17.07MIN: 5.53 / MAX: 6.55MIN: 5.48 / MAX: 6.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetLinux 5.10.130Linux 6.1Linux 5.15.831.10482.20963.31444.41925.524SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 64.914.894.85MIN: 4.74 / MAX: 16.51MIN: 4.81 / MAX: 5.21MIN: 4.72 / MAX: 7.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0Linux 5.10.130Linux 6.1Linux 5.15.83246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 67.067.046.99MIN: 6.92 / MAX: 7.42MIN: 6.92 / MAX: 7.34MIN: 6.89 / MAX: 8.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceLinux 5.10.130Linux 6.1Linux 5.15.830.53551.0711.60652.1422.6775SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 62.382.362.29MIN: 2.2 / MAX: 2.75MIN: 2.3 / MAX: 2.62MIN: 2.23 / MAX: 3.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetLinux 5.10.130Linux 6.1Linux 5.15.833691215SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 611.5711.4811.46MIN: 11.39 / MAX: 11.86MIN: 11.33 / MAX: 12.45MIN: 11.27 / MAX: 12.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16Linux 5.15.83Linux 5.10.130Linux 6.1714212835SE +/- 1.00, N = 6SE +/- 0.13, N = 3SE +/- 0.10, N = 327.6926.9526.52MIN: 26.21 / MAX: 33.47MIN: 26.65 / MAX: 27.51MIN: 26.22 / MAX: 27.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.04, N = 3SE +/- 0.22, N = 6SE +/- 0.01, N = 38.098.057.85MIN: 7.89 / MAX: 9.29MIN: 7.68 / MAX: 9.97MIN: 7.74 / MAX: 10.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetLinux 5.15.83Linux 6.1Linux 5.10.1301.2332.4663.6994.9326.165SE +/- 0.08, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 35.485.465.46MIN: 5.3 / MAX: 6.07MIN: 5.35 / MAX: 9.83MIN: 5.35 / MAX: 5.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50Linux 5.15.83Linux 5.10.130Linux 6.148121620SE +/- 0.34, N = 6SE +/- 0.05, N = 3SE +/- 0.13, N = 314.2114.2013.83MIN: 13.45 / MAX: 157.72MIN: 13.99 / MAX: 15.03MIN: 13.51 / MAX: 26.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyLinux 5.15.83Linux 5.10.130Linux 6.1612182430SE +/- 0.39, N = 6SE +/- 0.07, N = 3SE +/- 0.09, N = 323.8923.6023.35MIN: 22.91 / MAX: 31.78MIN: 23.16 / MAX: 27.3MIN: 23.01 / MAX: 26.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdLinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.12, N = 3SE +/- 0.12, N = 6SE +/- 0.14, N = 317.1316.8516.76MIN: 16.75 / MAX: 17.86MIN: 16.41 / MAX: 19.23MIN: 16.41 / MAX: 17.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mLinux 5.10.130Linux 6.1Linux 5.15.83510152025SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 618.8318.7018.67MIN: 18.43 / MAX: 58.94MIN: 18.43 / MAX: 19.5MIN: 18.39 / MAX: 21.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerLinux 5.15.83Linux 6.1Linux 5.10.1304080120160200SE +/- 0.40, N = 6SE +/- 0.61, N = 3SE +/- 0.96, N = 3161.23160.39160.27MIN: 158.43 / MAX: 179.56MIN: 158.59 / MAX: 172.13MIN: 158.5 / MAX: 166.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetLinux 5.10.130Linux 6.1Linux 5.15.83246810SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 67.026.966.91MIN: 6.87 / MAX: 7.89MIN: 6.86 / MAX: 7.19MIN: 6.78 / MAX: 7.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.10.130Linux 6.1Linux 5.15.8330060090012001500SE +/- 7.68, N = 3SE +/- 5.43, N = 3SE +/- 8.21, N = 31357.371357.101356.35MIN: 1303.04 / MAX: 1429.1MIN: 1311.47 / MAX: 1435.45MIN: 1238.64 / MAX: 1424.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1305001000150020002500SE +/- 4.48, N = 3SE +/- 6.63, N = 3SE +/- 6.79, N = 32415.312401.742400.02MIN: 2186.01 / MAX: 2533.33MIN: 2074.14 / MAX: 2532.54MIN: 1971.05 / MAX: 2519.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1305001000150020002500SE +/- 5.75, N = 3SE +/- 9.26, N = 3SE +/- 6.93, N = 32451.102441.672436.30MIN: 2080.43 / MAX: 2583.81MIN: 2123.66 / MAX: 2621.99MIN: 2086.23 / MAX: 2572.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.83714212835SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.01, N = 329.8629.3729.29MIN: 11.2 / MAX: 55.83MIN: 11.56 / MAX: 50.23MIN: 13.39 / MAX: 49.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.190180270360450SE +/- 0.17, N = 3SE +/- 0.53, N = 3SE +/- 0.59, N = 3417.71416.95416.16MIN: 260.74 / MAX: 433.77MIN: 240.72 / MAX: 434.4MIN: 211.14 / MAX: 443.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.15.83Linux 6.1Linux 5.10.130246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 38.348.338.24MIN: 4.49 / MAX: 23.48MIN: 4.48 / MAX: 25.96MIN: 4.42 / MAX: 23.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.130612182430SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 325.7325.6225.53MIN: 14.41 / MAX: 47.88MIN: 14.62 / MAX: 46.69MIN: 13.67 / MAX: 47.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.78, N = 3SE +/- 0.46, N = 3SE +/- 1.34, N = 3124.97124.34123.34MIN: 64.13 / MAX: 142.04MIN: 64.41 / MAX: 139.86MIN: 64 / MAX: 136.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.83246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 38.028.028.01MIN: 6 / MAX: 25.19MIN: 4.07 / MAX: 22.04MIN: 5.89 / MAX: 26.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.14, N = 13SE +/- 0.16, N = 3SE +/- 0.15, N = 1116.4716.4616.27MIN: 7.86 / MAX: 36.14MIN: 9.28 / MAX: 33.36MIN: 7.67 / MAX: 36.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.830.2340.4680.7020.9361.17SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.041.041.03MIN: 0.61 / MAX: 17.76MIN: 0.61 / MAX: 17.55MIN: 0.61 / MAX: 17.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.11480.22960.34440.45920.574SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.510.500.50MIN: 0.32 / MAX: 15.06MIN: 0.31 / MAX: 28.92MIN: 0.31 / MAX: 16.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.130160320480640800SE +/- 4.45, N = 3SE +/- 2.20, N = 3SE +/- 1.03, N = 3764.74759.35758.03

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.93, N = 3SE +/- 0.33, N = 3SE +/- 0.39, N = 3104.83104.16104.01

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 6.1Linux 5.15.83306090120150SE +/- 0.43, N = 3SE +/- 0.38, N = 3SE +/- 0.31, N = 3144.24144.21143.81

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 6.1Linux 5.10.130612182430SE +/- 0.27, N = 7SE +/- 0.11, N = 3SE +/- 0.14, N = 323.3123.0722.84

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 6.1Linux 5.15.8320406080100SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 392.2192.0591.99

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 6.1Linux 5.10.1303691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 313.3113.2713.27

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.130816243240SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 336.5436.5036.44

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.83246810SE +/- 0.1212, N = 3SE +/- 0.0949, N = 3SE +/- 0.0304, N = 37.53597.52657.4408

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 5.10.130Linux 6.11632486480SE +/- 0.36, N = 3SE +/- 0.04, N = 3SE +/- 0.32, N = 373.8273.6873.55

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.15.83Linux 5.10.13048121620SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 313.9013.8713.58

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.43, N = 3SE +/- 0.74, N = 3SE +/- 0.30, N = 3147.38146.95144.01

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.15.83Linux 5.10.130612182430SE +/- 0.23, N = 3SE +/- 0.29, N = 3SE +/- 0.10, N = 326.8726.4826.00

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.15.83Linux 5.10.130160320480640800SE +/- 2.74, N = 3SE +/- 1.90, N = 3SE +/- 2.25, N = 3763.31760.84752.83

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.120406080100SE +/- 0.31, N = 3SE +/- 0.59, N = 3SE +/- 0.22, N = 3104.04104.00103.58

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeLinux 5.10.130Linux 6.1Linux 5.15.8391827364538.5438.3638.241. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeLinux 5.10.130Linux 6.1Linux 5.15.834080120160200188.28186.93186.401. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeLinux 6.1Linux 5.15.83Linux 5.10.13050100150200250242.92242.25241.491. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeLinux 5.15.83Linux 6.1Linux 5.10.130300600900120015001611.591607.401598.701. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -ldynamicMesh -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamLinux 6.1Linux 5.10.130Linux 5.15.83306090120150SE +/- 0.17, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3153.23152.41151.82

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestLinux 5.15.83Linux 6.1Linux 5.10.13020406080100SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 396.3196.3096.21

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldLinux 5.10.130Linux 5.15.83Linux 6.160120180240300SE +/- 0.38, N = 3SE +/- 0.19, N = 3SE +/- 0.19, N = 3256.43256.19255.89

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationLinux 6.1Linux 5.10.130Linux 5.15.834080120160200SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.22, N = 3160.27159.75159.15

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerLinux 6.1Linux 5.15.83Linux 5.10.130100200300400500SE +/- 0.46, N = 3SE +/- 0.43, N = 3SE +/- 0.39, N = 3446.66445.17443.72

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Linux 6.1Linux 5.10.130Linux 5.15.83306090120150SE +/- 0.17, N = 3SE +/- 0.40, N = 3SE +/- 0.50, N = 3145.04145.01144.711. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Linux 6.1Linux 5.15.83Linux 5.10.1301632486480SE +/- 0.25, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 371.2071.0770.521. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6Linux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.036, N = 3SE +/- 0.054, N = 3SE +/- 0.059, N = 36.7986.7496.6891. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessLinux 6.1Linux 5.15.83Linux 5.10.1303691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 311.5811.4311.381. (CXX) g++ options: -O3 -fPIC -lm

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, LosslessLinux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.029, N = 3SE +/- 0.017, N = 3SE +/- 0.021, N = 36.9096.6666.6371. (CXX) g++ options: -O3 -fPIC -lm

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileLinux 6.1Linux 5.15.83Linux 5.10.13020406080100SE +/- 0.17, N = 3SE +/- 0.35, N = 3SE +/- 0.21, N = 399.4297.5797.25

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigLinux 6.1Linux 5.15.83Linux 5.10.1301632486480SE +/- 0.28, N = 3SE +/- 0.24, N = 3SE +/- 0.25, N = 372.5670.4970.17

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigLinux 6.1Linux 5.15.83Linux 5.10.1302004006008001000SE +/- 0.78, N = 3SE +/- 1.08, N = 3SE +/- 0.08, N = 3934.27911.08907.75

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To CompileLinux 6.1Linux 5.10.130Linux 5.15.83100200300400500SE +/- 0.24, N = 3SE +/- 0.23, N = 3SE +/- 0.27, N = 3459.75453.61453.31

Timed PHP Compilation

This test times how long it takes to build PHP. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9Time To CompileLinux 6.1Linux 5.10.130Linux 5.15.831530456075SE +/- 0.39, N = 3SE +/- 0.32, N = 3SE +/- 0.24, N = 365.9665.3365.14

Timed CPython Compilation

This test times how long it takes to build the reference Python implementation, CPython, with optimizations and LTO enabled for a release build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: DefaultLinux 6.1Linux 5.15.83Linux 5.10.13051015202519.7819.4919.45

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: Released Build, PGO + LTO OptimizedLinux 6.1Linux 5.15.83Linux 5.10.13080160240320400385.50383.96383.51

Primesieve

Primesieve generates prime numbers using a highly optimized sieve of Eratosthenes implementation. Primesieve primarily benchmarks the CPU's L1/L2 cache performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e12Linux 5.10.130Linux 5.15.83Linux 6.148121620SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 314.4414.4314.421. (CXX) g++ options: -O3 -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 8.0Length: 1e13Linux 6.1Linux 5.10.130Linux 5.15.834080120160200SE +/- 0.47, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 3174.98174.72174.661. (CXX) g++ options: -O3 -lpthread

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BLinux 5.15.83Linux 6.1Linux 5.10.130612182430SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 324.5624.4624.45

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 311.3711.3511.29

Timed Erlang/OTP Compilation

This test times how long it takes to compile Erlang/OTP. Erlang is a programming language and run-time for massively scalable soft real-time systems with high availability requirements. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0Time To CompileLinux 6.1Linux 5.15.83Linux 5.10.13020406080100SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 393.7491.7591.56

FLAC Audio Encoding

This test times how long it takes to encode a sample WAV file to FLAC audio format ten times using the --best preset settings. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.4WAV To FLACLinux 6.1Linux 5.10.130Linux 5.15.83510152025SE +/- 0.04, N = 5SE +/- 0.03, N = 5SE +/- 0.02, N = 521.3821.1121.101. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyLinux 6.1Linux 5.15.83Linux 5.10.13020406080100SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3106.46106.38106.13

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyLinux 6.1Linux 5.10.130Linux 5.15.8370140210280350SE +/- 0.49, N = 3SE +/- 0.37, N = 3SE +/- 0.22, N = 3318.71318.28317.07

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.30, N = 3SE +/- 0.09, N = 3SE +/- 0.12, N = 3144.34144.29144.25

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyLinux 5.10.130Linux 6.1Linux 5.15.832004006008001000SE +/- 0.49, N = 3SE +/- 0.42, N = 3SE +/- 0.12, N = 31145.901145.181144.82

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-OnlyLinux 6.1Linux 5.10.130Linux 5.15.8380160240320400SE +/- 0.42, N = 3SE +/- 0.42, N = 3SE +/- 0.29, N = 3374.17373.74373.54

EnCodec

EnCodec is a Facebook/Meta developed AI means of compressing audio files using High Fidelity Neural Audio Compression. EnCodec is designed to provide codec compression at 6 kbps using their novel AI-powered compression technique. The test profile uses a lengthy JFK speech as the audio input for benchmarking and the performance measurement is measuring the time to encode the EnCodec file from WAV. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsLinux 6.1Linux 5.10.130Linux 5.15.83714212835SE +/- 0.30, N = 8SE +/- 0.21, N = 3SE +/- 0.34, N = 630.4329.1428.66

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsLinux 6.1Linux 5.15.83Linux 5.10.130714212835SE +/- 0.09, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 332.0229.5329.50

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsLinux 6.1Linux 5.10.130Linux 5.15.83816243240SE +/- 0.13, N = 3SE +/- 0.02, N = 3SE +/- 0.20, N = 336.3234.1633.92

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsLinux 6.1Linux 5.15.83Linux 5.10.130714212835SE +/- 0.30, N = 9SE +/- 0.33, N = 3SE +/- 0.29, N = 830.4928.3528.21

Numenta Anomaly Benchmark

Numenta Anomaly Benchmark (NAB) is a benchmark for evaluating algorithms for anomaly detection in streaming, real-time applications. It is comprised of over 50 labeled real-world and artificial time-series data files plus a novel scoring mechanism designed for real-time applications. This test profile currently measures the time to run various detectors. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: KNN CADLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.84, N = 3SE +/- 0.59, N = 3SE +/- 0.44, N = 3185.33182.66180.52

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Relative EntropyLinux 5.15.83Linux 5.10.130Linux 6.148121620SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.19, N = 315.8115.8015.53

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Windowed GaussianLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.037, N = 3SE +/- 0.038, N = 3SE +/- 0.045, N = 39.0739.0709.018

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Earthgecko SkylineLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.67, N = 3SE +/- 0.35, N = 3SE +/- 0.46, N = 3115.83115.53114.81

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Bayesian ChangepointLinux 6.1Linux 5.15.83Linux 5.10.1301020304050SE +/- 0.20, N = 3SE +/- 0.21, N = 3SE +/- 0.18, N = 341.9441.4341.39

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Contextual Anomaly Detector OSELinux 6.1Linux 5.10.130Linux 5.15.831326395265SE +/- 0.15, N = 3SE +/- 0.29, N = 3SE +/- 0.25, N = 355.8255.7355.66

302 Results Shown

miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
Stress-NG:
  MMAP
  NUMA
  Futex
  MEMFD
  Mutex
  Atomic
  Crypto
  Malloc
  Forking
  IO_uring
  SENDFILE
  CPU Cache
  CPU Stress
  Semaphores
  Matrix Math
  Vector Math
  x86_64 RdRand
  Memory Copying
  Socket Activity
  Context Switching
  Glibc C String Functions
  Glibc Qsort Data Sorting
  System V Message Passing
srsRAN:
  4G PHY_DL_Test 100 PRB MIMO 64-QAM
  4G PHY_DL_Test 100 PRB SISO 64-QAM
  4G PHY_DL_Test 100 PRB MIMO 256-QAM
  4G PHY_DL_Test 100 PRB SISO 256-QAM
  5G PHY_DL_NR Test 52 PRB SISO 64-QAM
nekRS
OpenVINO:
  Face Detection FP16 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Vehicle Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Natron
AOM AV1:
  Speed 6 Two-Pass - Bosphorus 4K
  Speed 8 Realtime - Bosphorus 4K
  Speed 9 Realtime - Bosphorus 4K
  Speed 10 Realtime - Bosphorus 4K
SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p
miniBUDE:
  OpenMP - BM1
  OpenMP - BM2
Xmrig:
  Monero - 1M
  Wownero - 1M
TensorFlow:
  CPU - 16 - AlexNet
  CPU - 32 - AlexNet
  CPU - 64 - AlexNet
  CPU - 256 - AlexNet
  CPU - 16 - GoogLeNet
  CPU - 16 - ResNet-50
  CPU - 32 - GoogLeNet
  CPU - 32 - ResNet-50
  CPU - 64 - GoogLeNet
  CPU - 64 - ResNet-50
  CPU - 256 - GoogLeNet
  CPU - 256 - ResNet-50
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream
  CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection,YOLOv5s COCO - Synchronous Single-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream
GraphicsMagick:
  Swirl
  Rotate
  Sharpen
  Enhanced
  Resizing
  Noise-Gaussian
  HWB Color Space
Aircrack-ng
Cpuminer-Opt:
  Magi
  x25x
  scrypt
  Deepcoin
  Ringcoin
  Blake-2 S
  Garlicoin
  Skeincoin
  Myriad-Groestl
  LBC, LBRY Credits
  Quad SHA-256, Pyrite
  Triple SHA-256, Onecoin
C-Blosc:
  blosclz shuffle
  blosclz bitshuffle
7-Zip Compression:
  Compression Rating
  Decompression Rating
JPEG XL libjxl:
  PNG - 80
  PNG - 90
  JPEG - 80
  JPEG - 90
  PNG - 100
  JPEG - 100
JPEG XL Decoding libjxl:
  1
  All
WebP Image Encode:
  Default
  Quality 100
  Quality 100, Lossless
  Quality 100, Highest Compression
  Quality 100, Lossless, Highest Compression
ASTC Encoder:
  Fast
  Medium
  Thorough
  Exhaustive
LAMMPS Molecular Dynamics Simulator:
  20k Atoms
  Rhodopsin Protein
Facebook RocksDB:
  Rand Fill
  Rand Read
  Update Rand
  Seq Fill
  Rand Fill Sync
  Read While Writing
  Read Rand Write Rand
Dragonflydb:
  50 - 1:1
  50 - 1:5
  50 - 5:1
  200 - 1:1
  200 - 1:5
  200 - 5:1
ClickHouse:
  100M Rows Web Analytics Dataset, First Run / Cold Cache
  100M Rows Web Analytics Dataset, Second Run
  100M Rows Web Analytics Dataset, Third Run
Stargate Digital Audio Workstation:
  44100 - 512
  96000 - 512
  192000 - 512
  44100 - 1024
  480000 - 512
  96000 - 1024
  192000 - 1024
  480000 - 1024
srsRAN
spaCy:
  en_core_web_lg
  en_core_web_trf
PostgreSQL:
  100 - 100 - Read Only
  100 - 250 - Read Only
  100 - 500 - Read Only
  100 - 100 - Read Write
  100 - 250 - Read Write
  100 - 500 - Read Write
srsRAN:
  4G PHY_DL_Test 100 PRB MIMO 64-QAM
  4G PHY_DL_Test 100 PRB SISO 64-QAM
  4G PHY_DL_Test 100 PRB MIMO 256-QAM
  4G PHY_DL_Test 100 PRB SISO 256-QAM
  5G PHY_DL_NR Test 52 PRB SISO 64-QAM
BRL-CAD
ctx_clock
oneDNN:
  IP Shapes 1D - f32 - CPU
  IP Shapes 3D - f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 3D - u8s8f32 - CPU
  Convolution Batch Shapes Auto - f32 - CPU
  Deconvolution Batch shapes_1d - f32 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Convolution Batch Shapes Auto - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Recurrent Neural Network Training - f32 - CPU
  Recurrent Neural Network Inference - f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Matrix Multiply Batch Shapes Transformer - f32 - CPU
  Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU
OSPRay Studio:
  1 - 4K - 1 - Path Tracer
  2 - 4K - 1 - Path Tracer
  3 - 4K - 1 - Path Tracer
  1 - 4K - 16 - Path Tracer
  1 - 4K - 32 - Path Tracer
  2 - 4K - 16 - Path Tracer
  2 - 4K - 32 - Path Tracer
  3 - 4K - 16 - Path Tracer
  3 - 4K - 32 - Path Tracer
  1 - 1080p - 1 - Path Tracer
  2 - 1080p - 1 - Path Tracer
  3 - 1080p - 1 - Path Tracer
  1 - 1080p - 16 - Path Tracer
  1 - 1080p - 32 - Path Tracer
  2 - 1080p - 16 - Path Tracer
  2 - 1080p - 32 - Path Tracer
  3 - 1080p - 16 - Path Tracer
  3 - 1080p - 32 - Path Tracer
PostgreSQL:
  100 - 100 - Read Only - Average Latency
  100 - 250 - Read Only - Average Latency
  100 - 500 - Read Only - Average Latency
  100 - 100 - Read Write - Average Latency
  100 - 250 - Read Write - Average Latency
  100 - 500 - Read Write - Average Latency
Mobile Neural Network:
  nasnet
  mobilenetV3
  squeezenetv1.1
  resnet-v2-50
  SqueezeNetV1.0
  MobileNetV2_224
  mobilenet-v1-1.0
  inception-v3
NCNN:
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPU - yolov4-tiny
  CPU - squeezenet_ssd
  CPU - regnety_400m
  CPU - vision_transformer
  CPU - FastestDet
OpenVINO:
  Face Detection FP16 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Vehicle Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream
  CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection,YOLOv5s COCO - Synchronous Single-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss:
  Bumper Beam
  Cell Phone Drop Test
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  INIVOL and Fluid Structure Interaction Drop Container
libavif avifenc:
  0
  2
  6
  6, Lossless
  10, Lossless
Timed Godot Game Engine Compilation
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed Node.js Compilation
Timed PHP Compilation
Timed CPython Compilation:
  Default
  Released Build, PGO + LTO Optimized
Primesieve:
  1e12
  1e13
Y-Cruncher:
  1B
  500M
Timed Erlang/OTP Compilation
FLAC Audio Encoding
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Barbershop - CPU-Only
  Pabellon Barcelona - CPU-Only
EnCodec:
  3 kbps
  6 kbps
  24 kbps
  1.5 kbps
Numenta Anomaly Benchmark:
  KNN CAD
  Relative Entropy
  Windowed Gaussian
  Earthgecko Skyline
  Bayesian Changepoint
  Contextual Anomaly Detector OSE

Linux 5.10.130

Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210

OS: Ubuntu 20.10, Kernel: 5.10.130-0510130-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 14 December 2022 13:59 by user pts.

Linux 5.15.83

Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210

OS: Ubuntu 20.10, Kernel: 5.15.83-051583-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 15 December 2022 15:58 by user pts.

Linux 6.1

Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210

OS: Ubuntu 20.10, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 16 December 2022 14:23 by user pts.