Xeon Gold Cascade Lake Refresh LTS Linux Benchmarks

Intel Xeon Gold 6226R testing with a Supermicro X11SPL-F v1.02 (3.1 BIOS) and ASPEED on Ubuntu 20.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2212171-PTS-XEONGOLD08
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Audio Encoding 2 Tests
AV1 3 Tests
C++ Boost Tests 2 Tests
Timed Code Compilation 6 Tests
C/C++ Compiler Tests 9 Tests
Compression Tests 2 Tests
CPU Massive 17 Tests
Creator Workloads 17 Tests
Cryptocurrency Benchmarks, CPU Mining Tests 2 Tests
Cryptography 3 Tests
Database Test Suite 4 Tests
Encoding 5 Tests
Game Development 3 Tests
HPC - High Performance Computing 13 Tests
Imaging 5 Tests
Common Kernel Benchmarks 4 Tests
Machine Learning 8 Tests
Molecular Dynamics 2 Tests
Multi-Core 21 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 4 Tests
Programmer / Developer System Benchmarks 7 Tests
Python Tests 9 Tests
Renderers 3 Tests
Scientific Computing 2 Tests
Server 4 Tests
Server CPU Tests 10 Tests
Video Encoding 3 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Linux 5.10.130
December 14 2022
  1 Day, 44 Minutes
Linux 5.15.83
December 15 2022
  1 Day, 1 Hour, 38 Minutes
Linux 6.1
December 16 2022
  1 Day, 2 Hours, 3 Minutes
Invert Hiding All Results Option
  1 Day, 1 Hour, 28 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Linux 5.10.130

Processor: Intel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads), Motherboard: Supermicro X11SPL-F v1.02 (3.1 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 192GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210

OS: Ubuntu 20.10, Kernel: 5.10.130-0510130-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Linux 5.15.83

OS: Ubuntu 20.10, Kernel: 5.15.83-051583-generic (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Linux 6.1

OS: Ubuntu 20.10, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.38.1, Display Server: X Server 1.20.9, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1080

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102
Python Notes: Python 3.8.10
Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Xeon Gold Cascade Lake Refresh LTS Linux BenchmarksOpenBenchmarking.orgPhoronix Test SuiteIntel Xeon Gold 6226R @ 3.90GHz (16 Cores / 32 Threads)Supermicro X11SPL-F v1.02 (3.1 BIOS)Intel Sky Lake-E DMI3 Registers192GB280GB INTEL SSDPED1D280GAASPEEDVE2282 x Intel I210Ubuntu 20.105.10.130-0510130-generic (x86_64)5.15.83-051583-generic (x86_64)6.1.0-phx (x86_64)GNOME Shell 3.38.1X Server 1.20.9GCC 10.3.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelsDesktopDisplay ServerCompilerFile-SystemScreen ResolutionXeon Gold Cascade Lake Refresh LTS Linux Benchmarks PerformanceSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-poYruo/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x5003102- Python 3.8.10- Linux 5.10.130: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: eIBRS with unprivileged eBPF + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 5.15.83: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled - Linux 6.1: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Mitigation of TSX disabled

Linux 5.10.130Linux 5.15.83Linux 6.1Result OverviewPhoronix Test Suite100%107%115%122%130%ctx_clockDragonflydbJPEG XL Decoding libjxlEnCodecPostgreSQLGraphicsMagickC-BloscStress-NGAOM AV1JPEG XL libjxlFacebook RocksDBTimed Linux Kernel CompilationStargate Digital Audio WorkstationspaCyClickHouseTimed Erlang/OTP CompilationTimed Godot Game Engine Compilationlibavif avifencMobile Neural NetworkTimed Node.js CompilationFLAC Audio EncodingTimed PHP CompilationminiBUDETimed CPython Compilation7-Zip CompressionNCNNBRL-CADNeural Magic DeepSparsesrsRANSVT-AV1nekRSOpenVINOY-CruncherXmrigCpuminer-OptWebP Image EncodeOpenRadiossLAMMPS Molecular Dynamics SimulatorTensorFlowNumenta Anomaly BenchmarkBlenderoneDNNASTC EncoderPrimesieveAircrack-ngNatronOSPRay StudioOpenFOAM

Xeon Gold Cascade Lake Refresh LTS Linux Benchmarksminibude: OpenMP - BM1minibude: OpenMP - BM2stress-ng: MMAPstress-ng: NUMAstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: x86_64 RdRandstress-ng: Memory Copyingstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingsrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMnekrs: TurboPipe Periodicopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUnatron: Spaceshipaom-av1: Speed 6 Two-Pass - Bosphorus 4Kaom-av1: Speed 8 Realtime - Bosphorus 4Kaom-av1: Speed 9 Realtime - Bosphorus 4Kaom-av1: Speed 10 Realtime - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080pminibude: OpenMP - BM1minibude: OpenMP - BM2xmrig: Monero - 1Mxmrig: Wownero - 1Mtensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 64 - AlexNettensorflow: CPU - 256 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - ResNet-50tensorflow: CPU - 256 - GoogLeNettensorflow: CPU - 256 - ResNet-50deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamgraphics-magick: Swirlgraphics-magick: Rotategraphics-magick: Sharpengraphics-magick: Enhancedgraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spaceaircrack-ng: cpuminer-opt: Magicpuminer-opt: x25xcpuminer-opt: scryptcpuminer-opt: Deepcoincpuminer-opt: Ringcoincpuminer-opt: Blake-2 Scpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: Myriad-Groestlcpuminer-opt: LBC, LBRY Creditscpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: Triple SHA-256, Onecoinblosc: blosclz shuffleblosc: blosclz bitshufflecompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingjpegxl: PNG - 80jpegxl: PNG - 90jpegxl: JPEG - 80jpegxl: JPEG - 90jpegxl: PNG - 100jpegxl: JPEG - 100jpegxl-decode: 1jpegxl-decode: Allwebp: Defaultwebp: Quality 100webp: Quality 100, Losslesswebp: Quality 100, Highest Compressionwebp: Quality 100, Lossless, Highest Compressionastcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustivelammps: 20k Atomslammps: Rhodopsin Proteinrocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randdragonflydb: 50 - 1:1dragonflydb: 50 - 1:5dragonflydb: 50 - 5:1dragonflydb: 200 - 1:1dragonflydb: 200 - 1:5dragonflydb: 200 - 5:1clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, Third Runstargate: 44100 - 512stargate: 96000 - 512stargate: 192000 - 512stargate: 44100 - 1024stargate: 480000 - 512stargate: 96000 - 1024stargate: 192000 - 1024stargate: 480000 - 1024srsran: OFDM_Testspacy: en_core_web_lgspacy: en_core_web_trfpgbench: 100 - 100 - Read Onlypgbench: 100 - 250 - Read Onlypgbench: 100 - 500 - Read Onlypgbench: 100 - 100 - Read Writepgbench: 100 - 250 - Read Writepgbench: 100 - 500 - Read Writesrsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 64-QAMsrsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAMsrsran: 4G PHY_DL_Test 100 PRB SISO 256-QAMsrsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMbrl-cad: VGR Performance Metricctx-clock: Context Switch Timeonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 2 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 2 - 1080p - 16 - Path Tracerospray-studio: 2 - 1080p - 32 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerpgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 500 - Read Write - Average Latencymnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3ncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeravifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compilebuild-php: Time To Compilebuild-python: Defaultbuild-python: Released Build, PGO + LTO Optimizedprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Mbuild-erlang: Time To Compileencode-flac: WAV To FLACblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyencodec: 3 kbpsencodec: 6 kbpsencodec: 24 kbpsencodec: 1.5 kbpsnumenta-nab: KNN CADnumenta-nab: Relative Entropynumenta-nab: Windowed Gaussiannumenta-nab: Earthgecko Skylinenumenta-nab: Bayesian Changepointnumenta-nab: Contextual Anomaly Detector OSELinux 5.10.130Linux 5.15.83Linux 6.121.21121.389390.20358.051498828.701008.628606774.99223731.7018742.6722392194.2856719.5136489.15241610.68116.3334273.523214994.8355915.3655351.58252390.564201.0210160.915500706.76911917.94194.366490812.35279.8279.8303.4307.098.6706497666675.883.313.25272.0919.11969.33625.5064.821991.75485.3615259.8631167.813.611.7037.8848.0548.342.47534.519126.497120.7947.04695.493415.136423.649530.266534.7386794.59492.2166.55211.25243.30278.63114.4137.68121.7240.23125.7941.90130.2143.5010.52109.599655.423343.761286.656775.2616219.3569132.6485108.547573.603955.543338.443810.54039.6153502757199315133333597650605.559374.94640.06491.90144972833.0911491036572.81135103173639682021883031591315238.110158.9106357864327.707.587.457.300.540.5338.17208.7914.379.001.273.070.48193.131572.15959.32250.937110.42710.65998319965094239625695120425521646431008992132608978963.311047699.23989148.97971725.251021149.38918617.37205.76212.60212.423.9095522.5378911.5362554.3858933.7269332.9996111.8892684.199568122000000113142446465422413949370238536564767638503117.3123.3126.9131.065.91677711542.296363.101440.4966131.252714.291534.706993.306064.158690.5406540.8514551613.12909.6321621.84911.8160.9563990.3132387055724286331214672342161244282399351465832846991778182621782840965271291726682334786780160.2150.6041.3501.8645.24412.98614.9102.0912.59210.1484.8923.8552.67822.73314.545.564.955.664.917.062.3811.5726.958.095.4614.2023.6017.1318.83160.277.021357.372400.022436.3029.37417.718.2425.53123.348.0216.471.040.50758.0277104.1622144.241022.839692.214213.268936.43907.526573.675913.5771144.006226.0011752.8319103.996038.53511188.28208241.485511598.6991152.4196.21256.43159.75443.72145.01270.5176.68911.3766.63797.24670.169907.748453.61365.32519.449383.51414.443174.72224.44911.34591.56021.110106.13318.28144.251145.90373.7429.14129.49534.16228.208185.33015.8039.070114.81341.39255.73421.17021.317381.23335.582364278.75879.679013626.15225144.3318733.1020930090.9660087.3632758.89285766.99128.3134238.773314461.3855890.2355415.01252393.884129.3417786.172284154.16916397.13194.888257907.06282.7282.0310.0307.998.6709236333335.883.303.25272.8019.15957.08623.3664.281993.58485.1915258.5631007.383.611.7737.8647.6648.332.48334.818127.534122.9786.98595.043418.022425.263529.240532.9246829.89531.3166.90211.47242.73279.05115.1538.09122.1840.41126.2942.05130.4043.4110.45399.614155.584942.901386.940275.0401219.0088134.1326108.337772.055254.433237.760210.43399.6111499731199314132133195750607.738373.55641.61489.83145002812.3411505836594.18134833176109666321849331391715998.610555.7108058867357.717.547.407.250.540.5337.90209.1814.409.021.283.090.48193.024472.12199.32670.937510.41410.639982848652336496166261193837234969304327921293591123953.551186278.251068662.911060251.051117321.90993337.90204.26209.58215.023.9725912.5790451.5670494.4310983.7903213.0635111.9896804.270897122633333112362416515273475175426428562304592233824118.3123.9128.0131.666.01668521792.293853.085610.4972481.251744.311784.708343.296334.203430.5404520.8465431611.14912.0661614.87908.1880.9616820.3160057046724686281214862341421245562403111465702848531778182621762841765242292066681734801779970.1940.5261.1731.7795.44414.78314.8802.0712.5379.8504.8973.7522.63922.43814.715.534.955.594.856.992.2911.4627.698.055.4814.2123.8916.8518.67161.236.911356.352401.742441.6729.29416.958.3425.62124.348.0116.461.030.5759.3525104.0054143.806523.313991.986013.308936.49737.440873.821613.8679146.950526.4774760.8374104.037638.235781186.39843242.254871611.5943151.8296.31256.19159.15445.17144.70971.0656.74911.4256.66697.56870.488911.083453.30765.14319.493383.96214.429174.65824.56211.36691.75421.098106.38317.07144.341144.82373.5428.66029.53033.91728.349182.65715.8139.018115.52941.43355.65921.42221.552310.22256.612433807.14667.827375258.06225639.3218727.6115989079.7753632.6732918.80284966.04115.5934059.433315660.8855875.1855344.32252372.294181.8016990.752054658.64916843.52194.3014896082.79280.2280.3307.4305.598.3704815000005.893.283.23267.6219.17957.41620.6163.961992.23491.2415144.3230632.463.611.6536.1045.4145.972.46034.723126.763121.5967.02495.151409.127419.750535.565538.7906767.39527.7166.31211.06242.34279.22116.1638.01123.1940.32126.4942.06130.4743.3710.40979.539355.436643.320286.883275.2635218.6936132.5077108.744371.885254.272637.211510.38329.6532491668197311129932287250609.276373.45638.64491.85144202800.6211375506571.66134320174779601021723731572315256.110161.3106968866807.367.207.086.940.530.5236.37181.5414.388.951.273.080.48192.991772.09729.31030.936810.39910.608935285653371755944851134991218454298539221335281130454.031180450.091074996.431046604.151099078.40979549.43198.51204.43212.923.8172682.4971641.5200404.3113823.7188123.0125851.9288144.208880120733333112312341523788487468467167543654522336109117.1123.3127.2130.365.91683342002.297083.094330.4967761.248714.286184.980673.312444.180960.5414300.8318661614.07909.1471618.86913.9430.9634000.3139757048724586331230002343711263412404301466922842351779182421732847965894291656783734779798040.1910.5131.0701.8395.52813.84715.1222.0832.6069.9324.9693.8312.64022.78914.455.574.955.634.897.042.3611.4826.527.855.4613.8323.3516.7618.70160.396.961357.102415.312451.1029.86416.168.3325.73124.978.0216.271.040.51764.7425104.8348144.211423.071892.046213.269136.53927.535973.545613.9013147.380426.8656763.3064103.582338.361993186.93467242.923071607.4012153.2396.30255.89160.27446.66145.03671.2016.79811.5806.90999.42072.558934.265459.75365.96419.777385.514.424174.97724.45511.29493.73921.376106.46318.71144.291145.18374.1730.42632.01736.32130.493180.51915.5259.073115.83141.93655.815OpenBenchmarking.org

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 6.1Linux 5.10.130Linux 5.15.83510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 321.4221.2121.171. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 6.1Linux 5.10.130Linux 5.15.83510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 321.5521.3921.321. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Stress-NG

Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MMAPLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 0.74, N = 3SE +/- 0.56, N = 3SE +/- 2.76, N = 3390.20381.23310.221. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: NUMALinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 2.82, N = 3SE +/- 0.90, N = 3SE +/- 1.78, N = 3358.05335.58256.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: FutexLinux 6.1Linux 5.15.83Linux 5.10.130500K1000K1500K2000K2500KSE +/- 9882.04, N = 3SE +/- 32600.02, N = 3SE +/- 33488.35, N = 152433807.142364278.751498828.701. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 0.88, N = 3SE +/- 0.39, N = 3SE +/- 0.28, N = 31008.62879.67667.821. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MutexLinux 5.15.83Linux 5.10.130Linux 6.12M4M6M8M10MSE +/- 112044.15, N = 15SE +/- 10182.54, N = 3SE +/- 24065.62, N = 39013626.158606774.997375258.061. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: AtomicLinux 6.1Linux 5.15.83Linux 5.10.13050K100K150K200K250KSE +/- 3644.44, N = 3SE +/- 1620.65, N = 3SE +/- 1447.49, N = 3225639.32225144.33223731.701. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CryptoLinux 5.10.130Linux 5.15.83Linux 6.14K8K12K16K20KSE +/- 47.41, N = 3SE +/- 83.58, N = 3SE +/- 66.53, N = 318742.6718733.1018727.611. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MallocLinux 5.10.130Linux 5.15.83Linux 6.15M10M15M20M25MSE +/- 90978.10, N = 3SE +/- 130302.14, N = 3SE +/- 91731.80, N = 322392194.2820930090.9615989079.771. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: ForkingLinux 5.15.83Linux 5.10.130Linux 6.113K26K39K52K65KSE +/- 184.20, N = 3SE +/- 175.99, N = 3SE +/- 386.64, N = 360087.3656719.5153632.671. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringLinux 5.10.130Linux 6.1Linux 5.15.838K16K24K32K40KSE +/- 401.23, N = 3SE +/- 240.39, N = 3SE +/- 501.84, N = 336489.1532918.8032758.891. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILELinux 5.15.83Linux 6.1Linux 5.10.13060K120K180K240K300KSE +/- 2143.98, N = 3SE +/- 1947.11, N = 3SE +/- 2449.06, N = 3285766.99284966.04241610.681. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU CacheLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 6.07, N = 12SE +/- 2.89, N = 15SE +/- 2.00, N = 15128.31116.33115.591. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CPU StressLinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 248.24, N = 14SE +/- 3.47, N = 3SE +/- 27.28, N = 334273.5234238.7734059.431. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SemaphoresLinux 6.1Linux 5.15.83Linux 5.10.130700K1400K2100K2800K3500KSE +/- 1806.60, N = 3SE +/- 1860.75, N = 3SE +/- 159.78, N = 33315660.883314461.383214994.831. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Matrix MathLinux 5.10.130Linux 5.15.83Linux 6.112K24K36K48K60KSE +/- 476.25, N = 3SE +/- 503.37, N = 3SE +/- 647.24, N = 355915.3655890.2355875.181. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Vector MathLinux 5.15.83Linux 5.10.130Linux 6.112K24K36K48K60KSE +/- 330.15, N = 3SE +/- 337.57, N = 3SE +/- 321.30, N = 355415.0155351.5855344.321. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux 5.15.83Linux 5.10.130Linux 6.150K100K150K200K250KSE +/- 1.57, N = 3SE +/- 0.71, N = 3SE +/- 12.63, N = 3252393.88252390.56252372.291. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Memory CopyingLinux 5.10.130Linux 6.1Linux 5.15.839001800270036004500SE +/- 31.35, N = 3SE +/- 29.72, N = 3SE +/- 42.48, N = 34201.024181.804129.341. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Socket ActivityLinux 5.15.83Linux 6.1Linux 5.10.1304K8K12K16K20KSE +/- 80.02, N = 3SE +/- 112.51, N = 3SE +/- 302.66, N = 1517786.1716990.7510160.911. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Context SwitchingLinux 5.10.130Linux 5.15.83Linux 6.11.2M2.4M3.6M4.8M6MSE +/- 72191.04, N = 3SE +/- 7040.94, N = 3SE +/- 3492.53, N = 35500706.762284154.162054658.641. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc C String FunctionsLinux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 8664.27, N = 3SE +/- 3709.52, N = 3SE +/- 6508.49, N = 3916843.52916397.13911917.941. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Glibc Qsort Data SortingLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 1.18, N = 3SE +/- 1.58, N = 3SE +/- 1.25, N = 3194.88194.36194.301. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: System V Message PassingLinux 6.1Linux 5.15.83Linux 5.10.1303M6M9M12M15MSE +/- 26770.64, N = 3SE +/- 4399.60, N = 3SE +/- 23387.52, N = 314896082.798257907.066490812.351. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread

srsRAN

srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.13060120180240300SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.15, N = 3282.7280.2279.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.13060120180240300SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3282.0280.3279.81. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.15.83Linux 6.1Linux 5.10.13070140210280350SE +/- 0.22, N = 3SE +/- 0.35, N = 3SE +/- 1.79, N = 3310.0307.4303.41. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.15.83Linux 5.10.130Linux 6.170140210280350SE +/- 0.15, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3307.9307.0305.51. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgeNb Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.15.83Linux 5.10.130Linux 6.120406080100SE +/- 0.10, N = 3SE +/- 0.35, N = 3SE +/- 0.15, N = 398.698.698.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicLinux 5.15.83Linux 5.10.130Linux 6.115000M30000M45000M60000M75000MSE +/- 219477639.96, N = 3SE +/- 144216808.24, N = 3SE +/- 48731133.10, N = 37092363333370649766667704815000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -pthread -lmpi_cxx -lmpi

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.1301.32532.65063.97595.30126.6265SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 35.895.885.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.74481.48962.23442.97923.724SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 33.313.303.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.10.73131.46262.19392.92523.6565SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 33.253.253.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.160120180240300SE +/- 0.06, N = 3SE +/- 1.08, N = 3SE +/- 1.20, N = 3272.80272.09267.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.130510152025SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 319.1719.1519.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 6.1Linux 5.15.832004006008001000SE +/- 5.71, N = 3SE +/- 0.69, N = 3SE +/- 1.74, N = 3969.33957.41957.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1140280420560700SE +/- 0.68, N = 3SE +/- 0.90, N = 3SE +/- 1.31, N = 3625.50623.36620.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.11428425670SE +/- 0.70, N = 3SE +/- 0.24, N = 3SE +/- 0.40, N = 364.8264.2863.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.15.83Linux 6.1Linux 5.10.130400800120016002000SE +/- 0.98, N = 3SE +/- 1.06, N = 3SE +/- 1.36, N = 31993.581992.231991.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.1Linux 5.10.130Linux 5.15.83110220330440550SE +/- 4.29, N = 11SE +/- 4.00, N = 13SE +/- 4.62, N = 3491.24485.36485.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.13K6K9K12K15KSE +/- 110.56, N = 3SE +/- 108.60, N = 3SE +/- 96.54, N = 315259.8615258.5615144.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.17K14K21K28K35KSE +/- 85.59, N = 3SE +/- 38.88, N = 3SE +/- 16.23, N = 331167.8131007.3830632.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Natron

Natron is an open-source, cross-platform compositing software for visual effects (VFX) and motion graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipLinux 6.1Linux 5.15.83Linux 5.10.1300.811.622.433.244.05SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.63.63.6

AOM AV1

This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4KLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 311.7711.7011.651. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 337.8837.8636.101. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.06, N = 3SE +/- 0.14, N = 3SE +/- 0.11, N = 348.0547.6645.411. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

OpenBenchmarking.orgFrames Per Second, More Is BetterAOM AV1 3.5Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4KLinux 5.10.130Linux 5.15.83Linux 6.11122334455SE +/- 0.10, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 348.3448.3345.971. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm -lpthread

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KLinux 5.15.83Linux 5.10.130Linux 6.10.55871.11741.67612.23482.7935SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.005, N = 32.4832.4752.4601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KLinux 5.15.83Linux 6.1Linux 5.10.130816243240SE +/- 0.15, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 334.8234.7234.521. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.62, N = 3SE +/- 0.29, N = 3SE +/- 0.46, N = 3127.53126.76126.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.32, N = 3SE +/- 0.62, N = 3SE +/- 0.69, N = 3122.98121.60120.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pLinux 5.10.130Linux 6.1Linux 5.15.83246810SE +/- 0.057, N = 3SE +/- 0.044, N = 3SE +/- 0.016, N = 37.0467.0246.9851. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pLinux 5.10.130Linux 6.1Linux 5.15.8320406080100SE +/- 0.40, N = 3SE +/- 0.46, N = 3SE +/- 0.30, N = 395.4995.1595.041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pLinux 5.15.83Linux 5.10.130Linux 6.190180270360450SE +/- 0.85, N = 3SE +/- 0.88, N = 3SE +/- 2.62, N = 3418.02415.14409.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pLinux 5.15.83Linux 5.10.130Linux 6.190180270360450SE +/- 1.29, N = 3SE +/- 0.82, N = 3SE +/- 1.64, N = 3425.26423.65419.751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Linux 6.1Linux 5.10.130Linux 5.15.83120240360480600SE +/- 0.30, N = 3SE +/- 0.13, N = 3SE +/- 0.39, N = 3535.57530.27529.241. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2Linux 6.1Linux 5.10.130Linux 5.15.83120240360480600SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3538.79534.74532.921. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmlrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MLinux 5.15.83Linux 5.10.130Linux 6.115003000450060007500SE +/- 23.74, N = 3SE +/- 3.14, N = 3SE +/- 54.19, N = 36829.86794.56767.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MLinux 5.15.83Linux 6.1Linux 5.10.1302K4K6K8K10KSE +/- 34.41, N = 3SE +/- 49.24, N = 3SE +/- 67.20, N = 39531.39527.79492.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 0.13, N = 3SE +/- 0.44, N = 3SE +/- 0.22, N = 3166.90166.55166.31

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetLinux 5.15.83Linux 5.10.130Linux 6.150100150200250SE +/- 0.13, N = 3SE +/- 0.47, N = 3SE +/- 0.28, N = 3211.47211.25211.06

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.06, N = 3SE +/- 0.39, N = 3SE +/- 0.27, N = 3243.30242.73242.34

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetLinux 6.1Linux 5.15.83Linux 5.10.13060120180240300SE +/- 0.40, N = 3SE +/- 0.66, N = 3SE +/- 0.53, N = 3279.22279.05278.63

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.17, N = 3SE +/- 0.10, N = 3SE +/- 0.12, N = 3116.16115.15114.41

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Linux 5.15.83Linux 6.1Linux 5.10.130918273645SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 338.0938.0137.68

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3123.19122.18121.72

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Linux 5.15.83Linux 6.1Linux 5.10.130918273645SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 340.4140.3240.23

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3126.49126.29125.79

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Linux 6.1Linux 5.15.83Linux 5.10.1301020304050SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 342.0642.0541.90

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetLinux 6.1Linux 5.15.83Linux 5.10.130306090120150SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3130.47130.40130.21

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: ResNet-50Linux 5.10.130Linux 5.15.83Linux 6.11020304050SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 343.5043.4143.37

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 310.5210.4510.41

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.0357, N = 3SE +/- 0.0301, N = 3SE +/- 0.0848, N = 39.61419.59969.5393

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 6.1Linux 5.10.1301224364860SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 355.5855.4455.42

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 6.1Linux 5.15.831020304050SE +/- 0.26, N = 3SE +/- 0.21, N = 3SE +/- 0.47, N = 743.7643.3242.90

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux 5.15.83Linux 6.1Linux 5.10.13020406080100SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 386.9486.8886.66

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.10, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 375.2675.2675.04

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.10, N = 3SE +/- 0.45, N = 3SE +/- 0.45, N = 3219.36219.01218.69

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.54, N = 3SE +/- 1.67, N = 3SE +/- 2.16, N = 3134.13132.65132.51

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamLinux 6.1Linux 5.10.130Linux 5.15.8320406080100SE +/- 0.47, N = 3SE +/- 0.05, N = 3SE +/- 0.53, N = 3108.74108.55108.34

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.65, N = 3SE +/- 0.33, N = 3SE +/- 0.51, N = 373.6072.0671.89

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.11224364860SE +/- 0.12, N = 3SE +/- 0.27, N = 3SE +/- 0.16, N = 355.5454.4354.27

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamLinux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.15, N = 3SE +/- 0.41, N = 3SE +/- 0.31, N = 338.4437.7637.21

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 310.5410.4310.38

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamLinux 6.1Linux 5.10.130Linux 5.15.833691215SE +/- 0.0209, N = 3SE +/- 0.0549, N = 3SE +/- 0.0282, N = 39.65329.61539.6111

GraphicsMagick

This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlLinux 5.10.130Linux 5.15.83Linux 6.1110220330440550SE +/- 2.40, N = 3SE +/- 1.53, N = 3SE +/- 1.53, N = 35024994911. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800SE +/- 9.97, N = 5SE +/- 1.76, N = 3SE +/- 5.43, N = 157577316681. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenLinux 5.15.83Linux 5.10.130Linux 6.14080120160200SE +/- 1.20, N = 3SE +/- 1.33, N = 3SE +/- 1.33, N = 31991991971. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 33153143111. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingLinux 5.10.130Linux 5.15.83Linux 6.130060090012001500SE +/- 7.42, N = 3SE +/- 2.73, N = 3SE +/- 2.91, N = 31333132112991. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianLinux 5.10.130Linux 5.15.83Linux 6.170140210280350SE +/- 1.76, N = 33353313221. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceLinux 5.10.130Linux 5.15.83Linux 6.12004006008001000SE +/- 1.53, N = 3SE +/- 1.67, N = 39769578721. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -lwebp -lwebpmux -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

Aircrack-ng

Aircrack-ng is a tool for assessing WiFi/WLAN network security. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgk/s, More Is BetterAircrack-ng 1.7Linux 6.1Linux 5.15.83Linux 5.10.13011K22K33K44K55KSE +/- 144.43, N = 3SE +/- 118.77, N = 3SE +/- 129.98, N = 350609.2850607.7450605.561. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -lbsd -pthread

Cpuminer-Opt

Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: MagiLinux 5.10.130Linux 5.15.83Linux 6.180160240320400SE +/- 4.81, N = 3SE +/- 4.11, N = 3SE +/- 4.81, N = 3374.94373.55373.451. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xLinux 5.15.83Linux 5.10.130Linux 6.1140280420560700SE +/- 1.51, N = 3SE +/- 0.20, N = 3SE +/- 0.34, N = 3641.61640.06638.641. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptLinux 5.10.130Linux 6.1Linux 5.15.83110220330440550SE +/- 3.92, N = 3SE +/- 2.46, N = 3SE +/- 5.31, N = 3491.90491.85489.831. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: DeepcoinLinux 5.15.83Linux 5.10.130Linux 6.13K6K9K12K15KSE +/- 50.00, N = 3SE +/- 46.67, N = 31450014497144201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: RingcoinLinux 5.10.130Linux 5.15.83Linux 6.16001200180024003000SE +/- 27.91, N = 3SE +/- 0.80, N = 3SE +/- 1.62, N = 32833.092812.342800.621. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Blake-2 SLinux 5.15.83Linux 5.10.130Linux 6.1200K400K600K800K1000KSE +/- 10686.26, N = 3SE +/- 6874.21, N = 3SE +/- 3289.87, N = 31150583114910311375501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinLinux 5.15.83Linux 5.10.130Linux 6.114002800420056007000SE +/- 11.67, N = 3SE +/- 2.21, N = 3SE +/- 2.16, N = 36594.186572.816571.661. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 169.54, N = 3SE +/- 3.33, N = 3SE +/- 283.78, N = 31351031348331343201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Myriad-GroestlLinux 5.15.83Linux 6.1Linux 5.10.1304K8K12K16K20KSE +/- 185.02, N = 3SE +/- 135.32, N = 3SE +/- 286.72, N = 31761017477173631. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsLinux 5.10.130Linux 5.15.83Linux 6.120K40K60K80K100KSE +/- 656.84, N = 3SE +/- 167.46, N = 3SE +/- 615.39, N = 39682096663960101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 820.33, N = 3SE +/- 6.67, N = 3SE +/- 258.61, N = 32188302184932172371. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Triple SHA-256, OnecoinLinux 5.10.130Linux 6.1Linux 5.15.8370K140K210K280K350KSE +/- 2642.36, N = 3SE +/- 2222.66, N = 3SE +/- 661.12, N = 33159133157233139171. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

C-Blosc

C-Blosc (c-blosc2) simple, compressed, fast and persistent data store library for C. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleLinux 5.15.83Linux 6.1Linux 5.10.1303K6K9K12K15KSE +/- 51.78, N = 3SE +/- 27.75, N = 3SE +/- 62.87, N = 315998.615256.115238.11. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleLinux 5.15.83Linux 6.1Linux 5.10.1302K4K6K8K10KSE +/- 12.20, N = 3SE +/- 25.18, N = 3SE +/- 20.30, N = 310555.710161.310158.91. (CC) gcc options: -std=gnu99 -O3 -lrt -pthread -lm

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingLinux 5.15.83Linux 6.1Linux 5.10.13020K40K60K80K100KSE +/- 364.72, N = 3SE +/- 526.57, N = 3SE +/- 95.64, N = 31080581069681063571. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingLinux 5.15.83Linux 6.1Linux 5.10.13020K40K60K80K100KSE +/- 150.80, N = 3SE +/- 264.89, N = 3SE +/- 259.98, N = 38673586680864321. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

JPEG XL libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Linux 5.15.83Linux 5.10.130Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.717.707.361. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 37.587.547.201. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 37.457.407.081. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Linux 5.10.130Linux 5.15.83Linux 6.1246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 37.307.256.941. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Linux 5.15.83Linux 5.10.130Linux 6.10.12150.2430.36450.4860.6075SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.540.540.531. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Linux 5.15.83Linux 5.10.130Linux 6.10.11930.23860.35790.47720.5965SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.530.530.521. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic

JPEG XL Decoding libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is suited for JPEG XL decode performance testing to PNG output file, the pts/jpexl test is for encode performance. The JPEG XL encoding/decoding is done using the libjxl codebase. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Linux 5.10.130Linux 5.15.83Linux 6.1918273645SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 338.1737.9036.37

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllLinux 5.15.83Linux 5.10.130Linux 6.150100150200250SE +/- 0.37, N = 3SE +/- 1.38, N = 3SE +/- 2.09, N = 3209.18208.79181.54

WebP Image Encode

This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: DefaultLinux 5.15.83Linux 6.1Linux 5.10.13048121620SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 314.4014.3814.371. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100Linux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 39.029.008.951. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, LosslessLinux 5.15.83Linux 6.1Linux 5.10.1300.2880.5760.8641.1521.44SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.281.271.271. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest CompressionLinux 5.15.83Linux 6.1Linux 5.10.1300.69531.39062.08592.78123.4765SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 33.093.083.071. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Lossless, Highest CompressionLinux 6.1Linux 5.15.83Linux 5.10.1300.1080.2160.3240.4320.54SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.480.480.481. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3193.13193.02192.991. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumLinux 5.10.130Linux 5.15.83Linux 6.11632486480SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 372.1672.1272.101. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughLinux 5.15.83Linux 5.10.130Linux 6.13691215SE +/- 0.0055, N = 3SE +/- 0.0023, N = 3SE +/- 0.0088, N = 39.32679.32259.31031. (CXX) g++ options: -O3 -flto -pthread

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveLinux 5.15.83Linux 5.10.130Linux 6.10.21090.42180.63270.84361.0545SE +/- 0.0001, N = 3SE +/- 0.0001, N = 3SE +/- 0.0006, N = 30.93750.93710.93681. (CXX) g++ options: -O3 -flto -pthread

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 310.4310.4110.401. (CXX) g++ options: -O3 -pthread -lm -ldl

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinLinux 5.10.130Linux 5.15.83Linux 6.13691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6610.6410.611. (CXX) g++ options: -O3 -pthread -lm -ldl

Facebook RocksDB

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random FillLinux 5.10.130Linux 5.15.83Linux 6.1200K400K600K800K1000KSE +/- 10947.16, N = 3SE +/- 11892.65, N = 3SE +/- 2558.50, N = 39831999828489352851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random ReadLinux 6.1Linux 5.15.83Linux 5.10.13014M28M42M56M70MSE +/- 360247.64, N = 3SE +/- 139131.71, N = 3SE +/- 547664.44, N = 36533717565233649650942391. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Update RandomLinux 5.10.130Linux 5.15.83Linux 6.1130K260K390K520K650KSE +/- 3662.51, N = 3SE +/- 1069.98, N = 3SE +/- 2022.46, N = 36256956166265944851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Sequential FillLinux 5.10.130Linux 5.15.83Linux 6.1300K600K900K1200K1500KSE +/- 10501.31, N = 3SE +/- 3547.16, N = 3SE +/- 11595.14, N = 31204255119383711349911. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Random Fill SyncLinux 5.15.83Linux 6.1Linux 5.10.13050K100K150K200K250KSE +/- 684.45, N = 3SE +/- 160.74, N = 3SE +/- 254.19, N = 32349692184542164641. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read While WritingLinux 5.10.130Linux 5.15.83Linux 6.1700K1400K2100K2800K3500KSE +/- 49813.03, N = 3SE +/- 29968.88, N = 3SE +/- 14227.22, N = 33100899304327929853921. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterFacebook RocksDB 7.5.3Test: Read Random Write RandomLinux 6.1Linux 5.10.130Linux 5.15.83500K1000K1500K2000K2500KSE +/- 10651.17, N = 3SE +/- 16550.67, N = 3SE +/- 8919.50, N = 32133528213260821293591. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Dragonflydb

Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:1Linux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 1471.72, N = 3SE +/- 643.98, N = 3SE +/- 19609.96, N = 131130454.031123953.55978963.311. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 1:5Linux 5.15.83Linux 6.1Linux 5.10.130300K600K900K1200K1500KSE +/- 1515.54, N = 3SE +/- 1580.99, N = 3SE +/- 872.80, N = 31186278.251180450.091047699.231. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 50 - Set To Get Ratio: 5:1Linux 6.1Linux 5.15.83Linux 5.10.130200K400K600K800K1000KSE +/- 741.75, N = 3SE +/- 3987.52, N = 3SE +/- 8046.26, N = 31074996.431068662.91989148.971. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:1Linux 5.15.83Linux 6.1Linux 5.10.130200K400K600K800K1000KSE +/- 1111.75, N = 3SE +/- 6338.63, N = 3SE +/- 1890.11, N = 31060251.051046604.15971725.251. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 1:5Linux 5.15.83Linux 6.1Linux 5.10.130200K400K600K800K1000KSE +/- 3993.93, N = 3SE +/- 797.47, N = 3SE +/- 515.57, N = 31117321.901099078.401021149.381. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterDragonflydb 0.6Clients: 200 - Set To Get Ratio: 5:1Linux 5.15.83Linux 6.1Linux 5.10.130200K400K600K800K1000KSE +/- 845.72, N = 3SE +/- 1905.52, N = 3SE +/- 4444.49, N = 3993337.90979549.43918617.371. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 1.55, N = 15SE +/- 1.58, N = 14SE +/- 0.88, N = 3205.76204.26198.51MIN: 22.01 / MAX: 20000MIN: 22.52 / MAX: 20000MIN: 22.14 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunLinux 5.10.130Linux 5.15.83Linux 6.150100150200250SE +/- 0.88, N = 15SE +/- 1.25, N = 14SE +/- 4.28, N = 3212.60209.58204.43MIN: 22.96 / MAX: 20000MIN: 22.65 / MAX: 20000MIN: 22.33 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunLinux 5.15.83Linux 6.1Linux 5.10.13050100150200250SE +/- 0.78, N = 14SE +/- 1.08, N = 3SE +/- 1.01, N = 15215.02212.92212.42MIN: 22.68 / MAX: 20000MIN: 22.26 / MAX: 20000MIN: 22.81 / MAX: 200001. ClickHouse server version 22.5.4.19 (official build).

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.89381.78762.68143.57524.469SE +/- 0.017996, N = 3SE +/- 0.028488, N = 3SE +/- 0.063340, N = 33.9725913.9095523.8172681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.58031.16061.74092.32122.9015SE +/- 0.013088, N = 3SE +/- 0.035214, N = 3SE +/- 0.031971, N = 32.5790452.5378912.4971641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.35260.70521.05781.41041.763SE +/- 0.017482, N = 3SE +/- 0.008212, N = 3SE +/- 0.006196, N = 31.5670491.5362551.5200401. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Linux 5.15.83Linux 5.10.130Linux 6.10.9971.9942.9913.9884.985SE +/- 0.011431, N = 3SE +/- 0.002245, N = 3SE +/- 0.047576, N = 34.4310984.3858934.3113821. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Linux 5.15.83Linux 5.10.130Linux 6.10.85281.70562.55843.41124.264SE +/- 0.052597, N = 3SE +/- 0.019070, N = 3SE +/- 0.044488, N = 33.7903213.7269333.7188121. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Linux 5.15.83Linux 6.1Linux 5.10.1300.68931.37862.06792.75723.4465SE +/- 0.004654, N = 3SE +/- 0.021684, N = 3SE +/- 0.016716, N = 33.0635113.0125852.9996111. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Linux 5.15.83Linux 6.1Linux 5.10.1300.44770.89541.34311.79082.2385SE +/- 0.011134, N = 3SE +/- 0.012895, N = 3SE +/- 0.016352, N = 31.9896801.9288141.8892681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Linux 5.15.83Linux 6.1Linux 5.10.1300.9611.9222.8833.8444.805SE +/- 0.015411, N = 3SE +/- 0.017869, N = 3SE +/- 0.030220, N = 34.2708974.2088804.1995681. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

srsRAN

srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSamples / Second, More Is BettersrsRAN 22.04.1Test: OFDM_TestLinux 5.15.83Linux 5.10.130Linux 6.130M60M90M120M150MSE +/- 352766.84, N = 3SE +/- 251661.15, N = 3SE +/- 417665.47, N = 31226333331220000001207333331. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

spaCy

The spaCy library is an open-source solution for advanced neural language processing (NLP). The spaCy library leverages Python and is a leading neural language processing solution. This test profile times the spaCy CPU performance with various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgLinux 5.10.130Linux 5.15.83Linux 6.12K4K6K8K10KSE +/- 15.62, N = 3SE +/- 10.74, N = 3SE +/- 18.76, N = 3113141123611231

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfLinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 9.87, N = 3SE +/- 6.33, N = 3SE +/- 7.51, N = 3244624162341

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyLinux 6.1Linux 5.15.83Linux 5.10.130110K220K330K440K550KSE +/- 1990.45, N = 3SE +/- 92.73, N = 3SE +/- 1779.96, N = 35237885152734654221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyLinux 6.1Linux 5.15.83Linux 5.10.130100K200K300K400K500KSE +/- 5532.44, N = 3SE +/- 286.86, N = 3SE +/- 2810.03, N = 34874684751754139491. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyLinux 6.1Linux 5.15.83Linux 5.10.130100K200K300K400K500KSE +/- 757.53, N = 3SE +/- 666.01, N = 3SE +/- 956.06, N = 34671674264283702381. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteLinux 5.15.83Linux 6.1Linux 5.10.13012K24K36K48K60KSE +/- 125.21, N = 3SE +/- 90.59, N = 3SE +/- 146.53, N = 35623054365536561. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteLinux 5.10.130Linux 5.15.83Linux 6.110K20K30K40K50KSE +/- 132.15, N = 3SE +/- 31.67, N = 3SE +/- 71.67, N = 34767645922452231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteLinux 5.10.130Linux 6.1Linux 5.15.838K16K24K32K40KSE +/- 59.40, N = 3SE +/- 91.02, N = 3SE +/- 99.01, N = 33850336109338241. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

srsRAN

srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAMLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.07, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3118.3117.3117.11. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.06, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3123.9123.3123.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAMLinux 5.15.83Linux 6.1Linux 5.10.130306090120150SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.13, N = 3128.0127.2126.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 4G PHY_DL_Test 100 PRB SISO 256-QAMLinux 5.15.83Linux 5.10.130Linux 6.1306090120150SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.15, N = 3131.6131.0130.31. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

OpenBenchmarking.orgUE Mb/s, More Is BettersrsRAN 22.04.1Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAMLinux 5.15.83Linux 6.1Linux 5.10.1301530456075SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 366.065.965.91. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -mavx512f -mavx512cd -mavx512bw -mavx512dq -lpthread -ldl -lm

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.32.6VGR Performance MetricLinux 6.1Linux 5.10.130Linux 5.15.8340K80K120K160K200K1683341677711668521. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -pthread -ldl -lm

ctx_clock

Ctx_clock is a simple test program to measure the context switch time in clock cycles. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgClocks, Fewer Is Betterctx_clockContext Switch TimeLinux 5.10.130Linux 5.15.83Linux 6.14080120160200SE +/- 0.67, N = 3154179200

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.51681.03361.55042.06722.584SE +/- 0.00109, N = 3SE +/- 0.00305, N = 3SE +/- 0.00145, N = 32.293852.296362.29708MIN: 2.19MIN: 2.22MIN: 2.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.1300.69781.39562.09342.79123.489SE +/- 0.01196, N = 3SE +/- 0.00478, N = 3SE +/- 0.00480, N = 33.085613.094333.10144MIN: 3.05MIN: 3.06MIN: 3.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.11190.22380.33570.44760.5595SE +/- 0.000232, N = 3SE +/- 0.000335, N = 3SE +/- 0.000206, N = 30.4966130.4967760.497248MIN: 0.48MIN: 0.48MIN: 0.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.28190.56380.84571.12761.4095SE +/- 0.00376, N = 3SE +/- 0.00241, N = 3SE +/- 0.00257, N = 31.248711.251741.25271MIN: 1.21MIN: 1.22MIN: 1.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.830.97021.94042.91063.88084.851SE +/- 0.00632, N = 3SE +/- 0.00912, N = 3SE +/- 0.01348, N = 34.286184.291534.31178MIN: 4.24MIN: 4.25MIN: 4.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.11.12072.24143.36214.48285.6035SE +/- 0.01724, N = 3SE +/- 0.01367, N = 3SE +/- 0.02580, N = 34.706994.708344.98067MIN: 4.43MIN: 4.4MIN: 4.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.74531.49062.23592.98123.7265SE +/- 0.00438, N = 3SE +/- 0.00465, N = 3SE +/- 0.00768, N = 33.296333.306063.31244MIN: 3.27MIN: 3.27MIN: 3.261. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.94581.89162.83743.78324.729SE +/- 0.01257, N = 3SE +/- 0.00677, N = 3SE +/- 0.00929, N = 34.158694.180964.20343MIN: 4.09MIN: 4.13MIN: 4.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.10.12180.24360.36540.48720.609SE +/- 0.000263, N = 3SE +/- 0.000704, N = 3SE +/- 0.000200, N = 30.5404520.5406540.541430MIN: 0.53MIN: 0.53MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPULinux 6.1Linux 5.15.83Linux 5.10.1300.19160.38320.57480.76640.958SE +/- 0.003867, N = 3SE +/- 0.010105, N = 3SE +/- 0.006451, N = 30.8318660.8465430.851455MIN: 0.81MIN: 0.82MIN: 0.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.130060090012001500SE +/- 0.39, N = 3SE +/- 0.83, N = 3SE +/- 0.44, N = 31611.141613.121614.07MIN: 1608.25MIN: 1608.28MIN: 1609.861. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPULinux 6.1Linux 5.10.130Linux 5.15.832004006008001000SE +/- 1.41, N = 3SE +/- 2.14, N = 3SE +/- 1.01, N = 3909.15909.63912.07MIN: 904.93MIN: 903.56MIN: 908.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 6.1Linux 5.10.13030060090012001500SE +/- 3.87, N = 3SE +/- 1.70, N = 3SE +/- 2.14, N = 31614.871618.861621.84MIN: 1607.67MIN: 1614.3MIN: 1617.111. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPULinux 5.15.83Linux 5.10.130Linux 6.12004006008001000SE +/- 0.73, N = 3SE +/- 1.27, N = 3SE +/- 2.67, N = 3908.19911.82913.94MIN: 904.52MIN: 907.5MIN: 907.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPULinux 5.10.130Linux 5.15.83Linux 6.10.21680.43360.65040.86721.084SE +/- 0.001517, N = 3SE +/- 0.003629, N = 3SE +/- 0.002932, N = 30.9563990.9616820.963400MIN: 0.93MIN: 0.93MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPULinux 5.10.130Linux 6.1Linux 5.15.830.07110.14220.21330.28440.3555SE +/- 0.000694, N = 3SE +/- 0.000082, N = 3SE +/- 0.001833, N = 30.3132380.3139750.316005MIN: 0.3MIN: 0.3MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl

OSPRay Studio

Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.15.83Linux 6.1Linux 5.10.13015003000450060007500SE +/- 1.45, N = 3SE +/- 10.90, N = 37046704870551. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 6.1Linux 5.15.8316003200480064008000SE +/- 2.33, N = 3SE +/- 2.52, N = 3SE +/- 3.79, N = 37242724572461. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.12K4K6K8K10KSE +/- 5.51, N = 3SE +/- 9.45, N = 38628863386331. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 26.43, N = 3SE +/- 135.52, N = 3SE +/- 1530.19, N = 51214671214861230001. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.150K100K150K200K250KSE +/- 19.15, N = 3SE +/- 254.40, N = 3SE +/- 262.34, N = 32341422342162343711. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.130K60K90K120K150KSE +/- 68.75, N = 3SE +/- 104.41, N = 3SE +/- 1877.65, N = 31244281245561263411. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.150K100K150K200K250KSE +/- 103.12, N = 3SE +/- 62.00, N = 3SE +/- 131.54, N = 32399352403112404301. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.130K60K90K120K150KSE +/- 69.67, N = 3SE +/- 58.33, N = 3SE +/- 27.67, N = 31465701465831466921. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.8360K120K180K240K300KSE +/- 92.98, N = 3SE +/- 239.39, N = 3SE +/- 192.14, N = 32842352846992848531. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.1400800120016002000SE +/- 0.67, N = 3SE +/- 1.33, N = 3SE +/- 0.58, N = 31778177817791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.83400800120016002000SE +/- 1.00, N = 3SE +/- 1.15, N = 3SE +/- 0.67, N = 31824182618261. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerLinux 6.1Linux 5.15.83Linux 5.10.1305001000150020002500SE +/- 0.58, N = 3SE +/- 0.67, N = 32173217621781. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 5.10.130Linux 5.15.83Linux 6.16K12K18K24K30KSE +/- 8.11, N = 3SE +/- 21.40, N = 3SE +/- 9.70, N = 32840928417284791. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.114K28K42K56K70KSE +/- 20.81, N = 3SE +/- 37.27, N = 3SE +/- 527.74, N = 36524265271658941. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.836K12K18K24K30KSE +/- 28.26, N = 3SE +/- 5.24, N = 32916529172292061. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.115K30K45K60K75KSE +/- 44.92, N = 3SE +/- 35.09, N = 3SE +/- 539.86, N = 146681766823678371. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerLinux 6.1Linux 5.10.130Linux 5.15.837K14K21K28K35KSE +/- 5.29, N = 3SE +/- 21.06, N = 3SE +/- 4.51, N = 33477934786348011. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerLinux 5.15.83Linux 5.10.130Linux 6.120K40K60K80K100KSE +/- 75.54, N = 3SE +/- 96.91, N = 3SE +/- 964.72, N = 67799778016798041. (CXX) g++ options: -O3 -lm -ldl -lpthread -pthread

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1300.04840.09680.14520.19360.242SE +/- 0.001, N = 3SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1910.1940.2151. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1300.13590.27180.40770.54360.6795SE +/- 0.006, N = 3SE +/- 0.000, N = 3SE +/- 0.004, N = 30.5130.5260.6041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyLinux 6.1Linux 5.15.83Linux 5.10.1300.30380.60760.91141.21521.519SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 31.0701.1731.3501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyLinux 5.15.83Linux 6.1Linux 5.10.1300.41940.83881.25821.67762.097SE +/- 0.004, N = 3SE +/- 0.003, N = 3SE +/- 0.005, N = 31.7791.8391.8641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 5.15.83Linux 6.11.24382.48763.73144.97526.219SE +/- 0.015, N = 3SE +/- 0.004, N = 3SE +/- 0.009, N = 35.2445.4445.5281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyLinux 5.10.130Linux 6.1Linux 5.15.8348121620SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 312.9913.8514.781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm

Mobile Neural Network

MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. This MNN test profile is building the OpenMP / CPU threaded version for processor benchmarking and not any GPU-accelerated test. MNN does allow making use of AVX-512 extensions. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetLinux 5.15.83Linux 5.10.130Linux 6.148121620SE +/- 0.10, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 914.8814.9115.12MIN: 14.51 / MAX: 33.86MIN: 14.46 / MAX: 28.47MIN: 14.55 / MAX: 29.561. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3Linux 5.15.83Linux 6.1Linux 5.10.1300.47050.9411.41151.8822.3525SE +/- 0.009, N = 3SE +/- 0.009, N = 9SE +/- 0.010, N = 32.0712.0832.091MIN: 1.99 / MAX: 4.73MIN: 1.98 / MAX: 6.07MIN: 1.99 / MAX: 3.261. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1Linux 5.15.83Linux 5.10.130Linux 6.10.58641.17281.75922.34562.932SE +/- 0.015, N = 3SE +/- 0.020, N = 3SE +/- 0.012, N = 92.5372.5922.606MIN: 2.47 / MAX: 4.14MIN: 2.48 / MAX: 5.22MIN: 2.49 / MAX: 16.461. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50Linux 5.15.83Linux 6.1Linux 5.10.1303691215SE +/- 0.025, N = 3SE +/- 0.037, N = 9SE +/- 0.099, N = 39.8509.93210.148MIN: 9.74 / MAX: 31.53MIN: 9.74 / MAX: 23.92MIN: 9.88 / MAX: 23.71. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0Linux 5.10.130Linux 5.15.83Linux 6.11.1182.2363.3544.4725.59SE +/- 0.043, N = 3SE +/- 0.009, N = 3SE +/- 0.019, N = 94.8924.8974.969MIN: 4.79 / MAX: 17.74MIN: 4.84 / MAX: 18.25MIN: 4.87 / MAX: 7.191. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224Linux 5.15.83Linux 6.1Linux 5.10.1300.86741.73482.60223.46964.337SE +/- 0.020, N = 3SE +/- 0.020, N = 9SE +/- 0.007, N = 33.7523.8313.855MIN: 3.56 / MAX: 17.6MIN: 3.59 / MAX: 5.87MIN: 3.65 / MAX: 16.531. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0Linux 5.15.83Linux 6.1Linux 5.10.1300.60261.20521.80782.41043.013SE +/- 0.047, N = 3SE +/- 0.028, N = 9SE +/- 0.044, N = 32.6392.6402.678MIN: 2.38 / MAX: 3.73MIN: 2.36 / MAX: 16.9MIN: 2.4 / MAX: 5.221. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3Linux 5.15.83Linux 5.10.130Linux 6.1510152025SE +/- 0.38, N = 3SE +/- 0.36, N = 3SE +/- 0.32, N = 922.4422.7322.79MIN: 21.58 / MAX: 36.88MIN: 22.05 / MAX: 36.04MIN: 21.59 / MAX: 102.891. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

NCNN

NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mobilenetLinux 6.1Linux 5.10.130Linux 5.15.8348121620SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 614.4514.5414.71MIN: 14.31 / MAX: 15.47MIN: 14.37 / MAX: 17.06MIN: 14.26 / MAX: 15.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v2-v2 - Model: mobilenet-v2Linux 5.15.83Linux 5.10.130Linux 6.11.25332.50663.75995.01326.2665SE +/- 0.01, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 35.535.565.57MIN: 5.41 / MAX: 10.99MIN: 5.44 / MAX: 6.03MIN: 5.49 / MAX: 6.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU-v3-v3 - Model: mobilenet-v3Linux 5.10.130Linux 5.15.83Linux 6.11.11382.22763.34144.45525.569SE +/- 0.01, N = 3SE +/- 0.04, N = 6SE +/- 0.01, N = 34.954.954.95MIN: 4.85 / MAX: 5.91MIN: 4.8 / MAX: 63.45MIN: 4.86 / MAX: 5.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: shufflenet-v2Linux 5.15.83Linux 6.1Linux 5.10.1301.27352.5473.82055.0946.3675SE +/- 0.01, N = 6SE +/- 0.01, N = 3SE +/- 0.02, N = 35.595.635.66MIN: 5.48 / MAX: 6.6MIN: 5.53 / MAX: 6.55MIN: 5.54 / MAX: 17.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetLinux 5.15.83Linux 6.1Linux 5.10.1301.10482.20963.31444.41925.524SE +/- 0.00, N = 6SE +/- 0.01, N = 3SE +/- 0.03, N = 34.854.894.91MIN: 4.72 / MAX: 7.62MIN: 4.81 / MAX: 5.21MIN: 4.74 / MAX: 16.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0Linux 5.15.83Linux 6.1Linux 5.10.130246810SE +/- 0.01, N = 6SE +/- 0.01, N = 3SE +/- 0.02, N = 36.997.047.06MIN: 6.89 / MAX: 8.15MIN: 6.92 / MAX: 7.34MIN: 6.92 / MAX: 7.421. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceLinux 5.15.83Linux 6.1Linux 5.10.1300.53551.0711.60652.1422.6775SE +/- 0.00, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 32.292.362.38MIN: 2.23 / MAX: 3.1MIN: 2.3 / MAX: 2.62MIN: 2.2 / MAX: 2.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetLinux 5.15.83Linux 6.1Linux 5.10.1303691215SE +/- 0.02, N = 6SE +/- 0.02, N = 3SE +/- 0.05, N = 311.4611.4811.57MIN: 11.27 / MAX: 12.43MIN: 11.33 / MAX: 12.45MIN: 11.39 / MAX: 11.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vgg16Linux 6.1Linux 5.10.130Linux 5.15.83714212835SE +/- 0.10, N = 3SE +/- 0.13, N = 3SE +/- 1.00, N = 626.5226.9527.69MIN: 26.22 / MAX: 27.61MIN: 26.65 / MAX: 27.51MIN: 26.21 / MAX: 33.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet18Linux 6.1Linux 5.15.83Linux 5.10.130246810SE +/- 0.01, N = 3SE +/- 0.22, N = 6SE +/- 0.04, N = 37.858.058.09MIN: 7.74 / MAX: 10.2MIN: 7.68 / MAX: 9.97MIN: 7.89 / MAX: 9.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: alexnetLinux 5.10.130Linux 6.1Linux 5.15.831.2332.4663.6994.9326.165SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 65.465.465.48MIN: 5.35 / MAX: 5.85MIN: 5.35 / MAX: 9.83MIN: 5.3 / MAX: 6.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50Linux 6.1Linux 5.10.130Linux 5.15.8348121620SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 613.8314.2014.21MIN: 13.51 / MAX: 26.19MIN: 13.99 / MAX: 15.03MIN: 13.45 / MAX: 157.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: yolov4-tinyLinux 6.1Linux 5.10.130Linux 5.15.83612182430SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.39, N = 623.3523.6023.89MIN: 23.01 / MAX: 26.25MIN: 23.16 / MAX: 27.3MIN: 22.91 / MAX: 31.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: squeezenet_ssdLinux 6.1Linux 5.15.83Linux 5.10.13048121620SE +/- 0.14, N = 3SE +/- 0.12, N = 6SE +/- 0.12, N = 316.7616.8517.13MIN: 16.41 / MAX: 17.26MIN: 16.41 / MAX: 19.23MIN: 16.75 / MAX: 17.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mLinux 5.15.83Linux 6.1Linux 5.10.130510152025SE +/- 0.02, N = 6SE +/- 0.03, N = 3SE +/- 0.15, N = 318.6718.7018.83MIN: 18.39 / MAX: 21.55MIN: 18.43 / MAX: 19.5MIN: 18.43 / MAX: 58.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerLinux 5.10.130Linux 6.1Linux 5.15.834080120160200SE +/- 0.96, N = 3SE +/- 0.61, N = 3SE +/- 0.40, N = 6160.27160.39161.23MIN: 158.5 / MAX: 166.42MIN: 158.59 / MAX: 172.13MIN: 158.43 / MAX: 179.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetLinux 5.15.83Linux 6.1Linux 5.10.130246810SE +/- 0.02, N = 6SE +/- 0.02, N = 3SE +/- 0.03, N = 36.916.967.02MIN: 6.78 / MAX: 7.67MIN: 6.86 / MAX: 7.19MIN: 6.87 / MAX: 7.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPULinux 5.15.83Linux 6.1Linux 5.10.13030060090012001500SE +/- 8.21, N = 3SE +/- 5.43, N = 3SE +/- 7.68, N = 31356.351357.101357.37MIN: 1238.64 / MAX: 1424.43MIN: 1311.47 / MAX: 1435.45MIN: 1303.04 / MAX: 1429.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.79, N = 3SE +/- 6.63, N = 3SE +/- 4.48, N = 32400.022401.742415.31MIN: 1971.05 / MAX: 2519.43MIN: 2074.14 / MAX: 2532.54MIN: 2186.01 / MAX: 2533.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.15001000150020002500SE +/- 6.93, N = 3SE +/- 9.26, N = 3SE +/- 5.75, N = 32436.302441.672451.10MIN: 2086.23 / MAX: 2572.2MIN: 2123.66 / MAX: 2621.99MIN: 2080.43 / MAX: 2583.811. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.1714212835SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 329.2929.3729.86MIN: 13.39 / MAX: 49.34MIN: 11.56 / MAX: 50.23MIN: 11.2 / MAX: 55.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.13090180270360450SE +/- 0.59, N = 3SE +/- 0.53, N = 3SE +/- 0.17, N = 3416.16416.95417.71MIN: 211.14 / MAX: 443.45MIN: 240.72 / MAX: 434.4MIN: 260.74 / MAX: 433.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPULinux 5.10.130Linux 6.1Linux 5.15.83246810SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.248.338.34MIN: 4.42 / MAX: 23.84MIN: 4.48 / MAX: 25.96MIN: 4.49 / MAX: 23.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1612182430SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 325.5325.6225.73MIN: 13.67 / MAX: 47.14MIN: 14.62 / MAX: 46.69MIN: 14.41 / MAX: 47.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.1306090120150SE +/- 1.34, N = 3SE +/- 0.46, N = 3SE +/- 0.78, N = 3123.34124.34124.97MIN: 64 / MAX: 136.84MIN: 64.41 / MAX: 139.86MIN: 64.13 / MAX: 142.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.1246810SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.018.028.02MIN: 5.89 / MAX: 26.32MIN: 4.07 / MAX: 22.04MIN: 6 / MAX: 25.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPULinux 6.1Linux 5.15.83Linux 5.10.13048121620SE +/- 0.15, N = 11SE +/- 0.16, N = 3SE +/- 0.14, N = 1316.2716.4616.47MIN: 7.67 / MAX: 36.05MIN: 9.28 / MAX: 33.36MIN: 7.86 / MAX: 36.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPULinux 5.15.83Linux 5.10.130Linux 6.10.2340.4680.7020.9361.17SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 31.031.041.04MIN: 0.61 / MAX: 17.94MIN: 0.61 / MAX: 17.55MIN: 0.61 / MAX: 17.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPULinux 5.10.130Linux 5.15.83Linux 6.10.11480.22960.34440.45920.574SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.500.500.51MIN: 0.31 / MAX: 16.57MIN: 0.31 / MAX: 28.92MIN: 0.32 / MAX: 15.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux 5.10.130Linux 5.15.83Linux 6.1160320480640800