Call Depth Tracking mitigation benchmarks by Michael Larabel for a future article.
Default - IBRS Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
retbleed=stuff Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Stuffing + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
mitigations=off Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: vulnerable + mds: Vulnerable; SMT vulnerable + meltdown: Vulnerable + mmio_stale_data: Vulnerable + retbleed: Vulnerable + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled PBRSB-eIBRS: Not affected + srbds: Vulnerable + tsx_async_abort: Mitigation of TSX disabled
retbleed=off Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: VA2431, Network: Intel I219-V
OS: Ubuntu 20.04, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0), Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
Retbleed Call Depth Tracking Skylake OpenBenchmarking.org Phoronix Test Suite Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads) MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS) Intel Xeon E3-1200 v5/E3-1500 32GB 256GB TOSHIBA RD400 ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP Realtek ALC1150 VA2431 Intel I219-V Ubuntu 20.04 6.1.0-phx (x86_64) GNOME Shell 3.36.9 X Server 1.20.13 4.5 Mesa 21.2.6 (LLVM 12.0.0) GCC 9.4.0 ext4 1920x1080 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution Retbleed Call Depth Tracking Skylake Benchmarks System Logs - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - NONE / errors=remount-ro,relatime,rw / Block Size: 4096 - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1 - OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04) - Python 3.8.10 - Default - IBRS: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled - retbleed=stuff: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Stuffing + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled - mitigations=off: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: vulnerable + mds: Vulnerable; SMT vulnerable + meltdown: Vulnerable + mmio_stale_data: Vulnerable + retbleed: Vulnerable + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled PBRSB-eIBRS: Not affected + srbds: Vulnerable + tsx_async_abort: Mitigation of TSX disabled - retbleed=off: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
Default - IBRS retbleed=stuff mitigations=off retbleed=off Logarithmic Result Overview Phoronix Test Suite Hackbench ctx_clock Sockperf PostMark KeyDB Natron Stress-NG OSBench Memcached EnCodec nginx JPEG XL Decoding libjxl Facebook RocksDB JPEG XL libjxl Dragonflydb Mobile Neural Network memtier_benchmark Timed Erlang/OTP Compilation Timed Linux Kernel Compilation GraphicsMagick Renaissance PostgreSQL NCNN ClickHouse Timed PHP Compilation MariaDB Redis DaCapo Benchmark CockroachDB Selenium Timed Node.js Compilation Unpacking The Linux Kernel Apache Spark Timed CPython Compilation libavif avifenc LuaRadio SVT-AV1 OpenRadioss 7-Zip Compression oneDNN FLAC Audio Encoding Numenta Anomaly Benchmark rav1e OpenFOAM WebP2 Image Encode Neural Magic DeepSparse BRL-CAD WebP Image Encode Stargate Digital Audio Workstation Cpuminer-Opt OpenVINO miniBUDE srsRAN Blender SMHasher nekRS Xmrig OpenVKL
Retbleed Call Depth Tracking Skylake unpack-linux: linux-5.19.tar.xz postmark: Disk Transaction Performance sockperf: Throughput sockperf: Latency Ping Pong osbench: Create Files osbench: Create Threads osbench: Launch Programs osbench: Create Processes osbench: Memory Allocations minibude: OpenMP - BM1 minibude: OpenMP - BM1 smhasher: wyhash smhasher: wyhash smhasher: SHA3-256 smhasher: SHA3-256 smhasher: Spooky32 smhasher: Spooky32 smhasher: fasthash32 smhasher: fasthash32 smhasher: FarmHash128 smhasher: FarmHash128 smhasher: t1ha2_atonce smhasher: t1ha2_atonce smhasher: FarmHash32 x86_64 AVX smhasher: FarmHash32 x86_64 AVX smhasher: t1ha0_aes_avx2 x86_64 smhasher: t1ha0_aes_avx2 x86_64 smhasher: MeowHash x86_64 AES-NI smhasher: MeowHash x86_64 AES-NI nekrs: TurboPipe Periodic openfoam: drivaerFastback, Small Mesh Size - Mesh Time openfoam: drivaerFastback, Small Mesh Size - Execution Time openradioss: Bumper Beam openradioss: Cell Phone Drop Test openradioss: Bird Strike on Windshield openradioss: Rubber O-Ring Seal Installation openradioss: INIVOL and Fluid Structure Interaction Drop Container xmrig: Monero - 1M xmrig: Wownero - 1M dacapobench: H2 dacapobench: Jython dacapobench: Tradesoap dacapobench: Tradebeans renaissance: Scala Dotty renaissance: Rand Forest renaissance: ALS Movie Lens renaissance: Apache Spark ALS renaissance: Apache Spark Bayes renaissance: Savina Reactors.IO renaissance: Apache Spark PageRank renaissance: Finagle HTTP Requests renaissance: In-Memory Database Shootout renaissance: Akka Unbalanced Cobwebbed Tree renaissance: Genetic Algorithm Using Jenetics + Futures jpegxl: PNG - 80 jpegxl: PNG - 90 jpegxl: JPEG - 80 jpegxl: JPEG - 90 jpegxl: PNG - 100 jpegxl: JPEG - 100 jpegxl-decode: 1 jpegxl-decode: All webp: Default webp: Quality 100 webp: Quality 100, Lossless webp: Quality 100, Highest Compression webp: Quality 100, Lossless, Highest Compression webp2: Default webp2: Quality 75, Compression Effort 7 webp2: Quality 95, Compression Effort 7 srsran: OFDM_Test srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 64-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM srsran: 4G PHY_DL_Test 100 PRB MIMO 256-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM srsran: 4G PHY_DL_Test 100 PRB SISO 256-QAM srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM srsran: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM luaradio: Five Back to Back FIR Filters luaradio: FM Deemphasis Filter luaradio: Hilbert Transform luaradio: Complex Phase graphics-magick: Swirl graphics-magick: Rotate graphics-magick: Sharpen graphics-magick: Enhanced graphics-magick: Resizing graphics-magick: Noise-Gaussian graphics-magick: HWB Color Space rav1e: 5 rav1e: 6 rav1e: 10 svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p openvkl: vklBenchmark ISPC openvkl: vklBenchmark Scalar compress-7zip: Compression Rating compress-7zip: Decompression Rating stargate: 44100 - 512 stargate: 96000 - 512 stargate: 44100 - 1024 stargate: 480000 - 512 stargate: 96000 - 1024 stargate: 480000 - 1024 avifenc: 0 avifenc: 2 avifenc: 6 avifenc: 6, Lossless avifenc: 10, Lossless build-linux-kernel: defconfig build-nodejs: Time To Compile build-php: Time To Compile build-python: Default build-python: Released Build, PGO + LTO Optimized onednn: IP Shapes 1D - f32 - CPU onednn: IP Shapes 3D - f32 - CPU onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU build-erlang: Time To Compile encode-flac: WAV To FLAC hackbench: 1 - Thread hackbench: 2 - Thread hackbench: 4 - Thread hackbench: 8 - Thread hackbench: 1 - Process hackbench: 16 - Thread hackbench: 2 - Process hackbench: 4 - Process hackbench: 8 - Process hackbench: 16 - Process cpuminer-opt: Magi cpuminer-opt: x25x cpuminer-opt: scrypt cpuminer-opt: Deepcoin cpuminer-opt: Ringcoin cpuminer-opt: Blake-2 S cpuminer-opt: Garlicoin cpuminer-opt: Skeincoin cpuminer-opt: Myriad-Groestl cpuminer-opt: LBC, LBRY Credits cpuminer-opt: Quad SHA-256, Pyrite cpuminer-opt: Triple SHA-256, Onecoin clickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cache clickhouse: 100M Rows Web Analytics Dataset, Second Run clickhouse: 100M Rows Web Analytics Dataset, Third Run spark: 1000000 - 100 - SHA-512 Benchmark Time spark: 1000000 - 100 - Calculate Pi Benchmark spark: 1000000 - 100 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 100 - Group By Test Time spark: 1000000 - 100 - Repartition Test Time spark: 1000000 - 100 - Inner Join Test Time spark: 1000000 - 100 - Broadcast Inner Join Test Time spark: 1000000 - 500 - SHA-512 Benchmark Time spark: 1000000 - 500 - Calculate Pi Benchmark spark: 1000000 - 500 - Calculate Pi Benchmark Using Dataframe spark: 1000000 - 500 - Group By Test Time spark: 1000000 - 500 - Repartition Test Time spark: 1000000 - 500 - Inner Join Test Time spark: 1000000 - 500 - Broadcast Inner Join Test Time cockroach: MoVR - 128 cockroach: MoVR - 256 cockroach: MoVR - 512 cockroach: KV, 10% Reads - 128 cockroach: KV, 10% Reads - 256 cockroach: KV, 10% Reads - 512 cockroach: KV, 50% Reads - 128 cockroach: KV, 50% Reads - 256 cockroach: KV, 50% Reads - 512 cockroach: KV, 60% Reads - 128 cockroach: KV, 60% Reads - 256 cockroach: KV, 60% Reads - 512 cockroach: KV, 95% Reads - 128 cockroach: KV, 95% Reads - 256 cockroach: KV, 95% Reads - 512 dragonflydb: 50 - 1:5 dragonflydb: 50 - 5:1 dragonflydb: 200 - 1:1 dragonflydb: 200 - 1:5 dragonflydb: 200 - 5:1 memcached: 1:1 memcached: 1:5 memcached: 5:1 memcached: 1:10 redis: GET - 50 redis: SET - 50 keydb: mysqlslap: 8 mysqlslap: 16 pgbench: 1 - 1 - Read Only pgbench: 1 - 1 - Read Only - Average Latency pgbench: 1 - 1 - Read Write pgbench: 1 - 1 - Read Write - Average Latency pgbench: 1 - 50 - Read Only pgbench: 1 - 50 - Read Only - Average Latency pgbench: 1 - 100 - Read Only pgbench: 1 - 100 - Read Only - Average Latency pgbench: 1 - 50 - Read Write pgbench: 1 - 50 - Read Write - Average Latency pgbench: 100 - 1 - Read Only pgbench: 100 - 1 - Read Only - Average Latency pgbench: 1 - 100 - Read Write pgbench: 1 - 100 - Read Write - Average Latency pgbench: 100 - 1 - Read Write pgbench: 100 - 1 - Read Write - Average Latency pgbench: 100 - 50 - Read Only pgbench: 100 - 50 - Read Only - Average Latency pgbench: 100 - 100 - Read Only pgbench: 100 - 100 - Read Only - Average Latency pgbench: 100 - 50 - Read Write pgbench: 100 - 50 - Read Write - Average Latency pgbench: 100 - 100 - Read Write pgbench: 100 - 100 - Read Write - Average Latency deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream memtier-benchmark: Redis - 50 - 1:1 memtier-benchmark: Redis - 100 - 1:1 memtier-benchmark: Redis - 50 - 10:1 memtier-benchmark: Redis - 50 - 1:10 memtier-benchmark: Redis - 100 - 10:1 memtier-benchmark: Redis - 100 - 1:10 stress-ng: MMAP stress-ng: NUMA stress-ng: Futex stress-ng: MEMFD stress-ng: Mutex stress-ng: Atomic stress-ng: Crypto stress-ng: Malloc stress-ng: Forking stress-ng: SENDFILE stress-ng: CPU Cache stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Vector Math stress-ng: x86_64 RdRand stress-ng: Memory Copying stress-ng: Socket Activity stress-ng: Context Switching stress-ng: Glibc C String Functions stress-ng: Glibc Qsort Data Sorting stress-ng: System V Message Passing mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet blender: BMW27 - CPU-Only ctx-clock: Context Switch Time rocksdb: Rand Fill rocksdb: Rand Read rocksdb: Update Rand rocksdb: Seq Fill rocksdb: Rand Fill Sync rocksdb: Read While Writing rocksdb: Read Rand Write Rand numenta-nab: KNN CAD numenta-nab: Windowed Gaussian numenta-nab: Earthgecko Skyline numenta-nab: Contextual Anomaly Detector OSE nginx: 20 nginx: 100 nginx: 200 nginx: 500 nginx: 1000 nginx: 4000 natron: Spaceship selenium: Kraken - Firefox selenium: Jetstream 2 - Firefox selenium: PSPDFKit WASM - Firefox selenium: WASM imageConvolute - Firefox selenium: WASM collisionDetection - Firefox encodec: 3 kbps encodec: 6 kbps encodec: 24 kbps encodec: 1.5 kbps brl-cad: VGR Performance Metric openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 9.654 3275 338290 4.718 29.673016 25.280317 93.320211 47.050317 107.718388 125.419 5.017 20542.66 23.881 122.26 3226.919 12205.36 50.025 6164.11 36.388 13059.24 51.410 12505.38 34.007 20898.25 44.580 39760.79 33.713 32896.51 64.513 19263800000 89.670778 916.44205 412.01 308.94 735.24 565.84 1649.05 1429.8 2030.7 3763 4452 7114 4195 1142.4 849.9 22195.3 27451.4 3210.1 10635.9 4244.4 4310.6 4432.3 13903.1 2797.2 5.45 5.32 5.17 5.05 0.55 0.53 31.47 103.43 14.16 9.03 1.30 3.07 0.42 2.68 0.05 0.02 102366667 323.0 106.2 328.6 130.9 354.4 115.9 359.6 137.2 110.0 53.0 577.3 356.7 68.2 456.7 138 520 39 81 398 99 447 1.802 2.426 6.073 1.064 12.796 48.270 51.123 3.764 36.016 185.795 207.791 67 36 28096 22169 1.215741 0.859759 1.285265 1.181060 0.928978 1.241926 379.218 171.472 19.938 28.528 12.431 287.902 1783.492 142.630 37.535 442.216 7.68644 12.3700 20.9200 14.1430 14.4441 7409.45 3967.41 5.51332 220.868 21.655 13.045 27.976 59.167 108.746 12.806 221.696 25.052 52.230 107.092 217.355 97.92 156.44 72.55 3840.30 830.67 155060 1140.68 16360 5371.74 10550 19267 26697 74.87 76.82 79.54 5.90 441.23 24.54 5.40 3.69 3.58 3.14 6.49 436.79 24.33 6.14 3.98 4.05 3.38 106.9 108.5 108.1 6837.8 12182.1 13556.1 12263.7 15334.7 15417.9 14206.9 16214.1 15948.6 21848.0 21820.8 20258.0 902480.41 844039.71 893182.92 937232.81 865694.31 833888.75 827558.93 939991.36 823970.81 3367879.17 2315119.83 111189.18 283 258 20037 0.05 197 5.085 102394 0.488 102099 0.979 266 188.242 19939 0.050 248 402.584 188 5.322 99895 0.501 99837 1.002 3916 12.768 4633 21.590 3.1939 626.1738 3.0824 324.4131 11.5044 173.8218 10.3600 96.5129 17.4858 114.3522 17.4239 57.3753 36.6421 54.5595 34.8083 28.7152 27.5446 72.5893 24.1767 41.3519 13.9753 143.0892 12.2294 81.7593 3.1951 625.9283 3.0994 322.6335 1175178.96 1360130.93 1109992.57 1231773.00 1291653.16 1372487.30 20.39 63.58 830087.70 112.42 745688.97 180741.36 4815.30 388441.98 13111.86 54816.64 158.46 7987.29 699438.78 18152.96 14401.85 4462.86 850.74 2586.50 924510.28 243451.44 55.55 2107608.22 16.571 2.240 4.492 41.054 6.662 4.622 4.570 46.874 22.12 6.54 5.27 4.21 5.10 10.18 1.29 16.86 78.30 14.37 11.71 31.84 32.51 22.95 13.55 422.28 5.38 369.61 2823 376107 17559091 198089 509051 674 721604 640561 423.219 20.206 262.976 92.521 23974.25 23838.53 23460.51 22618.36 21713.79 21430.71 1.2 1250.0 85.239 3438 33.2 600.1 65.367 66.949 78.023 64.156 50086 1.2 3306.20 0.73 5354.18 0.73 5351.08 86.02 46.50 2.22 1797.13 136.56 29.27 113.01 35.4 13.20 302.54 218.59 18.28 157.85 25.32 2662.48 1.48 2968.92 1.32 9.641 4076 402526 4.270 26.498332 23.783843 85.820357 43.423176 93.203227 125.432 5.017 20125.38 24.103 122.13 3226.727 12211.48 50.268 6164.44 36.392 13103.28 51.406 12566.66 34.300 20869.88 42.436 38438.77 33.700 32807.20 64.482 19226766667 89.594193 913.50205 404.13 307.34 732.52 559.22 1633.50 1428.6 2031.1 3538 4441 7028 3878 1141.5 834.5 19597.7 23571.8 3177.8 9115.4 4158.8 4122.2 4200.6 12739.7 2086.6 6.03 5.88 5.74 5.6 0.56 0.55 34.88 114.19 14.21 9.09 1.31 3.09 0.42 2.71 0.05 0.02 102400000 321.9 105.4 329.2 130.9 353.7 115.8 359.0 137.1 110.4 53.1 576.2 357.0 68.7 458.7 139 615 39 82 403 102 518 1.799 2.448 6.144 1.068 12.924 48.756 51.928 3.776 36.260 189.070 212.118 67 36 28507 22160 1.217403 0.856760 1.284939 1.181143 0.926504 1.251187 380.581 171.568 19.764 28.087 11.852 271.329 1748.868 138.065 36.71 438.599 7.69614 12.2528 20.9171 14.0598 14.4752 7409.07 3968.47 5.48338 207.353 21.437 10.577 21.557 41.521 81.927 9.876 167.704 19.164 39.089 80.426 166.813 99.40 157.79 72.71 3840.87 822.67 155900 1153.43 16347 5400.62 10590 19097 27213 78.18 81.37 81.55 5.93 439.91 24.16 5.18 3.54 3.56 2.99 6.11 437.77 24.18 5.88 3.74 4.03 3.34 111.7 111.9 112.0 7257.6 12888.4 14251.3 13101.0 16052.6 16043.6 15153.9 17025.6 16550.4 22736.1 22382.3 20766.5 1068334.75 927313.86 942396.75 998481.69 898246.15 891561.78 883794.56 1053867.93 885942.92 3089573.83 2289592.50 128725.84 295 270 20179 0.050 200 4.999 111982 0.446 110671 0.903 279 179.102 20140 0.05 261 383.841 187 5.360 108308 0.461 107565 0.930 3753 13.323 4470 22.378 3.1621 632.3771 3.0464 328.2445 11.5245 173.5171 10.4323 95.8440 17.4051 114.8785 16.7678 59.6228 36.7359 54.4198 34.9242 28.6200 27.3999 72.9674 23.9930 41.6687 13.9119 143.7424 12.1905 82.0206 3.2032 624.3519 3.0946 323.1318 1232491.42 1447187.46 1180753.40 1286001.55 1319663.84 1440930.09 22.05 60.34 971383.12 106.29 1111966.01 182114.03 4817.25 603448.11 13778.46 52701.66 152.96 8039.91 721201.26 17799.14 14404.73 4492.76 834.84 3422.60 1035968.53 243636.88 55.86 3337126.74 15.896 2.058 4.358 39.584 6.483 4.489 4.501 45.846 21.75 6.29 4.99 3.91 4.85 9.83 1.11 16.54 78.38 14.25 11.66 31.50 32.31 22.55 11.75 421.62 5.03 368.09 1194 389753 17331836 218106 520166 664 759004 693910 410.611 20.234 264.629 92.427 25852.17 25553.05 24909.11 24113.33 22945.29 22968.36 0.7 1209.8 88.651 3319 33.1 596.8 55.984 56.781 66.186 54.662 50064 1.21 3287.93 0.73 5337.23 0.73 5339.56 85.95 46.53 2.22 1797.93 137.20 29.14 112.97 35.38 13.14 303.87 218.69 18.27 153.37 26.06 2703.22 1.46 3031.90 1.3 9.331 5859 690976 2.920 18.153880 18.166701 67.249139 34.507116 83.189328 124.910 4.996 20425.04 23.893 120.76 3270.418 12101.05 50.265 6165.80 36.799 13107.91 51.411 12500.30 34.034 20829.82 42.430 39559.81 33.694 32954.04 64.488 19262600000 89.417796 909.73859 398.01 306.77 729.94 553.46 1617.86 1430.4 2033.8 3630 4365 6728 3927 1150.8 819.7 18521.4 21755.3 3215.2 8754.1 4071.4 3809.8 3839.9 11106.7 2040.7 6.50 6.31 6.20 6.05 0.57 0.56 37.36 124.81 14.20 9.10 1.31 3.09 0.42 2.72 0.05 0.02 102366667 322.7 105.7 328.5 130.8 353.6 115.9 359.7 136.7 110.4 53.0 593.7 362.6 68.4 476.3 140 717 39 82 411 104 585 1.802 2.448 6.182 1.070 12.980 49.634 52.055 3.788 36.362 191.993 216.174 67 36 29055 22027 1.207418 0.857744 1.261311 1.183243 0.927538 1.251796 379.283 170.092 19.358 27.569 11.621 260.622 1716.489 134.186 35.937 435.078 7.69350 12.3382 20.9297 14.9097 14.5033 7405.60 3963.59 5.49579 198.222 21.387 7.955 15.101 23.654 44.484 6.497 101.210 11.358 21.653 43.546 95.568 98.24 156.26 72.64 3858.75 827.69 155063 1140.86 16353 5411.58 10577 19299 26723 80.13 83.14 83.60 5.63 441.21 24.00 5.03 3.51 3.53 3.19 5.89 436.93 24.89 5.70 3.71 3.90 3.36 111.4 111.2 111.6 7068.9 12714.4 14119.5 12637.0 16279.6 16312.1 14750.1 17086.4 16635.8 23352.3 23274.7 21346.1 1108896.91 979021.51 1004168.04 1037459.90 939884.95 1157720.20 1159234.39 1290274.48 1198373.90 3171723.17 2321265.75 195756.15 288 269 21888 0.046 202 4.961 126512 0.395 122433 0.817 278 179.918 20598 0.048 263 380.446 187 5.356 120818 0.414 121544 0.823 3645 13.717 4429 22.592 3.1666 631.5886 3.0587 326.9267 11.2716 177.2624 10.3743 96.3788 17.3925 114.9580 16.7560 59.6635 36.7410 54.4129 34.9336 28.6123 27.4149 72.9335 24.0175 41.6268 13.9388 143.4642 12.1937 81.9995 3.1923 626.4861 3.0682 325.9226 1481936.11 1422407.47 1288891.75 1403515.54 1341587.32 1485496.09 26.88 69.78 1440190.04 114.07 2131852.03 180081.27 4816.67 1165429.65 17166.22 76342.18 157.33 8179.85 755001.97 18017.30 14411.60 194722.99 834.50 4834.07 1563150.01 240956.56 55.82 6558503.53 14.194 1.797 3.874 35.444 6.124 4.233 4.421 43.406 21.56 6.11 4.84 3.74 4.68 9.60 0.99 16.29 78.26 14.12 11.56 31.29 32.19 22.35 10.61 413.10 4.80 368.7 230 492900 17471957 252250 687932 663 735461 750817 402.725 19.973 262.707 93.694 30466.92 29875.46 28879.67 27769.28 26356.08 26090.31 0.7 1185.1 90.050 3237 33.2 597.0 49.645 50.372 58.604 48.263 50104 1.21 3278.21 0.74 5313.90 0.73 5323.79 85.47 46.78 2.22 1798.30 136.24 29.34 113.00 35.38 13.18 303.09 218.83 18.26 150.46 26.57 2689.53 1.47 3056.03 1.29 9.472 4807 533313 3.611 20.921801 19.780000 74.868202 38.244724 89.004676 125.450 5.018 20525.16 24.148 122.25 3232.773 12124.07 50.028 6164.71 36.390 12611.70 51.409 12753.07 34.006 20433.25 43.303 39619.03 34.518 32887.58 64.487 19250000000 90.518025 910.87422 403.77 307.30 731.86 557.08 1626.25 1428.3 2029.0 3686 4234 6962 3923 1215.9 825.6 19637.6 23525.6 3140.9 9170.9 4017.6 3966.8 4037.2 12396.2 2069.5 6.24 6.06 5.94 5.79 0.56 0.55 35.84 120.77 14.25 9.12 1.31 3.08 0.42 2.71 0.05 0.02 102133333 320.8 105.4 327.1 129.4 354.7 115.2 359.9 137.2 109.5 52.9 593.0 362.3 68.4 474.6 140 654 39 82 410 103 551 1.818 2.435 6.182 1.069 12.968 49.046 52.171 3.781 36.342 190.252 212.544 67 36 28953 22114 1.217322 0.859412 1.286789 1.181881 0.929955 1.251774 377.401 169.839 19.487 27.854 11.744 266.835 1734.971 136.236 36.564 436.203 7.68653 12.3253 20.9145 13.5353 14.5017 7405.04 3961.26 5.46550 204.107 21.462 8.970 18.291 33.502 69.701 8.303 142.981 16.128 33.163 68.064 143.008 98.31 157.18 72.61 3845.26 820.72 153793 1144.59 16353 5374.93 10580 19100 26697 79.46 83.37 82.35 5.69 439.84 24.20 5.09 3.51 3.52 2.98 6.29 436.316232958 24.24 5.84 3.68 4.02 3.44 105.8 105.9 111.6 7123.9 12830.4 14248.2 12798.2 16169.5 16356.3 15102.3 17196.3 16712.8 23189.1 22888.9 21086.8 1085041.59 966283.04 987881.72 1033004.97 928724.15 1035956.62 1044494.53 1147643.61 1057571.99 3096924.8 2323685.50 154975.58 296 272 20390 0.049 203 4.927 115588 0.433 114303 0.875 282 177.361 20115 0.05 268 372.963 190 5.261 111247 0.450 111602 0.896 4083 12.249 5039 19.848 3.1660 631.7023 3.0623 326.5431 11.3638 175.9718 10.4500 95.6810 17.3667 115.1291 16.7158 59.8076 36.7551 54.3915 34.9308 28.6148 27.2657 73.3109 23.9973 41.6616 13.9442 143.4088 12.1873 82.0423 3.1945 626.0634 3.0656 326.1939 1329151.41 1410074.30 1220692.33 1317556.82 1329633.77 1499557.64 24.51 68.26 1156275.48 151.51 1285481.53 180772.46 4812.47 682715.71 15910.08 58646.53 153.84 7966.42 728080.34 18087.72 14384.51 4482.55 843.09 3720.58 1249349.81 243127.33 55.73 3767497.65 16.418 2.102 4.417 40.206 6.589 4.515 4.528 46.330 21.89 6.26 4.98 3.89 4.84 9.79 1.08 16.50 78.35 14.30 11.62 31.50 32.42 22.78 11.70 422.01 5.05 367.55 1181 456879 17542385 228194 613155 701 737668 712151 413.517 20.155 259.635 92.945 27933.18 27412.83 26593.58 25604.08 24256.31 24122.05 0.8 1199.5 88.460 3289 33.4 604.2 52.557 53.180 61.999 51.011 50358 1.21 3285.23 0.74 5325.14 0.73 5332.52 83.97 47.63 2.22 1798.51 137.21 29.14 112.88 35.41 13.24 301.63 218.56 18.29 158.52 25.22 2722.58 1.45 3051.91 1.29 OpenBenchmarking.org
PostMark This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance Default - IBRS retbleed=stuff mitigations=off retbleed=off 1300 2600 3900 5200 6500 SE +/- 14.33, N = 3 SE +/- 22.00, N = 3 SE +/- 46.33, N = 3 3275 4076 5859 4807 1. (CC) gcc options: -O3
Sockperf This is a network socket API performance benchmark developed by Mellanox. This test profile runs both the client and server on the local host for evaluating individual system performance. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Messages Per Second, More Is Better Sockperf 3.7 Test: Throughput Default - IBRS retbleed=stuff mitigations=off retbleed=off 150K 300K 450K 600K 750K SE +/- 3153.77, N = 5 SE +/- 3430.46, N = 25 SE +/- 8501.97, N = 25 SE +/- 6503.42, N = 5 338290 402526 690976 533313 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
OpenBenchmarking.org usec, Fewer Is Better Sockperf 3.7 Test: Latency Ping Pong Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.0616 2.1232 3.1848 4.2464 5.308 SE +/- 0.045, N = 5 SE +/- 0.051, N = 5 SE +/- 0.004, N = 5 SE +/- 0.009, N = 5 4.718 4.270 2.920 3.611 1. (CXX) g++ options: --param -O3 -rdynamic -ldl -lpthread
OSBench OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Files Default - IBRS retbleed=stuff mitigations=off retbleed=off 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 29.67 26.50 18.15 20.92 1. (CC) gcc options: -lm
OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Threads Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.23, N = 3 SE +/- 0.28, N = 3 SE +/- 0.11, N = 3 SE +/- 0.26, N = 3 25.28 23.78 18.17 19.78 1. (CC) gcc options: -lm
OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Launch Programs Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.17, N = 3 SE +/- 0.21, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 93.32 85.82 67.25 74.87 1. (CC) gcc options: -lm
OpenBenchmarking.org us Per Event, Fewer Is Better OSBench Test: Create Processes Default - IBRS retbleed=stuff mitigations=off retbleed=off 11 22 33 44 55 SE +/- 0.15, N = 3 SE +/- 0.11, N = 3 SE +/- 0.38, N = 3 SE +/- 0.51, N = 3 47.05 43.42 34.51 38.24 1. (CC) gcc options: -lm
OpenBenchmarking.org Ns Per Event, Fewer Is Better OSBench Test: Memory Allocations Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.20, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 107.72 93.20 83.19 89.00 1. (CC) gcc options: -lm
miniBUDE MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 125.42 125.43 124.91 125.45 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.1291 2.2582 3.3873 4.5164 5.6455 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 0.002, N = 3 SE +/- 0.001, N = 3 5.017 5.017 4.996 5.018 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
SMHasher SMHasher is a hash function tester supporting various algorithms and able to make use of AVX and other modern CPU instruction set extensions. Learn more via the OpenBenchmarking.org test page.
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: wyhash Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 227.26, N = 3 SE +/- 210.32, N = 15 SE +/- 200.08, N = 3 SE +/- 53.25, N = 3 20542.66 20125.38 20425.04 20525.16 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: wyhash Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.22, N = 15 SE +/- 0.01, N = 3 SE +/- 0.26, N = 3 23.88 24.10 23.89 24.15 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: SHA3-256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 1.74, N = 3 SE +/- 0.27, N = 3 122.26 122.13 120.76 122.25 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: SHA3-256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 700 1400 2100 2800 3500 SE +/- 0.08, N = 3 SE +/- 0.16, N = 3 SE +/- 44.34, N = 3 SE +/- 5.45, N = 3 3226.92 3226.73 3270.42 3232.77 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: Spooky32 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 10.25, N = 3 SE +/- 9.32, N = 3 SE +/- 38.37, N = 3 SE +/- 105.88, N = 3 12205.36 12211.48 12101.05 12124.07 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: Spooky32 Default - IBRS retbleed=stuff mitigations=off retbleed=off 11 22 33 44 55 SE +/- 0.00, N = 3 SE +/- 0.25, N = 3 SE +/- 0.24, N = 3 SE +/- 0.01, N = 3 50.03 50.27 50.27 50.03 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: fasthash32 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1300 2600 3900 5200 6500 SE +/- 1.21, N = 3 SE +/- 2.06, N = 3 SE +/- 1.39, N = 3 SE +/- 1.00, N = 3 6164.11 6164.44 6165.80 6164.71 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: fasthash32 Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.39, N = 3 SE +/- 0.00, N = 3 36.39 36.39 36.80 36.39 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: FarmHash128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 37.86, N = 3 SE +/- 6.91, N = 3 SE +/- 29.02, N = 3 SE +/- 141.54, N = 15 13059.24 13103.28 13107.91 12611.70 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: FarmHash128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 12 24 36 48 60 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 15 51.41 51.41 51.41 51.41 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: t1ha2_atonce Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 141.89, N = 3 SE +/- 155.43, N = 12 SE +/- 138.84, N = 15 SE +/- 56.28, N = 3 12505.38 12566.66 12500.30 12753.07 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: t1ha2_atonce Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.29, N = 12 SE +/- 0.03, N = 15 SE +/- 0.00, N = 3 34.01 34.30 34.03 34.01 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 91.06, N = 3 SE +/- 49.18, N = 3 SE +/- 68.95, N = 3 SE +/- 245.46, N = 15 20898.25 20869.88 20829.82 20433.25 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX Default - IBRS retbleed=stuff mitigations=off retbleed=off 10 20 30 40 50 SE +/- 2.16, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.56, N = 15 44.58 42.44 42.43 43.30 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: t1ha0_aes_avx2 x86_64 Default - IBRS retbleed=stuff mitigations=off retbleed=off 9K 18K 27K 36K 45K SE +/- 146.26, N = 3 SE +/- 329.62, N = 3 SE +/- 285.30, N = 3 SE +/- 312.62, N = 3 39760.79 38438.77 39559.81 39619.03 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: t1ha0_aes_avx2 x86_64 Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.82, N = 3 33.71 33.70 33.69 34.52 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
Result
OpenBenchmarking.org MiB/sec, More Is Better SMHasher 2022-08-22 Hash: MeowHash x86_64 AES-NI Default - IBRS retbleed=stuff mitigations=off retbleed=off 7K 14K 21K 28K 35K SE +/- 91.91, N = 3 SE +/- 20.33, N = 3 SE +/- 137.62, N = 3 SE +/- 31.93, N = 3 32896.51 32807.20 32954.04 32887.58 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread cycles/hash
OpenBenchmarking.org cycles/hash, Fewer Is Better SMHasher 2022-08-22 Hash: MeowHash x86_64 AES-NI Default - IBRS retbleed=stuff mitigations=off retbleed=off 14 28 42 56 70 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 64.51 64.48 64.49 64.49 1. (CXX) g++ options: -march=native -O3 -flto -fno-fat-lto-objects -lpthread
nekRS nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic Default - IBRS retbleed=stuff mitigations=off retbleed=off 4000M 8000M 12000M 16000M 20000M SE +/- 6547518.61, N = 3 SE +/- 26938345.24, N = 3 SE +/- 7918543.64, N = 3 SE +/- 11775822.69, N = 3 19263800000 19226766667 19262600000 19250000000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -pthread -lmpi_cxx -lmpi
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 89.67 89.59 89.42 90.52 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lphysicalProperties -lspecie -lfiniteVolume -lfvModels -lgenericPatchFields -lmeshTools -lsampling -lOpenFOAM -ldl -lm
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 200 400 600 800 1000 916.44 913.50 909.74 910.87 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lphysicalProperties -lspecie -lfiniteVolume -lfvModels -lgenericPatchFields -lmeshTools -lsampling -lOpenFOAM -ldl -lm
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam Default - IBRS retbleed=stuff mitigations=off retbleed=off 90 180 270 360 450 SE +/- 0.61, N = 3 SE +/- 0.31, N = 3 SE +/- 0.18, N = 3 SE +/- 0.41, N = 3 412.01 404.13 398.01 403.77
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Default - IBRS retbleed=stuff mitigations=off retbleed=off 70 140 210 280 350 SE +/- 0.54, N = 3 SE +/- 0.36, N = 3 SE +/- 0.38, N = 3 SE +/- 0.17, N = 3 308.94 307.34 306.77 307.30
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Default - IBRS retbleed=stuff mitigations=off retbleed=off 160 320 480 640 800 SE +/- 0.01, N = 3 SE +/- 0.53, N = 3 SE +/- 0.74, N = 3 SE +/- 0.27, N = 3 735.24 732.52 729.94 731.86
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Default - IBRS retbleed=stuff mitigations=off retbleed=off 120 240 360 480 600 SE +/- 0.10, N = 3 SE +/- 0.39, N = 3 SE +/- 0.05, N = 3 SE +/- 0.43, N = 3 565.84 559.22 553.46 557.08
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Default - IBRS retbleed=stuff mitigations=off retbleed=off 400 800 1200 1600 2000 SE +/- 6.44, N = 3 SE +/- 4.35, N = 3 SE +/- 0.41, N = 3 SE +/- 1.45, N = 3 1649.05 1633.50 1617.86 1626.25
Xmrig Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmlrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Monero - Hash Count: 1M Default - IBRS retbleed=stuff mitigations=off retbleed=off 300 600 900 1200 1500 SE +/- 0.41, N = 3 SE +/- 0.94, N = 3 SE +/- 1.27, N = 3 SE +/- 1.47, N = 3 1429.8 1428.6 1430.4 1428.3 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M Default - IBRS retbleed=stuff mitigations=off retbleed=off 400 800 1200 1600 2000 SE +/- 1.18, N = 3 SE +/- 1.62, N = 3 SE +/- 0.87, N = 3 SE +/- 2.44, N = 3 2030.7 2031.1 2033.8 2029.0 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 9.12-MR1 Java Test: Jython Default - IBRS retbleed=stuff mitigations=off retbleed=off 1000 2000 3000 4000 5000 SE +/- 50.46, N = 7 SE +/- 22.52, N = 4 SE +/- 51.90, N = 5 SE +/- 23.53, N = 4 4452 4441 4365 4234
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 9.12-MR1 Java Test: Tradesoap Default - IBRS retbleed=stuff mitigations=off retbleed=off 1500 3000 4500 6000 7500 SE +/- 50.45, N = 3 SE +/- 38.70, N = 4 SE +/- 49.58, N = 4 SE +/- 90.71, N = 4 7114 7028 6728 6962
OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 9.12-MR1 Java Test: Tradebeans Default - IBRS retbleed=stuff mitigations=off retbleed=off 900 1800 2700 3600 4500 SE +/- 56.91, N = 20 SE +/- 44.97, N = 20 SE +/- 50.26, N = 20 SE +/- 44.62, N = 20 4195 3878 3927 3923
Renaissance Renaissance is a suite of benchmarks designed to test the Java JVM from Apache Spark to a Twitter-like service to Scala and other features. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Scala Dotty Default - IBRS retbleed=stuff mitigations=off retbleed=off 300 600 900 1200 1500 SE +/- 4.99, N = 3 SE +/- 14.29, N = 15 SE +/- 16.88, N = 15 SE +/- 13.79, N = 3 1142.4 1141.5 1150.8 1215.9 MIN: 867.97 / MAX: 2211.31 MIN: 836.06 / MAX: 2372.4 MIN: 820.44 / MAX: 2321.46 MIN: 824.75 / MAX: 2207.54
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Random Forest Default - IBRS retbleed=stuff mitigations=off retbleed=off 200 400 600 800 1000 SE +/- 2.77, N = 3 SE +/- 3.59, N = 3 SE +/- 1.51, N = 3 SE +/- 4.60, N = 3 849.9 834.5 819.7 825.6 MIN: 707.65 / MAX: 1223.4 MIN: 712.17 / MAX: 1235.53 MIN: 700.08 / MAX: 1221.27 MIN: 699.38 / MAX: 1198.62
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: ALS Movie Lens Default - IBRS retbleed=stuff mitigations=off retbleed=off 5K 10K 15K 20K 25K SE +/- 10.16, N = 3 SE +/- 78.16, N = 3 SE +/- 104.72, N = 3 SE +/- 39.43, N = 3 22195.3 19597.7 18521.4 19637.6 MIN: 22175.14 / MAX: 24464.84 MIN: 19441.37 / MAX: 21708.22 MIN: 18335.77 / MAX: 20604.44 MIN: 19560.27 / MAX: 21682.59
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Apache Spark ALS Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 171.52, N = 3 SE +/- 337.23, N = 3 SE +/- 84.68, N = 3 SE +/- 116.97, N = 3 27451.4 23571.8 21755.3 23525.6 MIN: 26970.66 / MAX: 27928.53 MIN: 22927.95 / MAX: 24405.07 MIN: 21475.58 / MAX: 22054.88 MIN: 23177.22 / MAX: 23997.61
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Apache Spark Bayes Default - IBRS retbleed=stuff mitigations=off retbleed=off 700 1400 2100 2800 3500 SE +/- 43.03, N = 15 SE +/- 33.97, N = 7 SE +/- 43.55, N = 15 SE +/- 25.04, N = 15 3210.1 3177.8 3215.2 3140.9 MIN: 2206.57 / MAX: 3464.54 MIN: 2429.75 / MAX: 3365.98 MIN: 2315.41 / MAX: 3533.89 MIN: 2328.29 / MAX: 3358.6
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Savina Reactors.IO Default - IBRS retbleed=stuff mitigations=off retbleed=off 2K 4K 6K 8K 10K SE +/- 93.82, N = 3 SE +/- 146.02, N = 3 SE +/- 28.35, N = 3 SE +/- 126.82, N = 3 10635.9 9115.4 8754.1 9170.9 MIN: 10109.53 / MAX: 16338.05 MIN: 8944.48 / MAX: 13088.78 MIN: 8697.4 / MAX: 12208.1 MIN: 8933.81 / MAX: 12964.22
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Apache Spark PageRank Default - IBRS retbleed=stuff mitigations=off retbleed=off 900 1800 2700 3600 4500 SE +/- 23.20, N = 3 SE +/- 32.03, N = 3 SE +/- 2.22, N = 3 SE +/- 48.87, N = 3 4244.4 4158.8 4071.4 4017.6 MIN: 3945.79 / MAX: 4429.16 MIN: 3865.05 / MAX: 4442.02 MIN: 3791.67 / MAX: 4350.58 MIN: 3606.13 / MAX: 4304.31
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Finagle HTTP Requests Default - IBRS retbleed=stuff mitigations=off retbleed=off 900 1800 2700 3600 4500 SE +/- 7.61, N = 3 SE +/- 19.11, N = 3 SE +/- 36.43, N = 3 SE +/- 11.33, N = 3 4310.6 4122.2 3809.8 3966.8 MIN: 3653.96 / MAX: 6515.95 MIN: 3496.19 / MAX: 6318.23 MIN: 3207.35 / MAX: 5734.05 MIN: 3285.61 / MAX: 5723.05
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: In-Memory Database Shootout Default - IBRS retbleed=stuff mitigations=off retbleed=off 1000 2000 3000 4000 5000 SE +/- 32.38, N = 3 SE +/- 26.79, N = 3 SE +/- 12.21, N = 3 SE +/- 50.43, N = 4 4432.3 4200.6 3839.9 4037.2 MIN: 3880.98 / MAX: 5099.49 MIN: 3663.15 / MAX: 4744.43 MIN: 3364.72 / MAX: 4319.78 MIN: 3568.99 / MAX: 4384.41
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Akka Unbalanced Cobwebbed Tree Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 54.55, N = 3 SE +/- 30.85, N = 3 SE +/- 41.07, N = 3 SE +/- 92.58, N = 3 13903.1 12739.7 11106.7 12396.2 MIN: 10489.9 / MAX: 14005.14 MIN: 9693.86 / MAX: 12792.39 MIN: 8323.26 / MAX: 11185.64 MIN: 9295.02 / MAX: 12494.23
OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.14 Test: Genetic Algorithm Using Jenetics + Futures Default - IBRS retbleed=stuff mitigations=off retbleed=off 600 1200 1800 2400 3000 SE +/- 47.68, N = 3 SE +/- 6.73, N = 3 SE +/- 21.98, N = 3 SE +/- 4.33, N = 3 2797.2 2086.6 2040.7 2069.5 MIN: 2667.81 / MAX: 2893.34 MIN: 2049.58 / MAX: 2124.33 MIN: 1981.59 / MAX: 2119.04 MIN: 2035.71 / MAX: 2118.84
JPEG XL libjxl The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 80 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.45 6.03 6.50 6.24 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.32 5.88 6.31 6.06 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.17 5.74 6.20 5.94 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.05 5.60 6.05 5.79 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 100 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.1283 0.2566 0.3849 0.5132 0.6415 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.55 0.56 0.57 0.56 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.126 0.252 0.378 0.504 0.63 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.53 0.55 0.56 0.55 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -pthread -latomic
JPEG XL Decoding libjxl The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is suited for JPEG XL decode performance testing to PNG output file, the pts/jpexl test is for encode performance. The JPEG XL encoding/decoding is done using the libjxl codebase. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MP/s, More Is Better JPEG XL Decoding libjxl 0.7 CPU Threads: 1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 31.47 34.88 37.36 35.84
OpenBenchmarking.org MP/s, More Is Better JPEG XL Decoding libjxl 0.7 CPU Threads: All Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 103.43 114.19 124.81 120.77
WebP Image Encode This is a test of Google's libwebp with the cwebp image encode utility and using a sample 6000x4000 pixel JPEG image as the input. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Default Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 14.16 14.21 14.20 14.25 1. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 9.03 9.09 9.10 9.12 1. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2948 0.5896 0.8844 1.1792 1.474 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.30 1.31 1.31 1.31 1. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.6953 1.3906 2.0859 2.7812 3.4765 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.07 3.09 3.09 3.08 1. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread
OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.0945 0.189 0.2835 0.378 0.4725 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.42 0.42 0.42 0.42 1. (CC) gcc options: -fvisibility=hidden -O2 -lm -pthread
WebP2 Image Encode This is a test of Google's libwebp2 library with the WebP2 image encode utility and using a sample 6000x4000 pixel JPEG image as the input, similar to the WebP/libwebp test profile. WebP2 is currently experimental and under heavy development as ultimately the successor to WebP. WebP2 supports 10-bit HDR, more efficienct lossy compression, improved lossless compression, animation support, and full multi-threading support compared to WebP. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Default Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.612 1.224 1.836 2.448 3.06 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 2.68 2.71 2.72 2.71 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl -lpthread
OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 75, Compression Effort 7 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.0113 0.0226 0.0339 0.0452 0.0565 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.05 0.05 0.05 0.05 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl -lpthread
OpenBenchmarking.org MP/s, More Is Better WebP2 Image Encode 20220823 Encode Settings: Quality 95, Compression Effort 7 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.0045 0.009 0.0135 0.018 0.0225 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.02 0.02 0.02 0.02 1. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl -lpthread
srsRAN srsRAN is an open-source LTE/5G software radio suite created by Software Radio Systems (SRS). The srsRAN radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Samples / Second, More Is Better srsRAN 22.04.1 Test: OFDM_Test Default - IBRS retbleed=stuff mitigations=off retbleed=off 20M 40M 60M 80M 100M SE +/- 317979.73, N = 3 SE +/- 450924.98, N = 3 SE +/- 348010.22, N = 3 SE +/- 409606.86, N = 3 102366667 102400000 102366667 102133333 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 70 140 210 280 350 SE +/- 0.55, N = 3 SE +/- 0.26, N = 3 SE +/- 0.19, N = 3 SE +/- 1.24, N = 3 323.0 321.9 322.7 320.8 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.46, N = 3 SE +/- 0.70, N = 3 SE +/- 0.15, N = 3 SE +/- 0.13, N = 3 106.2 105.4 105.7 105.4 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 70 140 210 280 350 SE +/- 0.85, N = 3 SE +/- 0.31, N = 3 SE +/- 0.26, N = 3 SE +/- 0.39, N = 3 328.6 329.2 328.5 327.1 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.17, N = 3 SE +/- 0.24, N = 3 SE +/- 0.25, N = 3 SE +/- 0.57, N = 3 130.9 130.9 130.8 129.4 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 80 160 240 320 400 SE +/- 0.99, N = 3 SE +/- 0.30, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 354.4 353.7 353.6 354.7 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.61, N = 3 SE +/- 0.13, N = 3 SE +/- 0.46, N = 3 SE +/- 0.66, N = 3 115.9 115.8 115.9 115.2 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 80 160 240 320 400 SE +/- 0.38, N = 3 SE +/- 0.64, N = 3 SE +/- 0.43, N = 3 SE +/- 0.64, N = 3 359.6 359.0 359.7 359.9 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.47, N = 3 SE +/- 0.18, N = 3 SE +/- 0.20, N = 3 SE +/- 0.77, N = 3 137.2 137.1 136.7 137.2 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.65, N = 3 110.0 110.4 110.4 109.5 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM Default - IBRS retbleed=stuff mitigations=off retbleed=off 12 24 36 48 60 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 53.0 53.1 53.0 52.9 1. (CXX) g++ options: -std=c++14 -fno-strict-aliasing -march=native -mfpmath=sse -mavx2 -fvisibility=hidden -O3 -fno-trapping-math -fno-math-errno -lpthread -ldl -lm
LuaRadio LuaRadio is a lightweight software-defined radio (SDR) framework built atop LuaJIT. LuaRadio provides a suite of source, sink, and processing blocks, with a simple API for defining flow graphs, running flow graphs, creating blocks, and creating data types. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MiB/s, More Is Better LuaRadio 0.9.1 Test: Five Back to Back FIR Filters Default - IBRS retbleed=stuff mitigations=off retbleed=off 130 260 390 520 650 SE +/- 2.86, N = 3 SE +/- 4.25, N = 3 SE +/- 1.66, N = 3 SE +/- 2.34, N = 3 577.3 576.2 593.7 593.0
OpenBenchmarking.org MiB/s, More Is Better LuaRadio 0.9.1 Test: FM Deemphasis Filter Default - IBRS retbleed=stuff mitigations=off retbleed=off 80 160 240 320 400 SE +/- 0.35, N = 3 SE +/- 1.01, N = 3 SE +/- 1.09, N = 3 SE +/- 0.71, N = 3 356.7 357.0 362.6 362.3
OpenBenchmarking.org MiB/s, More Is Better LuaRadio 0.9.1 Test: Hilbert Transform Default - IBRS retbleed=stuff mitigations=off retbleed=off 15 30 45 60 75 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.15, N = 3 SE +/- 0.13, N = 3 68.2 68.7 68.4 68.4
OpenBenchmarking.org MiB/s, More Is Better LuaRadio 0.9.1 Test: Complex Phase Default - IBRS retbleed=stuff mitigations=off retbleed=off 100 200 300 400 500 SE +/- 1.81, N = 3 SE +/- 6.95, N = 3 SE +/- 4.57, N = 3 SE +/- 4.15, N = 3 456.7 458.7 476.3 474.6
GraphicsMagick This is a test of GraphicsMagick with its OpenMP implementation that performs various imaging tests on a sample 6000x4000 pixel JPEG image. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Swirl Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 138 139 140 140 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Rotate Default - IBRS retbleed=stuff mitigations=off retbleed=off 150 300 450 600 750 SE +/- 0.58, N = 3 SE +/- 0.88, N = 3 SE +/- 1.86, N = 3 520 615 717 654 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Sharpen Default - IBRS retbleed=stuff mitigations=off retbleed=off 9 18 27 36 45 39 39 39 39 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Enhanced Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 81 82 82 82 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Resizing Default - IBRS retbleed=stuff mitigations=off retbleed=off 90 180 270 360 450 SE +/- 0.88, N = 3 SE +/- 1.00, N = 3 398 403 411 410 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Noise-Gaussian Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 99 102 104 103 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: HWB Color Space Default - IBRS retbleed=stuff mitigations=off retbleed=off 130 260 390 520 650 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 447 518 585 551 1. (CC) gcc options: -fopenmp -O2 -pthread -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
rav1e Xiph rav1e is a Rust-written AV1 video encoder that claims to be the fastest and safest AV1 encoder. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better rav1e 0.6.1 Speed: 5 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.4091 0.8182 1.2273 1.6364 2.0455 SE +/- 0.003, N = 3 SE +/- 0.004, N = 3 SE +/- 0.003, N = 3 SE +/- 0.006, N = 3 1.802 1.799 1.802 1.818
OpenBenchmarking.org Frames Per Second, More Is Better rav1e 0.6.1 Speed: 6 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.5508 1.1016 1.6524 2.2032 2.754 SE +/- 0.006, N = 3 SE +/- 0.006, N = 3 SE +/- 0.006, N = 3 SE +/- 0.005, N = 3 2.426 2.448 2.448 2.435
OpenBenchmarking.org Frames Per Second, More Is Better rav1e 0.6.1 Speed: 10 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.020, N = 3 SE +/- 0.006, N = 3 SE +/- 0.017, N = 3 SE +/- 0.026, N = 3 6.073 6.144 6.182 6.182
SVT-AV1 This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 4K Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2408 0.4816 0.7224 0.9632 1.204 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 0.001, N = 3 SE +/- 0.001, N = 3 1.064 1.068 1.070 1.069 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 12.80 12.92 12.98 12.97 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K Default - IBRS retbleed=stuff mitigations=off retbleed=off 11 22 33 44 55 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 48.27 48.76 49.63 49.05 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K Default - IBRS retbleed=stuff mitigations=off retbleed=off 12 24 36 48 60 SE +/- 0.06, N = 3 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 51.12 51.93 52.06 52.17 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.8523 1.7046 2.5569 3.4092 4.2615 SE +/- 0.002, N = 3 SE +/- 0.007, N = 3 SE +/- 0.007, N = 3 SE +/- 0.003, N = 3 3.764 3.776 3.788 3.781 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 36.02 36.26 36.36 36.34 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.31, N = 3 SE +/- 0.43, N = 3 SE +/- 0.45, N = 3 SE +/- 0.54, N = 3 185.80 189.07 191.99 190.25 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Default - IBRS retbleed=stuff mitigations=off retbleed=off 50 100 150 200 250 SE +/- 0.29, N = 3 SE +/- 0.24, N = 3 SE +/- 0.43, N = 3 SE +/- 0.92, N = 3 207.79 212.12 216.17 212.54 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenVKL OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Default - IBRS retbleed=stuff mitigations=off retbleed=off 15 30 45 60 75 SE +/- 0.33, N = 3 67 67 67 67 MIN: 8 / MAX: 1035 MIN: 8 / MAX: 1039 MIN: 8 / MAX: 1038 MIN: 8 / MAX: 1036
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark Scalar Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 36 36 36 36 MIN: 4 / MAX: 701 MIN: 4 / MAX: 700 MIN: 4 / MAX: 701 MIN: 4 / MAX: 701
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Default - IBRS retbleed=stuff mitigations=off retbleed=off 5K 10K 15K 20K 25K SE +/- 57.42, N = 3 SE +/- 55.21, N = 3 SE +/- 132.11, N = 3 SE +/- 7.81, N = 3 22169 22160 22027 22114 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Stargate Digital Audio Workstation Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 44100 - Buffer Size: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2739 0.5478 0.8217 1.0956 1.3695 SE +/- 0.000342, N = 3 SE +/- 0.000113, N = 3 SE +/- 0.008493, N = 3 SE +/- 0.000124, N = 3 1.215741 1.217403 1.207418 1.217322 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 96000 - Buffer Size: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.1934 0.3868 0.5802 0.7736 0.967 SE +/- 0.000732, N = 3 SE +/- 0.000670, N = 3 SE +/- 0.000243, N = 3 SE +/- 0.000460, N = 3 0.859759 0.856760 0.857744 0.859412 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 44100 - Buffer Size: 1024 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2895 0.579 0.8685 1.158 1.4475 SE +/- 0.000148, N = 3 SE +/- 0.000082, N = 3 SE +/- 0.017971, N = 3 SE +/- 0.000153, N = 3 1.285265 1.284939 1.261311 1.286789 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 480000 - Buffer Size: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2662 0.5324 0.7986 1.0648 1.331 SE +/- 0.000675, N = 3 SE +/- 0.000431, N = 3 SE +/- 0.000280, N = 3 SE +/- 0.000339, N = 3 1.181060 1.181143 1.183243 1.181881 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 96000 - Buffer Size: 1024 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2092 0.4184 0.6276 0.8368 1.046 SE +/- 0.000224, N = 3 SE +/- 0.000807, N = 3 SE +/- 0.000455, N = 3 SE +/- 0.000035, N = 3 0.928978 0.926504 0.927538 0.929955 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 480000 - Buffer Size: 1024 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2817 0.5634 0.8451 1.1268 1.4085 SE +/- 0.005641, N = 3 SE +/- 0.000662, N = 3 SE +/- 0.000583, N = 3 SE +/- 0.000223, N = 3 1.241926 1.251187 1.251796 1.251774 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
libavif avifenc This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 0 Default - IBRS retbleed=stuff mitigations=off retbleed=off 80 160 240 320 400 SE +/- 0.22, N = 3 SE +/- 0.48, N = 3 SE +/- 1.22, N = 3 SE +/- 0.25, N = 3 379.22 380.58 379.28 377.40 1. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 2 Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.26, N = 3 SE +/- 0.27, N = 3 SE +/- 0.56, N = 3 SE +/- 0.22, N = 3 171.47 171.57 170.09 169.84 1. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 6 Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 19.94 19.76 19.36 19.49 1. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 6, Lossless Default - IBRS retbleed=stuff mitigations=off retbleed=off 7 14 21 28 35 SE +/- 0.03, N = 3 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 28.53 28.09 27.57 27.85 1. (CXX) g++ options: -O3 -fPIC -lm
OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 10, Lossless Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 12.43 11.85 11.62 11.74 1. (CXX) g++ options: -O3 -fPIC -lm
Timed Linux Kernel Compilation This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig Default - IBRS retbleed=stuff mitigations=off retbleed=off 60 120 180 240 300 SE +/- 1.63, N = 3 SE +/- 1.01, N = 3 SE +/- 0.76, N = 3 SE +/- 1.01, N = 3 287.90 271.33 260.62 266.84
Timed Node.js Compilation This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile Default - IBRS retbleed=stuff mitigations=off retbleed=off 400 800 1200 1600 2000 SE +/- 0.05, N = 3 SE +/- 0.48, N = 3 SE +/- 0.72, N = 3 SE +/- 0.16, N = 3 1783.49 1748.87 1716.49 1734.97
oneDNN This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.00789, N = 3 SE +/- 0.00849, N = 3 SE +/- 0.01398, N = 3 SE +/- 0.01002, N = 3 7.68644 7.69614 7.69350 7.68653 MIN: 7.53 MIN: 7.55 MIN: 7.53 MIN: 7.53 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 12.37 12.25 12.34 12.33 MIN: 12.21 MIN: 12.02 MIN: 12.15 MIN: 12.17 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 20.92 20.92 20.93 20.91 MIN: 20.86 MIN: 20.86 MIN: 20.84 MIN: 20.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.26, N = 15 SE +/- 0.28, N = 15 SE +/- 0.25, N = 3 SE +/- 0.25, N = 15 14.14 14.06 14.91 13.54 MIN: 11.76 MIN: 11.74 MIN: 11.77 MIN: 11.73 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 14.44 14.48 14.50 14.50 MIN: 14.25 MIN: 14.33 MIN: 14.35 MIN: 14.36 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 1600 3200 4800 6400 8000 SE +/- 2.05, N = 3 SE +/- 2.32, N = 3 SE +/- 3.51, N = 3 SE +/- 3.60, N = 3 7409.45 7409.07 7405.60 7405.04 MIN: 7399.64 MIN: 7401.09 MIN: 7394.43 MIN: 7395.87 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 900 1800 2700 3600 4500 SE +/- 1.74, N = 3 SE +/- 0.74, N = 3 SE +/- 4.77, N = 3 SE +/- 1.52, N = 3 3967.41 3968.47 3963.59 3961.26 MIN: 3960.54 MIN: 3960.07 MIN: 3954 MIN: 3956.98 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.2405 2.481 3.7215 4.962 6.2025 SE +/- 0.01808, N = 3 SE +/- 0.00519, N = 3 SE +/- 0.01647, N = 3 SE +/- 0.00478, N = 3 5.51332 5.48338 5.49579 5.46550 MIN: 5.41 MIN: 5.41 MIN: 5.41 MIN: 5.4 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -lpthread -ldl
Timed Erlang/OTP Compilation This test times how long it takes to compile Erlang/OTP. Erlang is a programming language and run-time for massively scalable soft real-time systems with high availability requirements. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Timed Erlang/OTP Compilation 25.0 Time To Compile Default - IBRS retbleed=stuff mitigations=off retbleed=off 50 100 150 200 250 SE +/- 0.25, N = 3 SE +/- 0.20, N = 3 SE +/- 0.18, N = 3 SE +/- 0.31, N = 3 220.87 207.35 198.22 204.11
FLAC Audio Encoding This test times how long it takes to encode a sample WAV file to FLAC audio format ten times using the --best preset settings. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.4 WAV To FLAC Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.05, N = 5 SE +/- 0.06, N = 5 SE +/- 0.13, N = 5 SE +/- 0.14, N = 5 21.66 21.44 21.39 21.46 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
Hackbench This is a benchmark of Hackbench, a test of the Linux kernel scheduler. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 1 - Type: Thread Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.004, N = 3 SE +/- 0.158, N = 15 SE +/- 0.077, N = 3 SE +/- 0.161, N = 15 13.045 10.577 7.955 8.970 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 2 - Type: Thread Default - IBRS retbleed=stuff mitigations=off retbleed=off 7 14 21 28 35 SE +/- 0.62, N = 15 SE +/- 0.78, N = 15 SE +/- 0.90, N = 15 SE +/- 0.69, N = 15 27.98 21.56 15.10 18.29 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 4 - Type: Thread Default - IBRS retbleed=stuff mitigations=off retbleed=off 13 26 39 52 65 SE +/- 0.30, N = 3 SE +/- 1.00, N = 15 SE +/- 0.95, N = 15 SE +/- 0.04, N = 3 59.17 41.52 23.65 33.50 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 8 - Type: Thread Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.60, N = 3 SE +/- 0.89, N = 3 SE +/- 0.06, N = 3 SE +/- 0.83, N = 3 108.75 81.93 44.48 69.70 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 1 - Type: Process Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.011, N = 3 SE +/- 0.012, N = 3 SE +/- 0.260, N = 15 SE +/- 0.004, N = 3 12.806 9.876 6.497 8.303 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Thread Default - IBRS retbleed=stuff mitigations=off retbleed=off 50 100 150 200 250 SE +/- 2.54, N = 6 SE +/- 0.52, N = 3 SE +/- 1.10, N = 15 SE +/- 0.19, N = 3 221.70 167.70 101.21 142.98 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 2 - Type: Process Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.52, N = 15 SE +/- 0.03, N = 3 25.05 19.16 11.36 16.13 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 4 - Type: Process Default - IBRS retbleed=stuff mitigations=off retbleed=off 12 24 36 48 60 SE +/- 0.49, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 52.23 39.09 21.65 33.16 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 8 - Type: Process Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 107.09 80.43 43.55 68.06 1. (CC) gcc options: -lpthread
OpenBenchmarking.org Seconds, Fewer Is Better Hackbench Count: 16 - Type: Process Default - IBRS retbleed=stuff mitigations=off retbleed=off 50 100 150 200 250 SE +/- 0.48, N = 3 SE +/- 0.25, N = 3 SE +/- 0.33, N = 3 SE +/- 0.47, N = 3 217.36 166.81 95.57 143.01 1. (CC) gcc options: -lpthread
Cpuminer-Opt Cpuminer-Opt is a fork of cpuminer-multi that carries a wide range of CPU performance optimizations for measuring the potential cryptocurrency mining performance of the CPU/processor with a wide variety of cryptocurrencies. The benchmark reports the hash speed for the CPU mining performance for the selected cryptocurrency. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Magi Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 1.28, N = 5 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 97.92 99.40 98.24 98.31 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 1.00, N = 3 SE +/- 1.84, N = 3 SE +/- 1.22, N = 3 SE +/- 1.01, N = 3 156.44 157.79 156.26 157.18 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt Default - IBRS retbleed=stuff mitigations=off retbleed=off 16 32 48 64 80 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 72.55 72.71 72.64 72.61 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Deepcoin Default - IBRS retbleed=stuff mitigations=off retbleed=off 800 1600 2400 3200 4000 SE +/- 0.76, N = 3 SE +/- 0.36, N = 3 SE +/- 24.38, N = 3 SE +/- 3.29, N = 3 3840.30 3840.87 3858.75 3845.26 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Ringcoin Default - IBRS retbleed=stuff mitigations=off retbleed=off 200 400 600 800 1000 SE +/- 6.22, N = 3 SE +/- 4.41, N = 3 SE +/- 9.06, N = 7 SE +/- 4.63, N = 3 830.67 822.67 827.69 820.72 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Blake-2 S Default - IBRS retbleed=stuff mitigations=off retbleed=off 30K 60K 90K 120K 150K SE +/- 1465.07, N = 3 SE +/- 1476.97, N = 3 SE +/- 1213.35, N = 3 SE +/- 18.56, N = 3 155060 155900 155063 153793 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin Default - IBRS retbleed=stuff mitigations=off retbleed=off 200 400 600 800 1000 SE +/- 2.76, N = 3 SE +/- 6.67, N = 3 SE +/- 2.68, N = 3 SE +/- 1.78, N = 3 1140.68 1153.43 1140.86 1144.59 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 16360 16347 16353 16353 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Myriad-Groestl Default - IBRS retbleed=stuff mitigations=off retbleed=off 1200 2400 3600 4800 6000 SE +/- 2.14, N = 3 SE +/- 24.39, N = 3 SE +/- 17.24, N = 3 SE +/- 2.34, N = 3 5371.74 5400.62 5411.58 5374.93 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits Default - IBRS retbleed=stuff mitigations=off retbleed=off 2K 4K 6K 8K 10K SE +/- 40.00, N = 3 SE +/- 16.67, N = 3 SE +/- 15.28, N = 3 10550 10590 10577 10580 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 176.67, N = 3 SE +/- 3.33, N = 3 SE +/- 193.10, N = 8 19267 19097 19299 19100 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 3.33, N = 3 SE +/- 313.39, N = 3 SE +/- 23.33, N = 3 SE +/- 3.33, N = 3 26697 27213 26723 26697 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all queries performed. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, First Run / Cold Cache Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 1.00, N = 3 SE +/- 0.67, N = 11 SE +/- 1.04, N = 3 SE +/- 1.18, N = 4 74.87 78.18 80.13 79.46 MIN: 4.96 / MAX: 15000 MIN: 5.58 / MAX: 20000 MIN: 5.87 / MAX: 20000 MIN: 5.8 / MAX: 20000 1. ClickHouse server version 22.5.4.19 (official build).
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Second Run Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.80, N = 3 SE +/- 0.47, N = 11 SE +/- 0.52, N = 3 SE +/- 0.38, N = 4 76.82 81.37 83.14 83.37 MIN: 5.2 / MAX: 20000 MIN: 5.83 / MAX: 20000 MIN: 5.96 / MAX: 20000 MIN: 5.89 / MAX: 20000 1. ClickHouse server version 22.5.4.19 (official build).
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Third Run Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.72, N = 3 SE +/- 0.41, N = 11 SE +/- 0.21, N = 3 SE +/- 1.06, N = 4 79.54 81.55 83.60 82.35 MIN: 5.59 / MAX: 20000 MIN: 5.79 / MAX: 20000 MIN: 6.05 / MAX: 20000 MIN: 5.89 / MAX: 20000 1. ClickHouse server version 22.5.4.19 (official build).
Apache Spark This is a benchmark of Apache Spark with its PySpark interface. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmars the Apache Spark in a single-system configuration using spark-submit. The test makes use of DIYBigData's pyspark-benchmark (https://github.com/DIYBigData/pyspark-benchmark/) for generating of test data and various Apache Spark operations. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.3343 2.6686 4.0029 5.3372 6.6715 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 5.90 5.93 5.63 5.69
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Default - IBRS retbleed=stuff mitigations=off retbleed=off 100 200 300 400 500 SE +/- 0.93, N = 3 SE +/- 0.48, N = 3 SE +/- 1.14, N = 3 SE +/- 0.28, N = 3 441.23 439.91 441.21 439.84
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 24.54 24.16 24.00 24.20
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.215 2.43 3.645 4.86 6.075 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 5.40 5.18 5.03 5.09
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.8303 1.6606 2.4909 3.3212 4.1515 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 3.69 3.54 3.51 3.51
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.8055 1.611 2.4165 3.222 4.0275 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 3.58 3.56 3.53 3.52
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.7178 1.4356 2.1534 2.8712 3.589 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 3.14 2.99 3.19 2.98
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - SHA-512 Benchmark Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.07, N = 3 SE +/- 0.08, N = 4 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 6.49 6.11 5.89 6.29
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Default - IBRS retbleed=stuff mitigations=off retbleed=off 90 180 270 360 450 SE +/- 0.18, N = 3 SE +/- 1.00, N = 4 SE +/- 0.45, N = 3 SE +/- 0.22, N = 3 436.79 437.77 436.93 436.32
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.11, N = 3 SE +/- 0.07, N = 4 SE +/- 0.66, N = 3 SE +/- 0.02, N = 3 24.33 24.18 24.89 24.24
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Group By Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.07, N = 4 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 6.14 5.88 5.70 5.84
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Repartition Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.8955 1.791 2.6865 3.582 4.4775 SE +/- 0.09, N = 3 SE +/- 0.02, N = 4 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 3.98 3.74 3.71 3.68
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Inner Join Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.9113 1.8226 2.7339 3.6452 4.5565 SE +/- 0.06, N = 3 SE +/- 0.04, N = 4 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 4.05 4.03 3.90 4.02
OpenBenchmarking.org Seconds, Fewer Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 - Broadcast Inner Join Test Time Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.774 1.548 2.322 3.096 3.87 SE +/- 0.05, N = 3 SE +/- 0.02, N = 4 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 3.38 3.34 3.36 3.44
CockroachDB CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.48, N = 3 SE +/- 0.19, N = 3 SE +/- 0.75, N = 3 SE +/- 1.02, N = 3 106.9 111.7 111.4 105.8
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.31, N = 3 SE +/- 0.35, N = 3 SE +/- 0.15, N = 3 SE +/- 4.63, N = 12 108.5 111.9 111.2 105.9
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.53, N = 3 SE +/- 0.29, N = 3 SE +/- 0.15, N = 3 SE +/- 0.13, N = 3 108.1 112.0 111.6 111.6
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1600 3200 4800 6400 8000 SE +/- 55.63, N = 3 SE +/- 26.36, N = 3 SE +/- 31.51, N = 3 SE +/- 47.48, N = 3 6837.8 7257.6 7068.9 7123.9
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 20.31, N = 3 SE +/- 67.67, N = 3 SE +/- 20.72, N = 3 SE +/- 37.60, N = 3 12182.1 12888.4 12714.4 12830.4
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 17.17, N = 3 SE +/- 24.56, N = 3 SE +/- 31.63, N = 3 SE +/- 61.83, N = 3 13556.1 14251.3 14119.5 14248.2
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 43.99, N = 3 SE +/- 29.50, N = 3 SE +/- 71.67, N = 3 SE +/- 23.00, N = 3 12263.7 13101.0 12637.0 12798.2
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 35.11, N = 3 SE +/- 38.67, N = 3 SE +/- 67.56, N = 3 SE +/- 35.46, N = 3 15334.7 16052.6 16279.6 16169.5
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 65.05, N = 3 SE +/- 52.98, N = 3 SE +/- 73.08, N = 3 SE +/- 24.66, N = 3 15417.9 16043.6 16312.1 16356.3
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 34.01, N = 3 SE +/- 31.65, N = 3 SE +/- 43.52, N = 3 SE +/- 65.34, N = 3 14206.9 15153.9 14750.1 15102.3
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 57.53, N = 3 SE +/- 125.50, N = 3 SE +/- 40.38, N = 3 SE +/- 80.54, N = 3 16214.1 17025.6 17086.4 17196.3
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 58.53, N = 3 SE +/- 125.77, N = 3 SE +/- 35.50, N = 3 SE +/- 106.96, N = 3 15948.6 16550.4 16635.8 16712.8
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 128 Default - IBRS retbleed=stuff mitigations=off retbleed=off 5K 10K 15K 20K 25K SE +/- 60.10, N = 3 SE +/- 96.17, N = 3 SE +/- 72.05, N = 3 SE +/- 67.44, N = 3 21848.0 22736.1 23352.3 23189.1
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 256 Default - IBRS retbleed=stuff mitigations=off retbleed=off 5K 10K 15K 20K 25K SE +/- 38.97, N = 3 SE +/- 67.07, N = 3 SE +/- 48.49, N = 3 SE +/- 30.70, N = 3 21820.8 22382.3 23274.7 22888.9
OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 Default - IBRS retbleed=stuff mitigations=off retbleed=off 5K 10K 15K 20K 25K SE +/- 39.90, N = 3 SE +/- 95.61, N = 3 SE +/- 115.39, N = 3 SE +/- 19.89, N = 3 20258.0 20766.5 21346.1 21086.8
Dragonflydb Dragonfly is an open-source database server that is a "modern Redis replacement" that aims to be the fastest memory store while being compliant with the Redis and Memcached protocols. For benchmarking Dragonfly, Memtier_benchmark is used as a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 0.6 Clients: 50 - Set To Get Ratio: 1:5 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 3202.61, N = 3 SE +/- 9874.35, N = 3 SE +/- 14928.63, N = 3 SE +/- 2098.57, N = 3 902480.41 1068334.75 1108896.91 1085041.59 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 0.6 Clients: 50 - Set To Get Ratio: 5:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 14572.82, N = 3 SE +/- 10204.79, N = 3 SE +/- 1484.63, N = 3 SE +/- 4701.88, N = 3 844039.71 927313.86 979021.51 966283.04 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 0.6 Clients: 200 - Set To Get Ratio: 1:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 3016.85, N = 3 SE +/- 3190.84, N = 3 SE +/- 2298.87, N = 3 SE +/- 6499.14, N = 3 893182.92 942396.75 1004168.04 987881.72 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 0.6 Clients: 200 - Set To Get Ratio: 1:5 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 9053.64, N = 3 SE +/- 10739.05, N = 3 SE +/- 1230.98, N = 3 SE +/- 6369.58, N = 3 937232.81 998481.69 1037459.90 1033004.97 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 0.6 Clients: 200 - Set To Get Ratio: 5:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 4933.91, N = 3 SE +/- 13869.80, N = 3 SE +/- 9961.71, N = 3 SE +/- 6448.91, N = 3 865694.31 898246.15 939884.95 928724.15 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Memcached OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.16 Set To Get Ratio: 1:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 543.55, N = 3 SE +/- 3880.05, N = 3 SE +/- 4312.41, N = 3 SE +/- 7025.44, N = 3 833888.75 891561.78 1157720.20 1035956.62 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.16 Set To Get Ratio: 1:5 Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 1256.03, N = 3 SE +/- 1962.85, N = 3 SE +/- 3325.22, N = 3 SE +/- 3239.10, N = 3 827558.93 883794.56 1159234.39 1044494.53 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.16 Set To Get Ratio: 5:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 1428.58, N = 3 SE +/- 1529.09, N = 3 SE +/- 882.77, N = 3 SE +/- 1635.50, N = 3 939991.36 1053867.93 1290274.48 1147643.61 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.16 Set To Get Ratio: 1:10 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 1191.60, N = 3 SE +/- 1221.65, N = 3 SE +/- 2970.13, N = 3 SE +/- 1613.00, N = 3 823970.81 885942.92 1198373.90 1057571.99 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Redis Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: GET - Parallel Connections: 50 Default - IBRS retbleed=stuff mitigations=off retbleed=off 700K 1400K 2100K 2800K 3500K SE +/- 1752.83, N = 3 SE +/- 623.36, N = 3 SE +/- 5141.59, N = 3 SE +/- 1509.63, N = 3 3367879.17 3089573.83 3171723.17 3096924.80 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: SET - Parallel Connections: 50 Default - IBRS retbleed=stuff mitigations=off retbleed=off 500K 1000K 1500K 2000K 2500K SE +/- 9932.25, N = 3 SE +/- 10945.95, N = 3 SE +/- 8978.75, N = 3 SE +/- 13282.97, N = 3 2315119.83 2289592.50 2321265.75 2323685.50 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
KeyDB A benchmark of KeyDB as a multi-threaded fork of the Redis server. The KeyDB benchmark is conducted using memtier-benchmark. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ops/sec, More Is Better KeyDB 6.2.0 Default - IBRS retbleed=stuff mitigations=off retbleed=off 40K 80K 120K 160K 200K SE +/- 699.76, N = 3 SE +/- 752.57, N = 3 SE +/- 833.55, N = 3 SE +/- 920.86, N = 3 111189.18 128725.84 195756.15 154975.58 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
MariaDB This is a MariaDB MySQL database server benchmark making use of mysqlslap. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Second, More Is Better MariaDB 10.8.2 Clients: 8 Default - IBRS retbleed=stuff mitigations=off retbleed=off 60 120 180 240 300 SE +/- 0.51, N = 3 SE +/- 0.28, N = 3 SE +/- 0.36, N = 3 SE +/- 0.43, N = 3 283 295 288 296 1. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -pthread -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl
OpenBenchmarking.org Queries Per Second, More Is Better MariaDB 10.8.2 Clients: 16 Default - IBRS retbleed=stuff mitigations=off retbleed=off 60 120 180 240 300 SE +/- 0.33, N = 3 SE +/- 0.76, N = 3 SE +/- 0.38, N = 3 SE +/- 0.80, N = 3 258 270 269 272 1. (CXX) g++ options: -pie -fPIC -fstack-protector -O3 -pthread -lnuma -lpcre2-8 -lcrypt -laio -lz -lm -lssl -lcrypto -lpthread -ldl
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 5K 10K 15K 20K 25K SE +/- 37.34, N = 3 SE +/- 18.45, N = 3 SE +/- 85.96, N = 3 SE +/- 93.24, N = 3 20037 20179 21888 20390 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.0113 0.0226 0.0339 0.0452 0.0565 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 0.050 0.050 0.046 0.049 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.31, N = 3 SE +/- 0.68, N = 3 SE +/- 1.63, N = 3 SE +/- 1.43, N = 3 197 200 202 203 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.1441 2.2882 3.4323 4.5764 5.7205 SE +/- 0.008, N = 3 SE +/- 0.017, N = 3 SE +/- 0.040, N = 3 SE +/- 0.035, N = 3 5.085 4.999 4.961 4.927 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 30K 60K 90K 120K 150K SE +/- 363.26, N = 3 SE +/- 934.91, N = 3 SE +/- 240.72, N = 3 SE +/- 462.80, N = 3 102394 111982 126512 115588 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.1098 0.2196 0.3294 0.4392 0.549 SE +/- 0.002, N = 3 SE +/- 0.004, N = 3 SE +/- 0.001, N = 3 SE +/- 0.002, N = 3 0.488 0.446 0.395 0.433 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 30K 60K 90K 120K 150K SE +/- 22.05, N = 3 SE +/- 433.11, N = 3 SE +/- 203.82, N = 3 SE +/- 543.52, N = 3 102099 110671 122433 114303 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2203 0.4406 0.6609 0.8812 1.1015 SE +/- 0.000, N = 3 SE +/- 0.004, N = 3 SE +/- 0.001, N = 3 SE +/- 0.004, N = 3 0.979 0.903 0.817 0.875 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write Default - IBRS retbleed=stuff mitigations=off retbleed=off 60 120 180 240 300 SE +/- 0.23, N = 3 SE +/- 0.53, N = 3 SE +/- 0.65, N = 3 SE +/- 0.48, N = 3 266 279 278 282 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.16, N = 3 SE +/- 0.34, N = 3 SE +/- 0.42, N = 3 SE +/- 0.31, N = 3 188.24 179.10 179.92 177.36 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 204.73, N = 3 SE +/- 19.47, N = 3 SE +/- 106.24, N = 3 SE +/- 14.57, N = 3 19939 20140 20598 20115 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.0113 0.0226 0.0339 0.0452 0.0565 SE +/- 0.001, N = 3 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 SE +/- 0.000, N = 3 0.050 0.050 0.048 0.050 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write Default - IBRS retbleed=stuff mitigations=off retbleed=off 60 120 180 240 300 SE +/- 2.48, N = 3 SE +/- 1.32, N = 3 SE +/- 0.56, N = 3 SE +/- 1.44, N = 3 248 261 263 268 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 90 180 270 360 450 SE +/- 4.05, N = 3 SE +/- 1.95, N = 3 SE +/- 0.80, N = 3 SE +/- 2.01, N = 3 402.58 383.84 380.45 372.96 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.32, N = 3 SE +/- 1.22, N = 3 SE +/- 0.22, N = 3 SE +/- 1.10, N = 3 188 187 187 190 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.206 2.412 3.618 4.824 6.03 SE +/- 0.009, N = 3 SE +/- 0.035, N = 3 SE +/- 0.006, N = 3 SE +/- 0.030, N = 3 5.322 5.360 5.356 5.261 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 30K 60K 90K 120K 150K SE +/- 252.50, N = 3 SE +/- 180.13, N = 3 SE +/- 778.58, N = 3 SE +/- 623.45, N = 3 99895 108308 120818 111247 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.1127 0.2254 0.3381 0.4508 0.5635 SE +/- 0.001, N = 3 SE +/- 0.001, N = 3 SE +/- 0.003, N = 3 SE +/- 0.002, N = 3 0.501 0.461 0.414 0.450 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 30K 60K 90K 120K 150K SE +/- 387.80, N = 3 SE +/- 1297.33, N = 3 SE +/- 464.85, N = 3 SE +/- 363.63, N = 3 99837 107565 121544 111602 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2255 0.451 0.6765 0.902 1.1275 SE +/- 0.004, N = 3 SE +/- 0.011, N = 3 SE +/- 0.003, N = 3 SE +/- 0.003, N = 3 1.002 0.930 0.823 0.896 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write Default - IBRS retbleed=stuff mitigations=off retbleed=off 900 1800 2700 3600 4500 SE +/- 14.43, N = 3 SE +/- 15.39, N = 3 SE +/- 18.41, N = 3 SE +/- 42.75, N = 3 3916 3753 3645 4083 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.13, N = 3 12.77 13.32 13.72 12.25 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write Default - IBRS retbleed=stuff mitigations=off retbleed=off 1100 2200 3300 4400 5500 SE +/- 45.81, N = 3 SE +/- 53.82, N = 3 SE +/- 72.12, N = 3 SE +/- 46.69, N = 3 4633 4470 4429 5039 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.21, N = 3 SE +/- 0.27, N = 3 SE +/- 0.36, N = 3 SE +/- 0.18, N = 3 21.59 22.38 22.59 19.85 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lpthread -lrt -ldl -lm
Neural Magic DeepSparse OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.7186 1.4372 2.1558 2.8744 3.593 SE +/- 0.0024, N = 3 SE +/- 0.0058, N = 3 SE +/- 0.0080, N = 3 SE +/- 0.0115, N = 3 3.1939 3.1621 3.1666 3.1660
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 140 280 420 560 700 SE +/- 0.48, N = 3 SE +/- 1.07, N = 3 SE +/- 1.60, N = 3 SE +/- 2.30, N = 3 626.17 632.38 631.59 631.70
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.6935 1.387 2.0805 2.774 3.4675 SE +/- 0.0017, N = 3 SE +/- 0.0054, N = 3 SE +/- 0.0019, N = 3 SE +/- 0.0082, N = 3 3.0824 3.0464 3.0587 3.0623
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 70 140 210 280 350 SE +/- 0.18, N = 3 SE +/- 0.58, N = 3 SE +/- 0.20, N = 3 SE +/- 0.87, N = 3 324.41 328.24 326.93 326.54
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.07, N = 3 11.50 11.52 11.27 11.36
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.41, N = 3 SE +/- 0.28, N = 3 SE +/- 2.19, N = 3 SE +/- 1.11, N = 3 173.82 173.52 177.26 175.97
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 10.36 10.43 10.37 10.45
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.30, N = 3 SE +/- 0.30, N = 3 SE +/- 0.12, N = 3 SE +/- 0.30, N = 3 96.51 95.84 96.38 95.68
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 17.49 17.41 17.39 17.37
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 114.35 114.88 114.96 115.13
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 17.42 16.77 16.76 16.72
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 13 26 39 52 65 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 57.38 59.62 59.66 59.81
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 36.64 36.74 36.74 36.76
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 12 24 36 48 60 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 54.56 54.42 54.41 54.39
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 34.81 34.92 34.93 34.93
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 7 14 21 28 35 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 28.72 28.62 28.61 28.61
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 27.54 27.40 27.41 27.27
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 16 32 48 64 80 SE +/- 0.01, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.29, N = 3 72.59 72.97 72.93 73.31
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 24.18 23.99 24.02 24.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 10 20 30 40 50 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 41.35 41.67 41.63 41.66
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 13.98 13.91 13.94 13.94
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 143.09 143.74 143.46 143.41
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 12.23 12.19 12.19 12.19
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.07, N = 3 81.76 82.02 82.00 82.04
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.7207 1.4414 2.1621 2.8828 3.6035 SE +/- 0.0008, N = 3 SE +/- 0.0033, N = 3 SE +/- 0.0031, N = 3 SE +/- 0.0037, N = 3 3.1951 3.2032 3.1923 3.1945
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 140 280 420 560 700 SE +/- 0.17, N = 3 SE +/- 0.64, N = 3 SE +/- 0.59, N = 3 SE +/- 0.72, N = 3 625.93 624.35 626.49 626.06
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.6974 1.3948 2.0922 2.7896 3.487 SE +/- 0.0045, N = 3 SE +/- 0.0068, N = 3 SE +/- 0.0109, N = 3 SE +/- 0.0067, N = 3 3.0994 3.0946 3.0682 3.0656
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Default - IBRS retbleed=stuff mitigations=off retbleed=off 70 140 210 280 350 SE +/- 0.47, N = 3 SE +/- 0.71, N = 3 SE +/- 1.16, N = 3 SE +/- 0.71, N = 3 322.63 323.13 325.92 326.19
memtier_benchmark Memtier_benchmark is a NoSQL Redis/Memcache traffic generation plus benchmarking tool developed by Redis Labs. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 10509.17, N = 11 SE +/- 17147.18, N = 4 SE +/- 48717.93, N = 15 SE +/- 18395.69, N = 15 1175178.96 1232491.42 1481936.11 1329151.41 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 18141.35, N = 3 SE +/- 9807.81, N = 3 SE +/- 20387.26, N = 4 SE +/- 18624.65, N = 3 1360130.93 1447187.46 1422407.47 1410074.30 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 14120.93, N = 3 SE +/- 11938.38, N = 3 SE +/- 27491.98, N = 15 SE +/- 20904.07, N = 12 1109992.57 1180753.40 1288891.75 1220692.33 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 15330.54, N = 3 SE +/- 10395.85, N = 3 SE +/- 12805.02, N = 15 SE +/- 7047.94, N = 3 1231773.00 1286001.55 1403515.54 1317556.82 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 100 - Set To Get Ratio: 10:1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 16343.00, N = 3 SE +/- 14429.89, N = 3 SE +/- 13202.94, N = 3 SE +/- 17472.63, N = 4 1291653.16 1319663.84 1341587.32 1329633.77 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better memtier_benchmark 1.4 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10 Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 19117.51, N = 3 SE +/- 7241.76, N = 3 SE +/- 11096.23, N = 3 SE +/- 18956.48, N = 3 1372487.30 1440930.09 1485496.09 1499557.64 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Stress-NG Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MMAP Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.31, N = 3 SE +/- 0.31, N = 4 SE +/- 0.27, N = 8 SE +/- 0.29, N = 6 20.39 22.05 26.88 24.51 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: NUMA Default - IBRS retbleed=stuff mitigations=off retbleed=off 16 32 48 64 80 SE +/- 0.26, N = 3 SE +/- 0.44, N = 3 SE +/- 0.60, N = 3 SE +/- 0.62, N = 3 63.58 60.34 69.78 68.26 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Futex Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 7928.09, N = 3 SE +/- 1267.42, N = 3 SE +/- 2035.60, N = 3 SE +/- 3071.26, N = 3 830087.70 971383.12 1440190.04 1156275.48 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MEMFD Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 1.50, N = 3 SE +/- 0.99, N = 3 SE +/- 1.18, N = 3 SE +/- 2.38, N = 3 112.42 106.29 114.07 151.51 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Mutex Default - IBRS retbleed=stuff mitigations=off retbleed=off 500K 1000K 1500K 2000K 2500K SE +/- 1727.54, N = 3 SE +/- 2417.49, N = 3 SE +/- 3583.54, N = 3 SE +/- 511.77, N = 3 745688.97 1111966.01 2131852.03 1285481.53 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Atomic Default - IBRS retbleed=stuff mitigations=off retbleed=off 40K 80K 120K 160K 200K SE +/- 2552.57, N = 15 SE +/- 2632.45, N = 15 SE +/- 2604.63, N = 15 SE +/- 2454.73, N = 15 180741.36 182114.03 180081.27 180772.46 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto Default - IBRS retbleed=stuff mitigations=off retbleed=off 1000 2000 3000 4000 5000 SE +/- 3.82, N = 3 SE +/- 0.75, N = 3 SE +/- 6.94, N = 3 SE +/- 3.32, N = 3 4815.30 4817.25 4816.67 4812.47 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc Default - IBRS retbleed=stuff mitigations=off retbleed=off 200K 400K 600K 800K 1000K SE +/- 2251.44, N = 3 SE +/- 3175.67, N = 3 SE +/- 5092.34, N = 3 SE +/- 8981.65, N = 3 388441.98 603448.11 1165429.65 682715.71 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Forking Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 37.41, N = 3 SE +/- 44.23, N = 3 SE +/- 42.84, N = 3 SE +/- 44.04, N = 3 13111.86 13778.46 17166.22 15910.08 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE Default - IBRS retbleed=stuff mitigations=off retbleed=off 16K 32K 48K 64K 80K SE +/- 28.85, N = 3 SE +/- 7.12, N = 3 SE +/- 11.51, N = 3 SE +/- 20.22, N = 3 54816.64 52701.66 76342.18 58646.53 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Cache Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 2.33, N = 3 SE +/- 1.55, N = 3 SE +/- 2.61, N = 3 SE +/- 2.47, N = 3 158.46 152.96 157.33 153.84 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Stress Default - IBRS retbleed=stuff mitigations=off retbleed=off 2K 4K 6K 8K 10K SE +/- 93.45, N = 3 SE +/- 82.80, N = 3 SE +/- 5.67, N = 3 SE +/- 92.71, N = 3 7987.29 8039.91 8179.85 7966.42 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Semaphores Default - IBRS retbleed=stuff mitigations=off retbleed=off 160K 320K 480K 640K 800K SE +/- 6946.74, N = 15 SE +/- 7121.86, N = 15 SE +/- 5827.42, N = 15 SE +/- 7291.15, N = 12 699438.78 721201.26 755001.97 728080.34 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Matrix Math Default - IBRS retbleed=stuff mitigations=off retbleed=off 4K 8K 12K 16K 20K SE +/- 150.56, N = 3 SE +/- 237.67, N = 4 SE +/- 258.64, N = 3 SE +/- 44.22, N = 3 18152.96 17799.14 18017.30 18087.72 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Vector Math Default - IBRS retbleed=stuff mitigations=off retbleed=off 3K 6K 9K 12K 15K SE +/- 3.47, N = 3 SE +/- 8.67, N = 3 SE +/- 1.97, N = 3 SE +/- 25.94, N = 3 14401.85 14404.73 14411.60 14384.51 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: x86_64 RdRand Default - IBRS retbleed=stuff mitigations=off retbleed=off 40K 80K 120K 160K 200K SE +/- 25.86, N = 3 SE +/- 39.20, N = 3 SE +/- 2.25, N = 3 SE +/- 24.86, N = 3 4462.86 4492.76 194722.99 4482.55 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Memory Copying Default - IBRS retbleed=stuff mitigations=off retbleed=off 200 400 600 800 1000 SE +/- 8.53, N = 3 SE +/- 9.22, N = 7 SE +/- 9.06, N = 3 SE +/- 12.29, N = 3 850.74 834.84 834.50 843.09 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Socket Activity Default - IBRS retbleed=stuff mitigations=off retbleed=off 1000 2000 3000 4000 5000 SE +/- 4.43, N = 3 SE +/- 0.53, N = 3 SE +/- 2.42, N = 3 SE +/- 3.05, N = 3 2586.50 3422.60 4834.07 3720.58 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Context Switching Default - IBRS retbleed=stuff mitigations=off retbleed=off 300K 600K 900K 1200K 1500K SE +/- 2033.85, N = 3 SE +/- 679.86, N = 3 SE +/- 1094.09, N = 3 SE +/- 1335.54, N = 3 924510.28 1035968.53 1563150.01 1249349.81 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc C String Functions Default - IBRS retbleed=stuff mitigations=off retbleed=off 50K 100K 150K 200K 250K SE +/- 443.77, N = 3 SE +/- 612.75, N = 3 SE +/- 1033.29, N = 3 SE +/- 488.89, N = 3 243451.44 243636.88 240956.56 243127.33 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting Default - IBRS retbleed=stuff mitigations=off retbleed=off 13 26 39 52 65 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.27, N = 3 SE +/- 0.22, N = 3 55.55 55.86 55.82 55.73 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: System V Message Passing Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.4M 2.8M 4.2M 5.6M 7M SE +/- 521.34, N = 3 SE +/- 4395.83, N = 3 SE +/- 8723.09, N = 3 SE +/- 3066.42, N = 3 2107608.22 3337126.74 6558503.53 3767497.65 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -laio -lapparmor -latomic -lbsd -lc -lcrypt -ldl -lEGL -lgbm -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Mobile Neural Network MNN is the Mobile Neural Network as a highly efficient, lightweight deep learning framework developed by Alibaba. This MNN test profile is building the OpenMP / CPU threaded version for processor benchmarking and not any GPU-accelerated test. MNN does allow making use of AVX-512 extensions. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 16.57 15.90 14.19 16.42 MIN: 16.41 / MAX: 57.47 MIN: 15.64 / MAX: 34.5 MIN: 14.02 / MAX: 28.42 MIN: 16.2 / MAX: 35.7 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.504 1.008 1.512 2.016 2.52 SE +/- 0.006, N = 3 SE +/- 0.007, N = 3 SE +/- 0.002, N = 3 SE +/- 0.002, N = 3 2.240 2.058 1.797 2.102 MIN: 2.19 / MAX: 18.29 MIN: 2.02 / MAX: 3.45 MIN: 1.77 / MAX: 5.04 MIN: 2.07 / MAX: 6.28 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.0107 2.0214 3.0321 4.0428 5.0535 SE +/- 0.001, N = 3 SE +/- 0.016, N = 3 SE +/- 0.013, N = 3 SE +/- 0.016, N = 3 4.492 4.358 3.874 4.417 MIN: 4.44 / MAX: 9.15 MIN: 4.28 / MAX: 29.76 MIN: 3.82 / MAX: 4.21 MIN: 4.33 / MAX: 23.76 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 Default - IBRS retbleed=stuff mitigations=off retbleed=off 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 41.05 39.58 35.44 40.21 MIN: 40.85 / MAX: 88.28 MIN: 38.97 / MAX: 57.82 MIN: 35.31 / MAX: 50.16 MIN: 39.91 / MAX: 59.34 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.005, N = 3 SE +/- 0.013, N = 3 SE +/- 0.029, N = 3 SE +/- 0.017, N = 3 6.662 6.483 6.124 6.589 MIN: 6.58 / MAX: 8.88 MIN: 6.42 / MAX: 8.8 MIN: 6.04 / MAX: 16.59 MIN: 6.52 / MAX: 13.19 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.04 2.08 3.12 4.16 5.2 SE +/- 0.003, N = 3 SE +/- 0.006, N = 3 SE +/- 0.015, N = 3 SE +/- 0.027, N = 3 4.622 4.489 4.233 4.515 MIN: 4.58 / MAX: 6.62 MIN: 4.43 / MAX: 5.73 MIN: 4.17 / MAX: 7.41 MIN: 4.44 / MAX: 5.58 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.0283 2.0566 3.0849 4.1132 5.1415 SE +/- 0.005, N = 3 SE +/- 0.002, N = 3 SE +/- 0.004, N = 3 SE +/- 0.012, N = 3 4.570 4.501 4.421 4.528 MIN: 4.53 / MAX: 24.87 MIN: 4.46 / MAX: 5.13 MIN: 4.38 / MAX: 19.05 MIN: 4.48 / MAX: 8.73 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 Default - IBRS retbleed=stuff mitigations=off retbleed=off 11 22 33 44 55 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 3 46.87 45.85 43.41 46.33 MIN: 46.67 / MAX: 67.33 MIN: 45.65 / MAX: 64.31 MIN: 42.98 / MAX: 77.27 MIN: 46.01 / MAX: 65.9 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
NCNN NCNN is a high performance neural network inference framework optimized for mobile and other platforms developed by Tencent. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mobilenet Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 22.12 21.75 21.56 21.89 MIN: 21.87 / MAX: 33.68 MIN: 21.62 / MAX: 23.09 MIN: 21.42 / MAX: 22.85 MIN: 21.62 / MAX: 22.57 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 Default - IBRS retbleed=stuff mitigations=off retbleed=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 6.54 6.29 6.11 6.26 MIN: 6.46 / MAX: 6.94 MIN: 6.21 / MAX: 6.49 MIN: 6.04 / MAX: 6.27 MIN: 6.19 / MAX: 6.66 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.1858 2.3716 3.5574 4.7432 5.929 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 5.27 4.99 4.84 4.98 MIN: 5.2 / MAX: 5.71 MIN: 4.95 / MAX: 5.22 MIN: 4.78 / MAX: 16.71 MIN: 4.93 / MAX: 5.12 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: shufflenet-v2 Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.9473 1.8946 2.8419 3.7892 4.7365 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.21 3.91 3.74 3.89 MIN: 4.16 / MAX: 4.34 MIN: 3.87 / MAX: 4.05 MIN: 3.69 / MAX: 6.95 MIN: 3.85 / MAX: 5.06 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: mnasnet Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.1475 2.295 3.4425 4.59 5.7375 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 5.10 4.85 4.68 4.84 MIN: 5.04 / MAX: 5.46 MIN: 4.8 / MAX: 5.14 MIN: 4.64 / MAX: 7.37 MIN: 4.79 / MAX: 7.68 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: efficientnet-b0 Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 10.18 9.83 9.60 9.79 MIN: 10.11 / MAX: 10.58 MIN: 9.75 / MAX: 21.91 MIN: 9.52 / MAX: 21.53 MIN: 9.74 / MAX: 9.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: blazeface Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2903 0.5806 0.8709 1.1612 1.4515 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.29 1.11 0.99 1.08 MIN: 1.27 / MAX: 1.5 MIN: 1.08 / MAX: 1.38 MIN: 0.97 / MAX: 1.26 MIN: 1.06 / MAX: 1.36 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: googlenet Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 16.86 16.54 16.29 16.50 MIN: 16.75 / MAX: 18.33 MIN: 16.45 / MAX: 16.88 MIN: 16.22 / MAX: 16.6 MIN: 16.42 / MAX: 16.67 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vgg16 Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 78.30 78.38 78.26 78.35 MIN: 78.11 / MAX: 81.22 MIN: 78.15 / MAX: 90.52 MIN: 78.05 / MAX: 89.98 MIN: 78.11 / MAX: 89.13 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet18 Default - IBRS retbleed=stuff mitigations=off retbleed=off 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 14.37 14.25 14.12 14.30 MIN: 14.25 / MAX: 17.15 MIN: 14.14 / MAX: 15.65 MIN: 14.02 / MAX: 14.36 MIN: 14.1 / MAX: 29.85 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: alexnet Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 11.71 11.66 11.56 11.62 MIN: 11.65 / MAX: 11.92 MIN: 11.59 / MAX: 11.8 MIN: 11.5 / MAX: 12.06 MIN: 11.57 / MAX: 12.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: resnet50 Default - IBRS retbleed=stuff mitigations=off retbleed=off 7 14 21 28 35 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 31.84 31.50 31.29 31.50 MIN: 31.6 / MAX: 45.19 MIN: 31.34 / MAX: 34.28 MIN: 31.16 / MAX: 32.7 MIN: 31.34 / MAX: 32.41 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: yolov4-tiny Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.10, N = 3 32.51 32.31 32.19 32.42 MIN: 32.3 / MAX: 35.45 MIN: 32.17 / MAX: 40.14 MIN: 32.06 / MAX: 35.39 MIN: 32.2 / MAX: 35.38 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: squeezenet_ssd Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.22, N = 3 22.95 22.55 22.35 22.78 MIN: 22.77 / MAX: 25.96 MIN: 22.43 / MAX: 23.74 MIN: 22.23 / MAX: 23.47 MIN: 22.43 / MAX: 33.94 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: regnety_400m Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 13.55 11.75 10.61 11.70 MIN: 13.43 / MAX: 16.58 MIN: 11.68 / MAX: 14.61 MIN: 10.55 / MAX: 10.88 MIN: 11.6 / MAX: 23.72 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: vision_transformer Default - IBRS retbleed=stuff mitigations=off retbleed=off 90 180 270 360 450 SE +/- 5.45, N = 3 SE +/- 3.73, N = 3 SE +/- 0.09, N = 3 SE +/- 8.49, N = 3 422.28 421.62 413.10 422.01 MIN: 413.3 / MAX: 450.85 MIN: 413.1 / MAX: 442 MIN: 412.4 / MAX: 425.33 MIN: 412.79 / MAX: 552.82 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
OpenBenchmarking.org ms, Fewer Is Better NCNN 20220729 Target: CPU - Model: FastestDet Default - IBRS retbleed=stuff mitigations=off retbleed=off 1.2105 2.421 3.6315 4.842 6.0525 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 2 5.38 5.03 4.80 5.05 MIN: 5.27 / MAX: 5.74 MIN: 4.96 / MAX: 5.18 MIN: 4.76 / MAX: 5.78 MIN: 4.95 / MAX: 6.04 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only Default - IBRS retbleed=stuff mitigations=off retbleed=off 80 160 240 320 400 SE +/- 0.15, N = 3 SE +/- 0.72, N = 3 SE +/- 0.52, N = 3 SE +/- 0.06, N = 3 369.61 368.09 368.70 367.55
Facebook RocksDB OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Random Fill Default - IBRS retbleed=stuff mitigations=off retbleed=off 110K 220K 330K 440K 550K SE +/- 4120.62, N = 3 SE +/- 4573.03, N = 3 SE +/- 5841.02, N = 3 SE +/- 5715.80, N = 3 376107 389753 492900 456879 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Random Read Default - IBRS retbleed=stuff mitigations=off retbleed=off 4M 8M 12M 16M 20M SE +/- 180456.61, N = 3 SE +/- 82599.84, N = 3 SE +/- 104196.67, N = 3 SE +/- 227211.26, N = 4 17559091 17331836 17471957 17542385 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Update Random Default - IBRS retbleed=stuff mitigations=off retbleed=off 50K 100K 150K 200K 250K SE +/- 1397.10, N = 3 SE +/- 160.82, N = 3 SE +/- 2189.34, N = 3 SE +/- 440.67, N = 3 198089 218106 252250 228194 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Sequential Fill Default - IBRS retbleed=stuff mitigations=off retbleed=off 150K 300K 450K 600K 750K SE +/- 5351.57, N = 3 SE +/- 6126.72, N = 6 SE +/- 8478.51, N = 3 SE +/- 1867.35, N = 3 509051 520166 687932 613155 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Random Fill Sync Default - IBRS retbleed=stuff mitigations=off retbleed=off 150 300 450 600 750 SE +/- 4.73, N = 3 SE +/- 8.33, N = 3 SE +/- 9.10, N = 4 SE +/- 4.06, N = 3 674 664 663 701 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Read While Writing Default - IBRS retbleed=stuff mitigations=off retbleed=off 160K 320K 480K 640K 800K SE +/- 10015.04, N = 3 SE +/- 10552.54, N = 3 SE +/- 4523.86, N = 3 SE +/- 11857.59, N = 3 721604 759004 735461 737668 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Read Random Write Random Default - IBRS retbleed=stuff mitigations=off retbleed=off 160K 320K 480K 640K 800K SE +/- 2106.07, N = 3 SE +/- 4335.60, N = 3 SE +/- 8337.88, N = 3 SE +/- 4847.99, N = 3 640561 693910 750817 712151 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Numenta Anomaly Benchmark Numenta Anomaly Benchmark (NAB) is a benchmark for evaluating algorithms for anomaly detection in streaming, real-time applications. It is comprised of over 50 labeled real-world and artificial time-series data files plus a novel scoring mechanism designed for real-time applications. This test profile currently measures the time to run various detectors. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: KNN CAD Default - IBRS retbleed=stuff mitigations=off retbleed=off 90 180 270 360 450 SE +/- 5.51, N = 3 SE +/- 0.43, N = 3 SE +/- 1.85, N = 3 SE +/- 2.44, N = 3 423.22 410.61 402.73 413.52
OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 20.21 20.23 19.97 20.16
OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Default - IBRS retbleed=stuff mitigations=off retbleed=off 60 120 180 240 300 SE +/- 2.15, N = 3 SE +/- 1.77, N = 3 SE +/- 0.88, N = 3 SE +/- 1.62, N = 3 262.98 264.63 262.71 259.64
OpenBenchmarking.org Seconds, Fewer Is Better Numenta Anomaly Benchmark 1.1 Detector: Contextual Anomaly Detector OSE Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.29, N = 3 SE +/- 0.07, N = 3 SE +/- 0.68, N = 3 SE +/- 0.75, N = 3 92.52 92.43 93.69 92.95
nginx This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 20 Default - IBRS retbleed=stuff mitigations=off retbleed=off 7K 14K 21K 28K 35K SE +/- 6.23, N = 3 SE +/- 14.90, N = 3 SE +/- 28.27, N = 3 SE +/- 19.21, N = 3 23974.25 25852.17 30466.92 27933.18 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 100 Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 9.32, N = 3 SE +/- 16.02, N = 3 SE +/- 10.38, N = 3 SE +/- 29.95, N = 3 23838.53 25553.05 29875.46 27412.83 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 200 Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 23.99, N = 3 SE +/- 26.02, N = 3 SE +/- 7.45, N = 3 SE +/- 37.50, N = 3 23460.51 24909.11 28879.67 26593.58 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 13.33, N = 3 SE +/- 23.71, N = 3 SE +/- 46.53, N = 3 SE +/- 22.49, N = 3 22618.36 24113.33 27769.28 25604.08 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 98.51, N = 3 SE +/- 89.46, N = 3 SE +/- 181.77, N = 3 SE +/- 190.93, N = 3 21713.79 22945.29 26356.08 24256.31 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 4000 Default - IBRS retbleed=stuff mitigations=off retbleed=off 6K 12K 18K 24K 30K SE +/- 53.13, N = 3 SE +/- 174.05, N = 3 SE +/- 81.17, N = 3 SE +/- 35.92, N = 3 21430.71 22968.36 26090.31 24122.05 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
Selenium OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Firefox Default - IBRS retbleed=stuff mitigations=off retbleed=off 300 600 900 1200 1500 SE +/- 3.24, N = 3 SE +/- 5.53, N = 3 SE +/- 4.04, N = 3 SE +/- 2.56, N = 3 1250.0 1209.8 1185.1 1199.5 1. firefox 108.0
OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Jetstream 2 - Browser: Firefox Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.74, N = 3 SE +/- 0.35, N = 3 SE +/- 0.48, N = 3 SE +/- 1.06, N = 2 85.24 88.65 90.05 88.46 1. firefox 108.0
OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Firefox Default - IBRS retbleed=stuff mitigations=off retbleed=off 700 1400 2100 2800 3500 SE +/- 10.17, N = 3 SE +/- 3.46, N = 3 3438 3319 3237 3289 1. firefox 108.0
OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Firefox Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.10, N = 3 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 33.2 33.1 33.2 33.4 1. firefox 108.0
OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Firefox Default - IBRS retbleed=stuff mitigations=off retbleed=off 130 260 390 520 650 SE +/- 0.46, N = 3 SE +/- 1.11, N = 3 SE +/- 0.38, N = 3 SE +/- 5.12, N = 3 600.1 596.8 597.0 604.2 1. firefox 108.0
EnCodec EnCodec is a Facebook/Meta developed AI means of compressing audio files using High Fidelity Neural Audio Compression. EnCodec is designed to provide codec compression at 6 kbps using their novel AI-powered compression technique. The test profile uses a lengthy JFK speech as the audio input for benchmarking and the performance measurement is measuring the time to encode the EnCodec file from WAV. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 3 kbps Default - IBRS retbleed=stuff mitigations=off retbleed=off 15 30 45 60 75 SE +/- 0.25, N = 3 SE +/- 0.61, N = 3 SE +/- 0.56, N = 3 SE +/- 0.43, N = 3 65.37 55.98 49.65 52.56
OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 6 kbps Default - IBRS retbleed=stuff mitigations=off retbleed=off 15 30 45 60 75 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 66.95 56.78 50.37 53.18
OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 24 kbps Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 78.02 66.19 58.60 62.00
OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 1.5 kbps Default - IBRS retbleed=stuff mitigations=off retbleed=off 14 28 42 56 70 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.04, N = 3 64.16 54.66 48.26 51.01
BRL-CAD BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.32.6 VGR Performance Metric Default - IBRS retbleed=stuff mitigations=off retbleed=off 11K 22K 33K 44K 55K 50086 50064 50104 50358 1. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -pthread -ldl -lm
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.2723 0.5446 0.8169 1.0892 1.3615 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.20 1.21 1.21 1.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 700 1400 2100 2800 3500 SE +/- 10.60, N = 3 SE +/- 21.15, N = 3 SE +/- 7.27, N = 3 SE +/- 4.07, N = 3 3306.20 3287.93 3278.21 3285.23 MIN: 3204.79 / MAX: 3381.05 MIN: 3168.84 / MAX: 3380.01 MIN: 3175.59 / MAX: 3371.08 MIN: 3201.26 / MAX: 3383.3 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.1665 0.333 0.4995 0.666 0.8325 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.73 0.73 0.74 0.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 1100 2200 3300 4400 5500 SE +/- 1.25, N = 3 SE +/- 1.80, N = 3 SE +/- 3.89, N = 3 SE +/- 2.51, N = 3 5354.18 5337.23 5313.90 5325.14 MIN: 5048.06 / MAX: 5756.34 MIN: 5005.81 / MAX: 5704.35 MIN: 4979.6 / MAX: 5629.68 MIN: 5015.25 / MAX: 5648.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.1643 0.3286 0.4929 0.6572 0.8215 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.73 0.73 0.73 0.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 1100 2200 3300 4400 5500 SE +/- 1.67, N = 3 SE +/- 2.07, N = 3 SE +/- 2.90, N = 3 SE +/- 4.26, N = 3 5351.08 5339.56 5323.79 5332.52 MIN: 5029.61 / MAX: 5757.54 MIN: 5008.95 / MAX: 5703.69 MIN: 4982.73 / MAX: 5635.02 MIN: 5010.51 / MAX: 5668.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 20 40 60 80 100 SE +/- 1.30, N = 3 SE +/- 0.95, N = 3 SE +/- 0.97, N = 3 SE +/- 1.28, N = 3 86.02 85.95 85.47 83.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 11 22 33 44 55 SE +/- 0.69, N = 3 SE +/- 0.51, N = 3 SE +/- 0.54, N = 3 SE +/- 0.72, N = 3 46.50 46.53 46.78 47.63 MIN: 23.98 / MAX: 69.29 MIN: 20.85 / MAX: 70.17 MIN: 24.61 / MAX: 68.31 MIN: 23.65 / MAX: 68.25 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.4995 0.999 1.4985 1.998 2.4975 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.22 2.22 2.22 2.22 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 400 800 1200 1600 2000 SE +/- 0.52, N = 3 SE +/- 0.78, N = 3 SE +/- 0.01, N = 3 SE +/- 1.34, N = 3 1797.13 1797.93 1798.30 1798.51 MIN: 1747.57 / MAX: 1809.8 MIN: 1733.26 / MAX: 1816.74 MIN: 1724.05 / MAX: 1818.82 MIN: 1690.1 / MAX: 1919.15 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.38, N = 3 SE +/- 0.43, N = 3 SE +/- 0.26, N = 3 SE +/- 0.06, N = 3 136.56 137.20 136.24 137.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 7 14 21 28 35 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 29.27 29.14 29.34 29.14 MIN: 16.56 / MAX: 45.71 MIN: 16.05 / MAX: 46.79 MIN: 15.88 / MAX: 47.74 MIN: 16.39 / MAX: 45.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 30 60 90 120 150 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 113.01 112.97 113.00 112.88 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 35.40 35.38 35.38 35.41 MIN: 29.04 / MAX: 52.04 MIN: 25.81 / MAX: 52.06 MIN: 27.55 / MAX: 52.33 MIN: 25.78 / MAX: 52.57 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 3 6 9 12 15 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 13.20 13.14 13.18 13.24 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 70 140 210 280 350 SE +/- 1.98, N = 3 SE +/- 0.65, N = 3 SE +/- 1.48, N = 3 SE +/- 1.21, N = 3 302.54 303.87 303.09 301.63 MIN: 242.68 / MAX: 511.74 MIN: 164.49 / MAX: 327.96 MIN: 253.91 / MAX: 325.11 MIN: 253.21 / MAX: 326.2 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 50 100 150 200 250 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.14, N = 3 218.59 218.69 218.83 218.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 18.28 18.27 18.26 18.29 MIN: 10 / MAX: 37.03 MIN: 9.77 / MAX: 32.89 MIN: 9.82 / MAX: 32.91 MIN: 9.75 / MAX: 33.94 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 40 80 120 160 200 SE +/- 0.26, N = 3 SE +/- 1.41, N = 3 SE +/- 1.24, N = 3 SE +/- 0.93, N = 3 157.85 153.37 150.46 158.52 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.22, N = 3 SE +/- 0.15, N = 3 25.32 26.06 26.57 25.22 MIN: 12.97 / MAX: 44.7 MIN: 12.62 / MAX: 46.95 MIN: 12.63 / MAX: 42.23 MIN: 13.24 / MAX: 45.16 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 600 1200 1800 2400 3000 SE +/- 6.84, N = 3 SE +/- 3.22, N = 3 SE +/- 8.23, N = 3 SE +/- 7.59, N = 3 2662.48 2703.22 2689.53 2722.58 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.333 0.666 0.999 1.332 1.665 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 1.48 1.46 1.47 1.45 MIN: 0.93 / MAX: 20.4 MIN: 0.89 / MAX: 21.29 MIN: 0.88 / MAX: 20.32 MIN: 0.83 / MAX: 20.85 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 700 1400 2100 2800 3500 SE +/- 4.13, N = 3 SE +/- 3.18, N = 3 SE +/- 1.99, N = 3 SE +/- 19.88, N = 3 2968.92 3031.90 3056.03 3051.91 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Default - IBRS retbleed=stuff mitigations=off retbleed=off 0.297 0.594 0.891 1.188 1.485 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 1.32 1.30 1.29 1.29 MIN: 0.77 / MAX: 18.67 MIN: 0.74 / MAX: 17.31 MIN: 0.71 / MAX: 19.3 MIN: 0.76 / MAX: 19.6 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Default - IBRS Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
Testing initiated at 20 December 2022 15:14 by user phoronix.
retbleed=stuff Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Stuffing + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
Testing initiated at 22 December 2022 06:00 by user phoronix.
mitigations=off Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: vulnerable + mds: Vulnerable; SMT vulnerable + meltdown: Vulnerable + mmio_stale_data: Vulnerable + retbleed: Vulnerable + spec_store_bypass: Vulnerable + spectre_v1: Vulnerable: __user pointer sanitization and usercopy barriers only; no swapgs barriers + spectre_v2: Vulnerable IBPB: disabled STIBP: disabled PBRSB-eIBRS: Not affected + srbds: Vulnerable + tsx_async_abort: Mitigation of TSX disabled
Testing initiated at 23 December 2022 15:05 by user phoronix.
retbleed=off Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads), Motherboard: MSI Z170A SLI PLUS (MS-7998) v1.0 (2.A0 BIOS), Chipset: Intel Xeon E3-1200 v5/E3-1500, Memory: 32GB, Disk: 256GB TOSHIBA RD400, Graphics: ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SP, Audio: Realtek ALC1150, Monitor: VA2431, Network: Intel I219-V
OS: Ubuntu 20.04, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, OpenGL: 4.5 Mesa 21.2.6 (LLVM 12.0.0), Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 1.9.1Java Notes: OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu220.04)Python Notes: Python 3.8.10Security Notes: itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
Testing initiated at 25 December 2022 04:17 by user phoronix.