12400 march Intel Core i5-12400 testing with a MSI PRO Z690-A WIFI DDR4(MS-7D25) v1.0 (Dasharo coreboot+UEFI v1.0.0 BIOS) and MSI Intel ADL-S GT1 14GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2303066-NE-12400MARC37&grr&sro .
12400 march Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution a b c Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads) MSI PRO Z690-A WIFI DDR4(MS-7D25) v1.0 (Dasharo coreboot+UEFI v1.0.0 BIOS) Intel Device 7aa7 16GB Western Digital WD_BLACK SN750 SE 500GB MSI Intel ADL-S GT1 14GB (1450MHz) Realtek ALC897 DELL S2409W Intel I225-V + Intel Device 7af0 Ubuntu 22.04 5.15.0-47-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.0.1 1.2.204 GCC 11.2.0 ext4 1920x1080 GCC 11.3.0 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - a: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - b: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x1f - Thermald 2.4.9 Python Details - Python 3.10.6 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected
12400 march blender: Barbershop - CPU-Only nekrs: TurboPipe Periodic build-linux-kernel: allmodconfig clickhouse: 100M Rows Hits Dataset, Third Run clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache tensorflow: CPU - 512 - GoogLeNet openradioss: INIVOL and Fluid Structure Interaction Drop Container tensorflow: CPU - 256 - GoogLeNet blender: Pabellon Barcelona - CPU-Only openems: pyEMS Coupler brl-cad: VGR Performance Metric minibude: OpenMP - BM2 minibude: OpenMP - BM2 blender: Classroom - CPU-Only tensorflow: CPU - 512 - AlexNet pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write pgbench: 100 - 250 - Read Write - Average Latency pgbench: 100 - 250 - Read Write pgbench: 100 - 500 - Read Write - Average Latency pgbench: 100 - 500 - Read Write pgbench: 100 - 100 - Read Write - Average Latency pgbench: 100 - 100 - Read Write openvkl: vklBenchmark ISPC keydb: HMSET - 100 openradioss: Bird Strike on Windshield pgbench: 1 - 800 - Read Write - Average Latency pgbench: 1 - 800 - Read Write openvkl: vklBenchmark Scalar pgbench: 1 - 500 - Read Write - Average Latency pgbench: 1 - 500 - Read Write jpegxl: JPEG - 100 jpegxl: PNG - 100 xmrig: Monero - 1M pgbench: 100 - 800 - Read Write - Average Latency pgbench: 100 - 800 - Read Write tensorflow: CPU - 256 - AlexNet ffmpeg: libx264 - Upload ffmpeg: libx264 - Upload cockroach: MoVR - 128 blender: Fishy Cat - CPU-Only openradioss: Rubber O-Ring Seal Installation build-linux-kernel: defconfig aom-av1: Speed 0 Two-Pass - Bosphorus 4K compress-zstd: 19 - Decompression Speed compress-zstd: 19 - Compression Speed vvenc: Bosphorus 4K - Fast gromacs: MPI CPU - water_GMX50_bare rocksdb: Rand Fill keydb: LPUSH - 100 avifenc: 0 ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Video On Demand openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU ffmpeg: libx265 - Upload ffmpeg: libx265 - Upload ffmpeg: libx265 - Platform ffmpeg: libx265 - Platform xmrig: Wownero - 1M openradioss: Bumper Beam tensorflow: CPU - 64 - GoogLeNet blender: BMW27 - CPU-Only ffmpeg: libx264 - Video On Demand ffmpeg: libx264 - Video On Demand ffmpeg: libx264 - Platform ffmpeg: libx264 - Platform pgbench: 1 - 500 - Read Only - Average Latency pgbench: 1 - 500 - Read Only encodec: 24 kbps pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Only jpegxl: JPEG - 80 pgbench: 100 - 800 - Read Only - Average Latency pgbench: 100 - 800 - Read Only keydb: SADD - 50 pgbench: 100 - 500 - Read Only - Average Latency pgbench: 100 - 500 - Read Only jpegxl: PNG - 80 aom-av1: Speed 4 Two-Pass - Bosphorus 4K pgbench: 100 - 250 - Read Only - Average Latency pgbench: 100 - 250 - Read Only minibude: OpenMP - BM1 minibude: OpenMP - BM1 openradioss: Cell Phone Drop Test uvg266: Bosphorus 4K - Slow keydb: LPOP - 50 pgbench: 100 - 100 - Read Only - Average Latency pgbench: 100 - 100 - Read Only scikit-learn: Sparse Rand Projections, 100 Iterations keydb: GET - 50 pgbench: 1 - 1000 - Read Write - Average Latency pgbench: 1 - 1000 - Read Write aom-av1: Speed 0 Two-Pass - Bosphorus 1080p stargate: 192000 - 512 deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream encodec: 3 kbps keydb: SET - 50 pgbench: 1 - 250 - Read Write - Average Latency pgbench: 1 - 250 - Read Write pgbench: 1 - 100 - Read Write - Average Latency pgbench: 1 - 100 - Read Write pgbench: 1 - 800 - Read Only - Average Latency pgbench: 1 - 800 - Read Only pgbench: 1 - 1000 - Read Only - Average Latency pgbench: 1 - 1000 - Read Only pgbench: 1 - 100 - Read Only - Average Latency pgbench: 1 - 100 - Read Only pgbench: 1 - 250 - Read Only - Average Latency pgbench: 1 - 250 - Read Only uvg266: Bosphorus 4K - Medium keydb: LPOP - 100 stargate: 192000 - 1024 jpegxl: JPEG - 90 jpegxl: PNG - 90 deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream vpxenc: Speed 0 - Bosphorus 4K cockroach: KV, 10% Reads - 512 cockroach: KV, 10% Reads - 1024 cockroach: KV, 95% Reads - 1024 cockroach: KV, 50% Reads - 1024 cockroach: KV, 60% Reads - 1024 cockroach: KV, 95% Reads - 512 cockroach: KV, 50% Reads - 512 cockroach: KV, 60% Reads - 512 cockroach: KV, 60% Reads - 256 cockroach: KV, 50% Reads - 256 cockroach: KV, 95% Reads - 256 cockroach: KV, 10% Reads - 256 cockroach: KV, 50% Reads - 128 cockroach: KV, 10% Reads - 128 cockroach: KV, 60% Reads - 128 cockroach: KV, 95% Reads - 128 keydb: HMSET - 50 stress-ng: Atomic stress-ng: Context Switching stress-ng: MMAP stress-ng: Socket Activity stress-ng: Futex stress-ng: IO_uring deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream vvenc: Bosphorus 4K - Faster cockroach: MoVR - 256 cockroach: MoVR - 512 cockroach: MoVR - 1024 rocksdb: Rand Read encode-flac: WAV To FLAC kvazaar: Bosphorus 4K - Slow kvazaar: Bosphorus 4K - Medium scikit-learn: MNIST Dataset tensorflow: CPU - 32 - GoogLeNet nginx: 200 nginx: 1000 nginx: 500 nginx: 100 nginx: 20 onednn: Recurrent Neural Network Training - u8s8f32 - CPU onednn: Recurrent Neural Network Training - f32 - CPU onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPU avifenc: 2 stargate: 96000 - 512 rocksdb: Update Rand onednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPU stress-ng: MEMFD stress-ng: CPU Cache embree: Pathtracer - Asian Dragon Obj onednn: Recurrent Neural Network Inference - f32 - CPU onednn: Recurrent Neural Network Inference - u8s8f32 - CPU stargate: 96000 - 1024 tensorflow: CPU - 64 - AlexNet aom-av1: Speed 6 Two-Pass - Bosphorus 4K embree: Pathtracer ISPC - Asian Dragon Obj embree: Pathtracer - Crown vvenc: Bosphorus 1080p - Fast svt-av1: Preset 4 - Bosphorus 4K unvanquished: 1920 x 1080 - Ultra onednn: Deconvolution Batch shapes_1d - f32 - CPU onednn: Deconvolution Batch shapes_1d - u8s8f32 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU embree: Pathtracer ISPC - Crown openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU embree: Pathtracer - Asian Dragon stress-ng: Glibc C String Functions keydb: SET - 100 stargate: 44100 - 512 compress-zstd: 8 - Decompression Speed compress-zstd: 8 - Compression Speed rocksdb: Rand Fill Sync stargate: 480000 - 512 openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU compress-zstd: 3, Long Mode - Decompression Speed compress-zstd: 3, Long Mode - Compression Speed compress-zstd: 3 - Decompression Speed compress-zstd: 3 - Compression Speed compress-zstd: 12 - Decompression Speed compress-zstd: 12 - Compression Speed openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU compress-zstd: 8, Long Mode - Decompression Speed compress-zstd: 8, Long Mode - Compression Speed compress-zstd: 19, Long Mode - Decompression Speed compress-zstd: 19, Long Mode - Compression Speed ffmpeg: libx265 - Live ffmpeg: libx265 - Live stargate: 44100 - 1024 build-ffmpeg: Time To Compile openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU rocksdb: Read While Writing openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU stargate: 480000 - 1024 openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU rocksdb: Read Rand Write Rand embree: Pathtracer ISPC - Asian Dragon keydb: LPUSH - 50 jpegxl-decode: 1 aom-av1: Speed 4 Two-Pass - Bosphorus 1080p deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream onednn: IP Shapes 1D - f32 - CPU deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream onednn: IP Shapes 1D - u8s8f32 - CPU vpxenc: Speed 5 - Bosphorus 4K vpxenc: Speed 0 - Bosphorus 1080p keydb: SADD - 100 tensorflow: CPU - 16 - GoogLeNet deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream tensorflow: CPU - 32 - AlexNet unvanquished: 1920 x 1080 - High deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream keydb: GET - 100 uvg266: Bosphorus 4K - Very Fast deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream uvg266: Bosphorus 4K - Super Fast openems: openEMS MSL_NotchFilter deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream cpuminer-opt: LBC, LBRY Credits deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream ffmpeg: libx264 - Live ffmpeg: libx264 - Live encodec: 6 kbps deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream aom-av1: Speed 6 Realtime - Bosphorus 4K encodec: 1.5 kbps deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream stress-ng: Pthread kvazaar: Bosphorus 4K - Very Fast cpuminer-opt: Garlicoin uvg266: Bosphorus 4K - Ultra Fast unvanquished: 1920 x 1080 - Medium aom-av1: Speed 10 Realtime - Bosphorus 4K onednn: IP Shapes 3D - u8s8f32 - CPU tensorflow: CPU - 16 - AlexNet stress-ng: Zlib stress-ng: System V Message Passing stress-ng: Hash stress-ng: Poll stress-ng: Memory Copying stress-ng: NUMA cpuminer-opt: Myriad-Groestl stress-ng: Malloc stress-ng: Matrix Math stress-ng: Function Call stress-ng: Vector Math cpuminer-opt: Skeincoin cpuminer-opt: Blake-2 S stress-ng: Mutex stress-ng: CPU Stress stress-ng: SENDFILE stress-ng: x86_64 RdRand stress-ng: Glibc Qsort Data Sorting stress-ng: Crypto stress-ng: Semaphores stress-ng: Forking cpuminer-opt: Triple SHA-256, Onecoin cpuminer-opt: Magi cpuminer-opt: Deepcoin cpuminer-opt: x25x cpuminer-opt: scrypt cpuminer-opt: Ringcoin vvenc: Bosphorus 1080p - Faster cpuminer-opt: Quad SHA-256, Pyrite kvazaar: Bosphorus 4K - Super Fast uvg266: Bosphorus 1080p - Slow jpegxl-decode: All scikit-learn: TSNE MNIST Dataset uvg266: Bosphorus 1080p - Medium svt-av1: Preset 8 - Bosphorus 4K aom-av1: Speed 6 Two-Pass - Bosphorus 1080p avifenc: 10, Lossless svt-av1: Preset 4 - Bosphorus 1080p kvazaar: Bosphorus 4K - Ultra Fast vpxenc: Speed 5 - Bosphorus 1080p kvazaar: Bosphorus 1080p - Slow kvazaar: Bosphorus 1080p - Medium aom-av1: Speed 6 Realtime - Bosphorus 1080p aom-av1: Speed 8 Realtime - Bosphorus 4K avifenc: 6, Lossless aom-av1: Speed 10 Realtime - Bosphorus 1080p onednn: Matrix Multiply Batch Shapes Transformer - f32 - CPU onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU aom-av1: Speed 8 Realtime - Bosphorus 1080p aom-av1: Speed 9 Realtime - Bosphorus 1080p aom-av1: Speed 9 Realtime - Bosphorus 4K onednn: Deconvolution Batch shapes_3d - f32 - CPU onednn: Deconvolution Batch shapes_3d - u8s8f32 - CPU uvg266: Bosphorus 1080p - Very Fast onednn: IP Shapes 3D - f32 - CPU avifenc: 6 uvg266: Bosphorus 1080p - Super Fast svt-av1: Preset 12 - Bosphorus 4K rocksdb: Seq Fill kvazaar: Bosphorus 1080p - Very Fast svt-av1: Preset 8 - Bosphorus 1080p uvg266: Bosphorus 1080p - Ultra Fast svt-av1: Preset 13 - Bosphorus 4K kvazaar: Bosphorus 1080p - Super Fast onednn: Convolution Batch Shapes Auto - f32 - CPU onednn: Convolution Batch Shapes Auto - u8s8f32 - CPU kvazaar: Bosphorus 1080p - Ultra Fast svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p onednn: IP Shapes 1D - bf16bf16bf16 - CPU a b c 1913.71 29844655556 1605.965 133.73 130.84 112.08 44.65 862.76 43.37 602.17 39.72 132931 9.747 243.662 493.25 117.88 246.313 4070 60.802 4148 113.076 4472 24.552 4114 120 361525.21 378.02 2891.941 277 68 1561.269 321 0.68 0.69 2901.8 188.706 4252 107.91 13.50 187.09 176.4 242.51 236.87 117.653 0.15 1516.3 12.6 2.696 0.852 846457 976117.59 195.068 43.25 175.13 27.97 143.21 21.20 119.13 44.40 170.61 5359.8 187.49 41.05 172.01 48.80 155.27 51.90 145.95 1.393 359165 44.558 4.141 241540 7.93 3.031 263950 1345962.36 1.573 317872 8.05 5.12 0.634 394526 9.780 244.489 141.00 4.11 1403220.97 0.185 541410 142.729 1481042.42 3797.314 263 0.50 1.272677 129.7351 23.1401 38.663 1249454.75 681.418 367 258.427 387 2.606 307018 3.458 289205 0.162 617706 0.541 462071 4.58 1301994.00 1.398663 7.79 7.94 65.1167 46.1009 5.76 25625.0 26050.8 40249.9 30338.7 32151.8 43281.7 32781.2 35029.4 34782.8 30043.8 49613.5 17827.6 16123.0 9270.5 20255.7 52512.6 511218.21 146.11 1897936.07 74.70 8703.54 1579624.88 1965.75 32.7332 30.5731 6.065 181.6 177.4 177.4 41614110 17.324 6.34 6.53 90.146 40.17 61096.58 41663.17 51922.48 67993.52 62961.45 4341.92 4329.65 4334.97 88.246 1.930960 629944 2437.96 58.57 83.60 8.7102 2438.21 2406.13 2.071669 88.60 9.11 9.5706 8.4875 7.977 2.185 100.6 8.69748 1.52665 3384.14 1.17 3438.18 1.15 9.3366 2257.17 1.75 9.6958 1220179.93 1069422.99 2.578599 1732.4 202.6 1351 2.624567 552.79 7.21 1619.4 869.3 1592.6 1567.8 1758.9 77.1 184.37 21.68 1727.9 198.4 1444.4 7.00 120.17 42.02 2.705122 61.468 14.44 276.78 31.87 188.17 11.47 348.49 1518515 8.41 712.70 2.743784 0.95 6331.01 1.06 5560.27 1546655 11.0588 1323318.97 50.05 13.31 371.2707 8.0798 530.8351 5.6401 4.09853 530.1789 5.6434 1.251871 12.73 12.18 1148270.29 38.89 42.3370 70.8341 125.2707 7.9821 77.95 170.8 136.2739 22.0196 1283175.58 13.25 182.9823 5.4650 184.6546 5.4154 51.1472 19.5514 13.98 98.88 49.6401 20.1421 18438 20.3269 49.1789 239.86 21.05 38.516 91.1945 32.8927 55.33 36.915 26.0851 38.3366 40.4680 74.0988 15.5670 64.2327 128698.01 16.45 1836.59 16.99 248.2 58.76 2.50462 60.81 717.35 8216877.60 1548492.99 823762.13 2301.69 244.13 11237 5226456.99 45892.79 49787.62 41733.97 47853 282207 4254720.23 17781.86 177365.84 81909.45 101.42 14276.39 1189258.32 54276.34 78157 331.49 6392.10 344.30 110.87 1560.09 20.155 48250 20.38 21.53 217.33 26.914 24.11 27.441 31.69 6.571 7.737 27.83 32.75 32.53 34.46 147.69 45.87 13.461 175.80 3.59719 1.20219 139.13 188.81 57.99 8.93885 2.00020 62.33 10.3722 9.175 67.09 88.426 1502792 74.79 81.453 80.01 95.565 93.48 16.5925 18.2750 123.26 348.114 398.861 1918.11 30699700000 1581.695 130.95 129.64 114.01 44.7 855.12 43.6 601.73 39.86 132058 9.819 245.471 491.93 118.22 273.835 3652 68.072 3673 103.714 4821 23.642 4230 120 360477.28 375.59 2861.265 280 69 1536.855 325 0.69 0.69 2943.7 217.462 3679 108.69 13.43 188.02 161.5 242.4 233.55 117.843 0.16 1512.3 12.3 2.742 0.851 866381 1010733.94 193.626 44.31 170.95 31.54 126.78 21.11 119.626569107 44.36 170.76 5362.5 187.53 40.8 169.97 51.90 145.95 51.56 146.92 1.329 376302 43.528 4.159 240426 8.06 2.903 275540 1920122.88 1.581 316288 8.19 5.22 0.613 407921 10.18 254.507 141.91 4.22 1585238.25 0.182 549838 142.603 1373626.38 4001.537 250 0.54 1.272057 126.3428 23.743 38.375 1253729.88 702.475 356 260.581 384 2.654 301467 3.517 284352 0.16 624238 0.529 472171 4.64 1336505.38 1.387099 7.89 8.09 64.2317 46.6993 5.72 24787.3 26158.4 40176.2 30358.1 32001.2 43180.1 32901.1 34456.3 34070.8 30151.3 49024 17639.6 15644.6 9148.7 19591.8 51610.2 518247.5 145.01 1941869.46 50.26 9385.83 1723742.38 1723.13 32.2883 30.9632 5.893 173.6 177.3 177.4 43152112 19.297 6.52 6.64 90.819 40.32 61654.77 42015.72 51890.45 68835.78 64372.01 4289.21 4234.91 4270.75 87.041 1.918443 624540 2403.19 41.65 89.5 8.7168 2398.62 2394.33 2.048931 88.45 9.15 9.6296 8.7189 8.085 2.257 100.5 8.37239 1.41538 3363.57 1.18 3394.57 1.16 9.5395 2239.72 1.77 9.7857 1273002.92 1146000.38 2.570597 1733.2 203.6 1239 2.593242 541.21 7.39 1618.7 866.5 1596.2 1588.6 1761.7 77.2 182.53 21.87 1725.8 199.8 1451.7 7.06 119.65 42.21 2.697438 59.353 14.31 279.3 31.53 190.2 11.49 347.83 1531157 8.32 719.91 2.722846 0.94 6344.82 1.04 5661.39 1562812 11.1432 1252473.62 50.83 13.31 371.9694 8.0647 522.759 5.7386 3.9326 526.9595 5.6888 1.64076 12.02 11.57 1137811.75 39.2 50.8421 58.9625 123.9679 8.0658 77.8 171.1 146.7171 20.4372 1382055.38 13.57 185.0876 5.4027 183.8898 5.4379 52.8025 18.9371 14.3 98.72 58.9068 16.973 19200 20.3874 49.0317 241.95 20.87 41.175 88.7828 33.7778 54.93 41.029 26.5668 37.6351 38.4298 78.0436 15.3717 65.0336 130862.38 17.22 1908.99 17.49 248.1 58.66 2.45278 61.24 717.62 8225295.79 1549710.05 823948.19 2295.12 246.58 11090 5241054.32 46046.48 49807.05 41733.47 48410 302980 4273551.98 17780.76 176973.24 81907.97 102.53 14261.23 1190334.27 52494.81 77950 327.09 6428.9 367.28 111.65 1583.58 20.859 48310 21.04 22.34 226.31 26.708 25.05 27.782 31.54 6.438 7.809 29.11 32.33 33.27 34.52 145.58 46.2 13.724 177.46 3.59364 1.19925 139.06 171.53 58.45 8.13373 2.01154 64.1 10.557 9.277 67.46 69.565 1511361 74.73 81.399 79.81 96.58 93.52 16.6124 18.4063 121.82 348.913 399.081 1921.09 30696900000 1591.758 137.07 134.75 112.44 44.62 854.21 43.37 604.27 39.95 132368 9.809 245.226 492.05 118.5 221.36 4518 41.632 6005 82.83 6036 19.602 5102 121 343680.41 376.26 2990.051 268 68 1495.631 334 0.69 0.7 2952.3 124.508 6425 108.83 13.45 187.76 161.5 242.75 235.09 118.795 0.16 1515.1 12.4 2.725 0.849 1102439 967773.12 195.07 44.55 170.03 26.79 149.21 21.24 118.90 44.53 170.11 5388.2 188.06 40.83 169.98 51.73 146.45 52.00 145.67 1.368 365485 45.309 4.302 232445 8.09 3.025 264500 1225640.5 1.573 317863 8.22 5.17 0.608 411468 10.172 254.306 141.1 4.2 1479465 0.184 544459 142.501 1690102.75 3967.365 252 0.54 1.267444 125.3122 23.9381 40.903 1422030.12 697.892 358 252.003 397 2.552 313503 3.521 283973 0.157 638011 0.537 465619 4.62 1303645 1.392746 7.96 8.09 63.1436 47.5035 5.73 25709 26199.1 40255.3 30286.7 31560.1 43303.9 32572.9 34933.3 34301.1 29377.9 49764.2 17585.4 15733 9128.1 19566.6 51080.3 506124.09 162.65 1906264.57 49.73 9379.73 1689762.38 2856.89 32.2818 30.97 5.857 173.8 173.9 176.1 42975995 19.609 6.45 6.6 90.838 40.08 61396.93 42016.88 51737.26 68707.49 64314.45 4303.62 4253.17 4291.98 86.434 1.923352 664157 4000.34 52.99 72.1 8.7124 2410.16 2388.51 2.05266 89.08 9.21 9.5837 8.6301 8.02 2.25 100.7 8.4404 1.4093 3402.11 1.15 3413.87 1.16 9.482 2256.4 1.75 9.7544 1288214.51 1049912.88 2.575363 1734.3 203.6 3193 2.60295 549.42 7.28 1620.2 866.1 1598.4 1583.6 1762.2 77.3 185.48 21.54 1728.6 200.4 1447.2 7.02 118.36 42.67 2.687449 59.453 14.37 278.2 31.68 189.32 11.54 346.34 1532546 8.35 717.7 2.717116 0.94 6357.31 1.04 5687.23 1568201 11.1121 1317870.38 50.48 13.31 373.2362 8.0373 519.6558 5.7729 3.95246 520.9494 5.7586 0.959942 12.25 12.69 1193659.25 38.53 41.8658 71.6306 123.9547 8.0666 77.44 170.7 135.4278 22.1491 1273333.88 13.5 185.1037 5.4023 183.6924 5.4437 50.8162 19.6773 14.24 98.77 48.5207 20.6062 19710 20.2639 49.3305 235.80 21.42 40.12 90.1585 33.2636 55.31 38.706 25.2518 39.5957 39.0101 76.8831 15.3825 64.9894 132268.72 17.13 1895.32 17.41 248.2 58.53 2.43532 60.69 716.14 8192747.72 1548182.16 823174.05 2285.43 245 11100 5200128.82 45978.84 49784.19 41779.98 48670 295250 4254389.29 17782.21 178115.64 81907.39 102.73 14271.88 1188758.84 54204.65 77940 326.58 6368.98 368.41 111.66 1586.86 20.592 48320 20.92 22.14 225.63 26.864 24.96 27.504 32.35 6.439 7.75 28.85 32.38 33.22 34.5 169.96 46.08 13.727 168.56 3.60705 1.18228 140.47 201.29 58.38 9.3367 2.0105 64.13 10.4342 9.268 67.36 68.862 1461566 75.04 81.021 79.41 95.093 93.3 16.5893 18.2347 123.33 347.219 397.306 OpenBenchmarking.org
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Barbershop - Compute: CPU-Only a b c 400 800 1200 1600 2000 SE +/- 2.57, N = 3 1913.71 1918.11 1921.09
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic a b c 7000M 14000M 21000M 28000M 35000M SE +/- 533119138.01, N = 9 29844655556 30699700000 30696900000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: allmodconfig a b c 300 600 900 1200 1500 SE +/- 2.13, N = 3 1605.97 1581.70 1591.76
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run a b c 30 60 90 120 150 SE +/- 0.37, N = 9 133.73 130.95 137.07 MIN: 6.54 / MAX: 8571.43 MIN: 7.08 / MAX: 6000 MIN: 7.03 / MAX: 7500
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run a b c 30 60 90 120 150 SE +/- 0.66, N = 9 130.84 129.64 134.75 MIN: 6.51 / MAX: 8571.43 MIN: 7.07 / MAX: 6000 MIN: 7.04 / MAX: 8571.43
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache a b c 30 60 90 120 150 SE +/- 1.04, N = 9 112.08 114.01 112.44 MIN: 6.36 / MAX: 6666.67 MIN: 6.89 / MAX: 5000 MIN: 6.91 / MAX: 5454.55
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet a b c 10 20 30 40 50 SE +/- 0.04, N = 3 44.65 44.70 44.62
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container a b c 200 400 600 800 1000 SE +/- 5.89, N = 3 862.76 855.12 854.21
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet a b c 10 20 30 40 50 SE +/- 0.04, N = 3 43.37 43.60 43.37
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Pabellon Barcelona - Compute: CPU-Only a b c 130 260 390 520 650 SE +/- 0.41, N = 3 602.17 601.73 604.27
OpenEMS Test: pyEMS Coupler OpenBenchmarking.org MCells/s, More Is Better OpenEMS 0.0.35-86 Test: pyEMS Coupler a b c 9 18 27 36 45 SE +/- 0.06, N = 3 39.72 39.86 39.95 1. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.34 VGR Performance Metric a b c 30K 60K 90K 120K 150K 132931 132058 132368 1. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 a b c 3 6 9 12 15 SE +/- 0.016, N = 3 9.747 9.819 9.809 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 a b c 50 100 150 200 250 SE +/- 0.41, N = 3 243.66 245.47 245.23 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only a b c 110 220 330 440 550 SE +/- 0.90, N = 3 493.25 491.93 492.05
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet a b c 30 60 90 120 150 SE +/- 0.47, N = 3 117.88 118.22 118.50
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency a b c 60 120 180 240 300 SE +/- 3.72, N = 12 246.31 273.84 221.36 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write a b c 1000 2000 3000 4000 5000 SE +/- 59.66, N = 12 4070 3652 4518 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency a b c 15 30 45 60 75 SE +/- 1.63, N = 12 60.80 68.07 41.63 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 250 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write a b c 1300 2600 3900 5200 6500 SE +/- 122.04, N = 12 4148 3673 6005 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency a b c 30 60 90 120 150 SE +/- 3.53, N = 12 113.08 103.71 82.83 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 500 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Write a b c 1300 2600 3900 5200 6500 SE +/- 146.05, N = 12 4472 4821 6036 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency a b c 6 12 18 24 30 SE +/- 0.75, N = 12 24.55 23.64 19.60 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 100 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write a b c 1100 2200 3300 4400 5500 SE +/- 122.37, N = 12 4114 4230 5102 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC a b c 30 60 90 120 150 SE +/- 0.67, N = 3 120 120 121 MIN: 15 / MAX: 1750 MIN: 15 / MAX: 1749 MIN: 15 / MAX: 1739
KeyDB Test: HMSET - Parallel Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: HMSET - Parallel Connections: 100 a b c 80K 160K 240K 320K 400K SE +/- 3780.33, N = 12 361525.21 360477.28 343680.41 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield a b c 80 160 240 320 400 SE +/- 1.35, N = 3 378.02 375.59 376.26
PostgreSQL Scaling Factor: 1 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 800 - Mode: Read Write - Average Latency a b c 600 1200 1800 2400 3000 SE +/- 26.55, N = 12 2891.94 2861.27 2990.05 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 800 - Mode: Read Write a b c 60 120 180 240 300 SE +/- 2.63, N = 12 277 280 268 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenVKL Benchmark: vklBenchmark Scalar OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark Scalar a b c 15 30 45 60 75 SE +/- 0.33, N = 3 68 69 68 MIN: 7 / MAX: 1212 MIN: 7 / MAX: 1201 MIN: 7 / MAX: 1202
PostgreSQL Scaling Factor: 1 - Clients: 500 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Write - Average Latency a b c 300 600 900 1200 1500 SE +/- 15.49, N = 12 1561.27 1536.86 1495.63 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 500 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Write a b c 70 140 210 280 350 SE +/- 3.20, N = 12 321 325 334 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
JPEG XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 a b c 0.1553 0.3106 0.4659 0.6212 0.7765 SE +/- 0.00, N = 3 0.68 0.69 0.69 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: PNG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 100 a b c 0.1575 0.315 0.4725 0.63 0.7875 SE +/- 0.00, N = 3 0.69 0.69 0.70 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Monero - Hash Count: 1M a b c 600 1200 1800 2400 3000 SE +/- 10.62, N = 3 2901.8 2943.7 2952.3 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency a b c 50 100 150 200 250 SE +/- 3.52, N = 9 188.71 217.46 124.51 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write a b c 1400 2800 4200 5600 7000 SE +/- 83.04, N = 9 4252 3679 6425 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet a b c 20 40 60 80 100 SE +/- 0.09, N = 3 107.91 108.69 108.83
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload a b c 3 6 9 12 15 SE +/- 0.02, N = 3 13.50 13.43 13.45 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Upload a b c 40 80 120 160 200 SE +/- 0.26, N = 3 187.09 188.02 187.76 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
CockroachDB Workload: MoVR - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 128 a b c 40 80 120 160 200 SE +/- 1.32, N = 11 176.4 161.5 161.5
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Fishy Cat - Compute: CPU-Only a b c 50 100 150 200 250 SE +/- 0.25, N = 3 242.51 242.40 242.75
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation a b c 50 100 150 200 250 SE +/- 1.23, N = 3 236.87 233.55 235.09
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig a b c 30 60 90 120 150 SE +/- 1.00, N = 8 117.65 117.84 118.80
AOM AV1 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K a b c 0.036 0.072 0.108 0.144 0.18 SE +/- 0.00, N = 7 0.15 0.16 0.16 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
Zstd Compression Compression Level: 19 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed a b c 300 600 900 1200 1500 SE +/- 0.83, N = 15 1516.3 1512.3 1515.1 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 19 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed a b c 3 6 9 12 15 SE +/- 0.10, N = 15 12.6 12.3 12.4 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast a b c 0.617 1.234 1.851 2.468 3.085 SE +/- 0.016, N = 3 2.696 2.742 2.725 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare a b c 0.1917 0.3834 0.5751 0.7668 0.9585 SE +/- 0.003, N = 3 0.852 0.851 0.849 1. (CXX) g++ options: -O3
RocksDB Test: Random Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill a b c 200K 400K 600K 800K 1000K SE +/- 20633.51, N = 15 846457 866381 1102439 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
KeyDB Test: LPUSH - Parallel Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 100 a b c 200K 400K 600K 800K 1000K SE +/- 10077.27, N = 15 976117.59 1010733.94 967773.12 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 0 a b c 40 80 120 160 200 SE +/- 0.94, N = 3 195.07 193.63 195.07 1. (CXX) g++ options: -O3 -fPIC -lm
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand a b c 10 20 30 40 50 SE +/- 0.04, N = 3 43.25 44.31 44.55 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand a b c 40 80 120 160 200 SE +/- 0.16, N = 3 175.13 170.95 170.03 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU a b c 7 14 21 28 35 SE +/- 0.37, N = 14 27.97 31.54 26.79 MIN: 19.8 / MAX: 50.33 MIN: 19.58 / MAX: 49.19 MIN: 21.9 / MAX: 44.22 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU a b c 30 60 90 120 150 SE +/- 1.79, N = 14 143.21 126.78 149.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload a b c 5 10 15 20 25 SE +/- 0.03, N = 3 21.20 21.11 21.24 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Upload a b c 30 60 90 120 150 SE +/- 0.17, N = 3 119.13 119.63 118.90 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform a b c 10 20 30 40 50 SE +/- 0.03, N = 3 44.40 44.36 44.53 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Platform a b c 40 80 120 160 200 SE +/- 0.12, N = 3 170.61 170.76 170.11 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M a b c 1200 2400 3600 4800 6000 SE +/- 13.58, N = 3 5359.8 5362.5 5388.2 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam a b c 40 80 120 160 200 SE +/- 0.32, N = 3 187.49 187.53 188.06
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet a b c 9 18 27 36 45 SE +/- 0.09, N = 3 41.05 40.80 40.83
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only a b c 40 80 120 160 200 SE +/- 1.22, N = 3 172.01 169.97 169.98
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand a b c 12 24 36 48 60 SE +/- 0.66, N = 3 48.80 51.90 51.73 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Video On Demand OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand a b c 30 60 90 120 150 SE +/- 2.11, N = 3 155.27 145.95 146.45 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform a b c 12 24 36 48 60 SE +/- 0.27, N = 3 51.90 51.56 52.00 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Platform OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Platform a b c 30 60 90 120 150 SE +/- 0.75, N = 3 145.95 146.92 145.67 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
PostgreSQL Scaling Factor: 1 - Clients: 500 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Only - Average Latency a b c 0.3134 0.6268 0.9402 1.2536 1.567 SE +/- 0.016, N = 4 1.393 1.329 1.368 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 500 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Only a b c 80K 160K 240K 320K 400K SE +/- 3941.00, N = 4 359165 376302 365485 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
EnCodec Target Bandwidth: 24 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 24 kbps a b c 10 20 30 40 50 SE +/- 0.52, N = 15 44.56 43.53 45.31
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency a b c 0.968 1.936 2.904 3.872 4.84 SE +/- 0.034, N = 3 4.141 4.159 4.302 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only a b c 50K 100K 150K 200K 250K SE +/- 1961.46, N = 3 241540 240426 232445 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
JPEG XL libjxl Input: JPEG - Quality: 80 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 a b c 2 4 6 8 10 SE +/- 0.01, N = 3 7.93 8.06 8.09 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency a b c 0.682 1.364 2.046 2.728 3.41 SE +/- 0.027, N = 3 3.031 2.903 3.025 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only a b c 60K 120K 180K 240K 300K SE +/- 2360.08, N = 3 263950 275540 264500 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
KeyDB Test: SADD - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: SADD - Parallel Connections: 50 a b c 400K 800K 1200K 1600K 2000K SE +/- 44518.65, N = 15 1345962.36 1920122.88 1225640.50 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
PostgreSQL Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency a b c 0.3557 0.7114 1.0671 1.4228 1.7785 SE +/- 0.012, N = 3 1.573 1.581 1.573 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 500 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Only a b c 70K 140K 210K 280K 350K SE +/- 2326.54, N = 3 317872 316288 317863 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
JPEG XL libjxl Input: PNG - Quality: 80 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 80 a b c 2 4 6 8 10 SE +/- 0.00, N = 3 8.05 8.19 8.22 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
AOM AV1 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K a b c 1.1745 2.349 3.5235 4.698 5.8725 SE +/- 0.00, N = 3 5.12 5.22 5.17 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
PostgreSQL Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency a b c 0.1427 0.2854 0.4281 0.5708 0.7135 SE +/- 0.005, N = 3 0.634 0.613 0.608 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 250 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only a b c 90K 180K 270K 360K 450K SE +/- 2783.61, N = 3 394526 407921 411468 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 a b c 3 6 9 12 15 SE +/- 0.087, N = 7 9.780 10.180 10.172 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 a b c 60 120 180 240 300 SE +/- 2.17, N = 7 244.49 254.51 254.31 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Cell Phone Drop Test a b c 30 60 90 120 150 SE +/- 0.15, N = 3 141.00 141.91 141.10
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow a b c 0.9495 1.899 2.8485 3.798 4.7475 SE +/- 0.05, N = 3 4.11 4.22 4.20
KeyDB Test: LPOP - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: LPOP - Parallel Connections: 50 a b c 300K 600K 900K 1200K 1500K SE +/- 22923.50, N = 15 1403220.97 1585238.25 1479465.00 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
PostgreSQL Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency a b c 0.0416 0.0832 0.1248 0.1664 0.208 SE +/- 0.001, N = 3 0.185 0.182 0.184 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 100 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only a b c 120K 240K 360K 480K 600K SE +/- 1426.41, N = 3 541410 549838 544459 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scikit-Learn Benchmark: Sparse Random Projections, 100 Iterations OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 1.1.3 Benchmark: Sparse Random Projections, 100 Iterations a b c 30 60 90 120 150 SE +/- 0.14, N = 3 142.73 142.60 142.50
KeyDB Test: GET - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: GET - Parallel Connections: 50 a b c 400K 800K 1200K 1600K 2000K SE +/- 63048.39, N = 15 1481042.42 1373626.38 1690102.75 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
PostgreSQL Scaling Factor: 1 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1000 - Mode: Read Write - Average Latency a b c 900 1800 2700 3600 4500 SE +/- 35.63, N = 3 3797.31 4001.54 3967.37 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1000 - Mode: Read Write a b c 60 120 180 240 300 SE +/- 2.49, N = 3 263 250 252 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
AOM AV1 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p a b c 0.1215 0.243 0.3645 0.486 0.6075 SE +/- 0.00, N = 15 0.50 0.54 0.54 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
Stargate Digital Audio Workstation Sample Rate: 192000 - Buffer Size: 512 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 192000 - Buffer Size: 512 a b c 0.2864 0.5728 0.8592 1.1456 1.432 SE +/- 0.003098, N = 3 1.272677 1.272057 1.267444 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream a b c 30 60 90 120 150 SE +/- 1.18, N = 12 129.74 126.34 125.31
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream a b c 6 12 18 24 30 SE +/- 0.20, N = 12 23.14 23.74 23.94
EnCodec Target Bandwidth: 3 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 3 kbps a b c 9 18 27 36 45 SE +/- 0.60, N = 15 38.66 38.38 40.90
KeyDB Test: SET - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: SET - Parallel Connections: 50 a b c 300K 600K 900K 1200K 1500K SE +/- 40517.71, N = 12 1249454.75 1253729.88 1422030.12 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
PostgreSQL Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency a b c 150 300 450 600 750 SE +/- 4.83, N = 3 681.42 702.48 697.89 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 250 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write a b c 80 160 240 320 400 SE +/- 2.61, N = 3 367 356 358 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency a b c 60 120 180 240 300 SE +/- 1.27, N = 3 258.43 260.58 252.00 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 100 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write a b c 90 180 270 360 450 SE +/- 1.90, N = 3 387 384 397 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 800 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 800 - Mode: Read Only - Average Latency a b c 0.5972 1.1944 1.7916 2.3888 2.986 SE +/- 0.012, N = 3 2.606 2.654 2.552 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 800 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 800 - Mode: Read Only a b c 70K 140K 210K 280K 350K SE +/- 1379.07, N = 3 307018 301467 313503 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1000 - Mode: Read Only - Average Latency a b c 0.7922 1.5844 2.3766 3.1688 3.961 SE +/- 0.034, N = 3 3.458 3.517 3.521 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 1000 - Mode: Read Only a b c 60K 120K 180K 240K 300K SE +/- 2823.16, N = 3 289205 284352 283973 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency a b c 0.0365 0.073 0.1095 0.146 0.1825 SE +/- 0.001, N = 3 0.162 0.160 0.157 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 100 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only a b c 140K 280K 420K 560K 700K SE +/- 4488.67, N = 3 617706 624238 638011 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency a b c 0.1217 0.2434 0.3651 0.4868 0.6085 SE +/- 0.008, N = 3 0.541 0.529 0.537 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 1 - Clients: 250 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only a b c 100K 200K 300K 400K 500K SE +/- 6603.78, N = 3 462071 472171 465619 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium a b c 1.044 2.088 3.132 4.176 5.22 SE +/- 0.01, N = 3 4.58 4.64 4.62
KeyDB Test: LPOP - Parallel Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: LPOP - Parallel Connections: 100 a b c 300K 600K 900K 1200K 1500K SE +/- 37181.44, N = 12 1301994.00 1336505.38 1303645.00 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
Stargate Digital Audio Workstation Sample Rate: 192000 - Buffer Size: 1024 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 192000 - Buffer Size: 1024 a b c 0.3147 0.6294 0.9441 1.2588 1.5735 SE +/- 0.005117, N = 3 1.398663 1.387099 1.392746 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
JPEG XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 a b c 2 4 6 8 10 SE +/- 0.01, N = 3 7.79 7.89 7.96 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
JPEG XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 90 a b c 2 4 6 8 10 SE +/- 0.01, N = 3 7.94 8.09 8.09 1. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream a b c 15 30 45 60 75 SE +/- 0.58, N = 12 65.12 64.23 63.14
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream a b c 11 22 33 44 55 SE +/- 0.38, N = 12 46.10 46.70 47.50
VP9 libvpx Encoding Speed: Speed 0 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 4K a b c 1.296 2.592 3.888 5.184 6.48 SE +/- 0.02, N = 3 5.76 5.72 5.73 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
CockroachDB Workload: KV, 10% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 512 a b c 6K 12K 18K 24K 30K SE +/- 297.75, N = 3 25625.0 24787.3 25709.0
CockroachDB Workload: KV, 10% Reads - Concurrency: 1024 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 1024 a b c 6K 12K 18K 24K 30K SE +/- 369.95, N = 3 26050.8 26158.4 26199.1
CockroachDB Workload: KV, 95% Reads - Concurrency: 1024 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 1024 a b c 9K 18K 27K 36K 45K SE +/- 52.10, N = 3 40249.9 40176.2 40255.3
CockroachDB Workload: KV, 50% Reads - Concurrency: 1024 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 1024 a b c 7K 14K 21K 28K 35K SE +/- 65.26, N = 3 30338.7 30358.1 30286.7
CockroachDB Workload: KV, 60% Reads - Concurrency: 1024 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 1024 a b c 7K 14K 21K 28K 35K SE +/- 47.74, N = 3 32151.8 32001.2 31560.1
CockroachDB Workload: KV, 95% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 a b c 9K 18K 27K 36K 45K SE +/- 83.04, N = 3 43281.7 43180.1 43303.9
CockroachDB Workload: KV, 50% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 a b c 7K 14K 21K 28K 35K SE +/- 338.62, N = 3 32781.2 32901.1 32572.9
CockroachDB Workload: KV, 60% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 a b c 8K 16K 24K 32K 40K SE +/- 342.69, N = 3 35029.4 34456.3 34933.3
CockroachDB Workload: KV, 60% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 256 a b c 7K 14K 21K 28K 35K SE +/- 405.43, N = 3 34782.8 34070.8 34301.1
CockroachDB Workload: KV, 50% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 256 a b c 6K 12K 18K 24K 30K SE +/- 375.67, N = 3 30043.8 30151.3 29377.9
CockroachDB Workload: KV, 95% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 256 a b c 11K 22K 33K 44K 55K SE +/- 168.75, N = 3 49613.5 49024.0 49764.2
CockroachDB Workload: KV, 10% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 256 a b c 4K 8K 12K 16K 20K SE +/- 126.23, N = 3 17827.6 17639.6 17585.4
CockroachDB Workload: KV, 50% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 128 a b c 3K 6K 9K 12K 15K SE +/- 199.13, N = 3 16123.0 15644.6 15733.0
CockroachDB Workload: KV, 10% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 128 a b c 2K 4K 6K 8K 10K SE +/- 11.01, N = 3 9270.5 9148.7 9128.1
CockroachDB Workload: KV, 60% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 128 a b c 4K 8K 12K 16K 20K SE +/- 104.08, N = 3 20255.7 19591.8 19566.6
CockroachDB Workload: KV, 95% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 128 a b c 11K 22K 33K 44K 55K SE +/- 345.86, N = 3 52512.6 51610.2 51080.3
KeyDB Test: HMSET - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: HMSET - Parallel Connections: 50 a b c 110K 220K 330K 440K 550K SE +/- 2335.08, N = 3 511218.21 518247.50 506124.09 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
Stress-NG Test: Atomic OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Atomic a b c 40 80 120 160 200 SE +/- 3.12, N = 15 146.11 145.01 162.65 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Context Switching a b c 400K 800K 1200K 1600K 2000K SE +/- 48908.21, N = 15 1897936.07 1941869.46 1906264.57 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: MMAP OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: MMAP a b c 20 40 60 80 100 SE +/- 2.50, N = 15 74.70 50.26 49.73 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Socket Activity a b c 2K 4K 6K 8K 10K SE +/- 146.72, N = 15 8703.54 9385.83 9379.73 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Futex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Futex a b c 400K 800K 1200K 1600K 2000K SE +/- 41062.68, N = 15 1579624.88 1723742.38 1689762.38 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: IO_uring OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: IO_uring a b c 600 1200 1800 2400 3000 SE +/- 36.56, N = 15 1965.75 1723.13 2856.89 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream a b c 8 16 24 32 40 SE +/- 0.33, N = 12 32.73 32.29 32.28
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream a b c 7 14 21 28 35 SE +/- 0.28, N = 12 30.57 30.96 30.97
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster a b c 2 4 6 8 10 SE +/- 0.017, N = 3 6.065 5.893 5.857 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
CockroachDB Workload: MoVR - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 256 a b c 40 80 120 160 200 SE +/- 0.00, N = 3 181.6 173.6 173.8
CockroachDB Workload: MoVR - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 512 a b c 40 80 120 160 200 SE +/- 0.00, N = 3 177.4 177.3 173.9
CockroachDB Workload: MoVR - Concurrency: 1024 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 1024 a b c 40 80 120 160 200 SE +/- 0.06, N = 3 177.4 177.4 176.1
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read a b c 9M 18M 27M 36M 45M SE +/- 414703.47, N = 6 41614110 43152112 42975995 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
FLAC Audio Encoding WAV To FLAC OpenBenchmarking.org Seconds, Fewer Is Better FLAC Audio Encoding 1.4 WAV To FLAC a b c 5 10 15 20 25 SE +/- 0.15, N = 25 17.32 19.30 19.61 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
Kvazaar Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow a b c 2 4 6 8 10 SE +/- 0.03, N = 3 6.34 6.52 6.45 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium a b c 2 4 6 8 10 SE +/- 0.02, N = 3 6.53 6.64 6.60 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Scikit-Learn Benchmark: MNIST Dataset OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 1.1.3 Benchmark: MNIST Dataset a b c 20 40 60 80 100 SE +/- 0.23, N = 3 90.15 90.82 90.84
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet a b c 9 18 27 36 45 SE +/- 0.11, N = 3 40.17 40.32 40.08
nginx Connections: 200 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 200 a b c 13K 26K 39K 52K 65K SE +/- 149.19, N = 3 61096.58 61654.77 61396.93 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 a b c 9K 18K 27K 36K 45K SE +/- 203.43, N = 3 41663.17 42015.72 42016.88 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 a b c 11K 22K 33K 44K 55K SE +/- 61.89, N = 3 51922.48 51890.45 51737.26 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 100 a b c 15K 30K 45K 60K 75K SE +/- 335.89, N = 3 67993.52 68835.78 68707.49 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
nginx Connections: 20 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 20 a b c 14K 28K 42K 56K 70K SE +/- 804.71, N = 3 62961.45 64372.01 64314.45 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
oneDNN Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU a b c 900 1800 2700 3600 4500 SE +/- 2.56, N = 3 4341.92 4289.21 4303.62 MIN: 4124.68 MIN: 4045.19 MIN: 4079.69 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU a b c 900 1800 2700 3600 4500 SE +/- 15.35, N = 3 4329.65 4234.91 4253.17 MIN: 4088.59 MIN: 4027.35 MIN: 4043.25 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU a b c 900 1800 2700 3600 4500 SE +/- 5.86, N = 3 4334.97 4270.75 4291.98 MIN: 4122.67 MIN: 4043.43 MIN: 4067.51 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 2 a b c 20 40 60 80 100 SE +/- 0.11, N = 3 88.25 87.04 86.43 1. (CXX) g++ options: -O3 -fPIC -lm
Stargate Digital Audio Workstation Sample Rate: 96000 - Buffer Size: 512 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 96000 - Buffer Size: 512 a b c 0.4345 0.869 1.3035 1.738 2.1725 SE +/- 0.000948, N = 3 1.930960 1.918443 1.923352 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random a b c 140K 280K 420K 560K 700K SE +/- 6561.15, N = 5 629944 624540 664157 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
oneDNN Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU a b c 900 1800 2700 3600 4500 SE +/- 4.94, N = 3 2437.96 2403.19 4000.34 MIN: 2279.1 MIN: 2251.07 MIN: 3992.83 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Stress-NG Test: MEMFD OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: MEMFD a b c 13 26 39 52 65 SE +/- 3.98, N = 12 58.57 41.65 52.99 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: CPU Cache OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: CPU Cache a b c 20 40 60 80 100 SE +/- 2.33, N = 12 83.60 89.50 72.10 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Embree Binary: Pathtracer - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Obj a b c 2 4 6 8 10 SE +/- 0.0103, N = 3 8.7102 8.7168 8.7124 MIN: 8.64 / MAX: 8.85 MIN: 8.66 / MAX: 8.83 MIN: 8.66 / MAX: 8.86
oneDNN Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU a b c 500 1000 1500 2000 2500 SE +/- 3.98, N = 3 2438.21 2398.62 2410.16 MIN: 2279.8 MIN: 2251.99 MIN: 2254.61 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU a b c 500 1000 1500 2000 2500 SE +/- 22.77, N = 3 2406.13 2394.33 2388.51 MIN: 2255.86 MIN: 2261.91 MIN: 2252.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Stargate Digital Audio Workstation Sample Rate: 96000 - Buffer Size: 1024 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 96000 - Buffer Size: 1024 a b c 0.4661 0.9322 1.3983 1.8644 2.3305 SE +/- 0.001510, N = 3 2.071669 2.048931 2.052660 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet a b c 20 40 60 80 100 SE +/- 0.49, N = 3 88.60 88.45 89.08
AOM AV1 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K a b c 3 6 9 12 15 SE +/- 0.03, N = 3 9.11 9.15 9.21 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Obj a b c 3 6 9 12 15 SE +/- 0.0123, N = 3 9.5706 9.6296 9.5837 MIN: 9.47 / MAX: 9.79 MIN: 9.56 / MAX: 9.84 MIN: 9.5 / MAX: 9.8
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Crown a b c 2 4 6 8 10 SE +/- 0.0433, N = 3 8.4875 8.7189 8.6301 MIN: 8.32 / MAX: 8.82 MIN: 8.66 / MAX: 8.9 MIN: 8.56 / MAX: 8.78
VVenC Video Input: Bosphorus 1080p - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast a b c 2 4 6 8 10 SE +/- 0.014, N = 3 7.977 8.085 8.020 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 4K a b c 0.5078 1.0156 1.5234 2.0312 2.539 SE +/- 0.007, N = 3 2.185 2.257 2.250 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Unvanquished Resolution: 1920 x 1080 - Effects Quality: Ultra OpenBenchmarking.org Frames Per Second, More Is Better Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Ultra a b c 20 40 60 80 100 SE +/- 0.03, N = 3 100.6 100.5 100.7
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU a b c 2 4 6 8 10 SE +/- 0.17183, N = 15 8.69748 8.37239 8.44040 MIN: 5.76 MIN: 5.85 MIN: 5.8 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU a b c 0.3435 0.687 1.0305 1.374 1.7175 SE +/- 0.01138, N = 15 1.52665 1.41538 1.40930 MIN: 1.39 MIN: 1.39 MIN: 1.39 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU a b c 700 1400 2100 2800 3500 SE +/- 16.56, N = 3 3384.14 3363.57 3402.11 MIN: 3150.48 / MAX: 4797.77 MIN: 3197.76 / MAX: 3701.88 MIN: 3157.9 / MAX: 5910.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU a b c 0.2655 0.531 0.7965 1.062 1.3275 SE +/- 0.01, N = 3 1.17 1.18 1.15 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU a b c 700 1400 2100 2800 3500 SE +/- 29.12, N = 3 3438.18 3394.57 3413.87 MIN: 3203.29 / MAX: 4311.69 MIN: 3178.76 / MAX: 3780.74 MIN: 3197.21 / MAX: 4433.43 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU a b c 0.261 0.522 0.783 1.044 1.305 SE +/- 0.01, N = 3 1.15 1.16 1.16 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown a b c 3 6 9 12 15 SE +/- 0.0598, N = 3 9.3366 9.5395 9.4820 MIN: 9.13 / MAX: 9.88 MIN: 9.33 / MAX: 9.85 MIN: 9.26 / MAX: 9.81
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU a b c 500 1000 1500 2000 2500 SE +/- 12.95, N = 3 2257.17 2239.72 2256.40 MIN: 2132.88 / MAX: 3216.45 MIN: 2149.54 / MAX: 2500.68 MIN: 2134.57 / MAX: 2467.9 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU a b c 0.3983 0.7966 1.1949 1.5932 1.9915 SE +/- 0.02, N = 3 1.75 1.77 1.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon a b c 3 6 9 12 15 SE +/- 0.0065, N = 3 9.6958 9.7857 9.7544 MIN: 9.6 / MAX: 9.92 MIN: 9.73 / MAX: 9.93 MIN: 9.7 / MAX: 9.87
Stress-NG Test: Glibc C String Functions OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Glibc C String Functions a b c 300K 600K 900K 1200K 1500K SE +/- 9938.23, N = 9 1220179.93 1273002.92 1288214.51 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
KeyDB Test: SET - Parallel Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: SET - Parallel Connections: 100 a b c 200K 400K 600K 800K 1000K SE +/- 12223.15, N = 4 1069422.99 1146000.38 1049912.88 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
Stargate Digital Audio Workstation Sample Rate: 44100 - Buffer Size: 512 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 44100 - Buffer Size: 512 a b c 0.5802 1.1604 1.7406 2.3208 2.901 SE +/- 0.005177, N = 3 2.578599 2.570597 2.575363 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Zstd Compression Compression Level: 8 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8 - Decompression Speed a b c 400 800 1200 1600 2000 SE +/- 0.97, N = 3 1732.4 1733.2 1734.3 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 8 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8 - Compression Speed a b c 40 80 120 160 200 SE +/- 0.20, N = 3 202.6 203.6 203.6 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
RocksDB Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync a b c 700 1400 2100 2800 3500 SE +/- 15.17, N = 3 1351 1239 3193 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Stargate Digital Audio Workstation Sample Rate: 480000 - Buffer Size: 512 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 480000 - Buffer Size: 512 a b c 0.5905 1.181 1.7715 2.362 2.9525 SE +/- 0.002482, N = 3 2.624567 2.593242 2.602950 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU a b c 120 240 360 480 600 SE +/- 2.23, N = 3 552.79 541.21 549.42 MIN: 501.54 / MAX: 634.83 MIN: 503.72 / MAX: 633.37 MIN: 502.92 / MAX: 645.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU a b c 2 4 6 8 10 SE +/- 0.04, N = 3 7.21 7.39 7.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Zstd Compression Compression Level: 3, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Decompression Speed a b c 300 600 900 1200 1500 SE +/- 0.35, N = 3 1619.4 1618.7 1620.2 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 3, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Compression Speed a b c 200 400 600 800 1000 SE +/- 6.47, N = 3 869.3 866.5 866.1 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 3 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3 - Decompression Speed a b c 300 600 900 1200 1500 SE +/- 0.86, N = 3 1592.6 1596.2 1598.4 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 3 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3 - Compression Speed a b c 300 600 900 1200 1500 SE +/- 1.71, N = 3 1567.8 1588.6 1583.6 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 12 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 12 - Decompression Speed a b c 400 800 1200 1600 2000 SE +/- 3.74, N = 3 1758.9 1761.7 1762.2 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 12 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 12 - Compression Speed a b c 20 40 60 80 100 SE +/- 0.23, N = 3 77.1 77.2 77.3 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU a b c 40 80 120 160 200 SE +/- 0.73, N = 3 184.37 182.53 185.48 MIN: 164.97 / MAX: 226.63 MIN: 165.34 / MAX: 243.94 MIN: 166.33 / MAX: 257.37 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU a b c 5 10 15 20 25 SE +/- 0.09, N = 3 21.68 21.87 21.54 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Zstd Compression Compression Level: 8, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Decompression Speed a b c 400 800 1200 1600 2000 SE +/- 1.39, N = 3 1727.9 1725.8 1728.6 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 8, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Compression Speed a b c 40 80 120 160 200 SE +/- 0.15, N = 3 198.4 199.8 200.4 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 19, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed a b c 300 600 900 1200 1500 SE +/- 1.17, N = 3 1444.4 1451.7 1447.2 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
Zstd Compression Compression Level: 19, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed a b c 2 4 6 8 10 SE +/- 0.01, N = 3 7.00 7.06 7.02 1. (CC) gcc options: -O3 -pthread -lz -llzma -llz4
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live a b c 30 60 90 120 150 SE +/- 0.43, N = 3 120.17 119.65 118.36 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx265 - Scenario: Live a b c 10 20 30 40 50 SE +/- 0.15, N = 3 42.02 42.21 42.67 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
Stargate Digital Audio Workstation Sample Rate: 44100 - Buffer Size: 1024 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 44100 - Buffer Size: 1024 a b c 0.6087 1.2174 1.8261 2.4348 3.0435 SE +/- 0.000534, N = 3 2.705122 2.697438 2.687449 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
Timed FFmpeg Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 6.0 Time To Compile a b c 14 28 42 56 70 SE +/- 0.68, N = 3 61.47 59.35 59.45
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c 4 8 12 16 20 SE +/- 0.07, N = 3 14.44 14.31 14.37 MIN: 12.82 / MAX: 32.76 MIN: 12.84 / MAX: 26.05 MIN: 12.83 / MAX: 26.08 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c 60 120 180 240 300 SE +/- 1.32, N = 3 276.78 279.30 278.20 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU a b c 7 14 21 28 35 SE +/- 0.15, N = 3 31.87 31.53 31.68 MIN: 28.47 / MAX: 39.41 MIN: 28.51 / MAX: 38.58 MIN: 28.34 / MAX: 39.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU a b c 40 80 120 160 200 SE +/- 0.88, N = 3 188.17 190.20 189.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c 3 6 9 12 15 SE +/- 0.05, N = 3 11.47 11.49 11.54 MIN: 10.23 / MAX: 55.04 MIN: 10.24 / MAX: 17.75 MIN: 10.23 / MAX: 58.55 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c 80 160 240 320 400 SE +/- 1.63, N = 3 348.49 347.83 346.34 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing a b c 300K 600K 900K 1200K 1500K SE +/- 18612.51, N = 3 1518515 1531157 1532546 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c 2 4 6 8 10 SE +/- 0.04, N = 3 8.41 8.32 8.35 MIN: 7.49 / MAX: 16.85 MIN: 7.49 / MAX: 14.34 MIN: 7.49 / MAX: 38.94 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c 160 320 480 640 800 SE +/- 3.68, N = 3 712.70 719.91 717.70 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
Stargate Digital Audio Workstation Sample Rate: 480000 - Buffer Size: 1024 OpenBenchmarking.org Render Ratio, More Is Better Stargate Digital Audio Workstation 22.11.5 Sample Rate: 480000 - Buffer Size: 1024 a b c 0.6174 1.2348 1.8522 2.4696 3.087 SE +/- 0.003205, N = 3 2.743784 2.722846 2.717116 1. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c 0.2138 0.4276 0.6414 0.8552 1.069 SE +/- 0.00, N = 3 0.95 0.94 0.94 MIN: 0.85 / MAX: 7.32 MIN: 0.85 / MAX: 6.61 MIN: 0.84 / MAX: 7.1 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c 1400 2800 4200 5600 7000 SE +/- 19.43, N = 3 6331.01 6344.82 6357.31 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c 0.2385 0.477 0.7155 0.954 1.1925 SE +/- 0.01, N = 3 1.06 1.04 1.04 MIN: 0.92 / MAX: 68.14 MIN: 0.92 / MAX: 7.17 MIN: 0.92 / MAX: 4.88 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c 1200 2400 3600 4800 6000 SE +/- 27.53, N = 3 5560.27 5661.39 5687.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random a b c 300K 600K 900K 1200K 1500K SE +/- 6061.26, N = 3 1546655 1562812 1568201 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon a b c 3 6 9 12 15 SE +/- 0.03, N = 3 11.06 11.14 11.11 MIN: 10.93 / MAX: 11.31 MIN: 11.05 / MAX: 11.33 MIN: 11.03 / MAX: 11.35
KeyDB Test: LPUSH - Parallel Connections: 50 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 50 a b c 300K 600K 900K 1200K 1500K SE +/- 14149.76, N = 4 1323318.97 1252473.62 1317870.38 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
JPEG XL Decoding libjxl CPU Threads: 1 OpenBenchmarking.org MP/s, More Is Better JPEG XL Decoding libjxl 0.7 CPU Threads: 1 a b c 11 22 33 44 55 SE +/- 0.34, N = 3 50.05 50.83 50.48
AOM AV1 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p a b c 3 6 9 12 15 SE +/- 0.13, N = 3 13.31 13.31 13.31 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream a b c 80 160 240 320 400 SE +/- 0.80, N = 3 371.27 371.97 373.24
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream a b c 2 4 6 8 10 SE +/- 0.0174, N = 3 8.0798 8.0647 8.0373
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream a b c 110 220 330 440 550 SE +/- 1.89, N = 3 530.84 522.76 519.66
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream a b c 1.2989 2.5978 3.8967 5.1956 6.4945 SE +/- 0.0204, N = 3 5.6401 5.7386 5.7729
oneDNN Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU a b c 0.9222 1.8444 2.7666 3.6888 4.611 SE +/- 0.02631, N = 15 4.09853 3.93260 3.95246 MIN: 3.8 MIN: 3.81 MIN: 3.82 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream a b c 110 220 330 440 550 SE +/- 1.42, N = 3 530.18 526.96 520.95
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream a b c 1.2957 2.5914 3.8871 5.1828 6.4785 SE +/- 0.0208, N = 3 5.6434 5.6888 5.7586
oneDNN Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU a b c 0.3692 0.7384 1.1076 1.4768 1.846 SE +/- 0.105801, N = 15 1.251871 1.640760 0.959942 MIN: 0.91 MIN: 1.59 MIN: 0.91 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
VP9 libvpx Encoding Speed: Speed 5 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 4K a b c 3 6 9 12 15 SE +/- 0.07, N = 3 12.73 12.02 12.25 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
VP9 libvpx Encoding Speed: Speed 0 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 1080p a b c 3 6 9 12 15 SE +/- 0.13, N = 3 12.18 11.57 12.69 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
KeyDB Test: SADD - Parallel Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: SADD - Parallel Connections: 100 a b c 300K 600K 900K 1200K 1500K SE +/- 8944.31, N = 3 1148270.29 1137811.75 1193659.25 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet a b c 9 18 27 36 45 SE +/- 0.03, N = 3 38.89 39.20 38.53
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream a b c 11 22 33 44 55 SE +/- 0.04, N = 3 42.34 50.84 41.87
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream a b c 16 32 48 64 80 SE +/- 0.07, N = 3 70.83 58.96 71.63
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream a b c 30 60 90 120 150 SE +/- 0.41, N = 3 125.27 123.97 123.95
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream a b c 2 4 6 8 10 SE +/- 0.0263, N = 3 7.9821 8.0658 8.0666
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet a b c 20 40 60 80 100 SE +/- 0.36, N = 3 77.95 77.80 77.44
Unvanquished Resolution: 1920 x 1080 - Effects Quality: High OpenBenchmarking.org Frames Per Second, More Is Better Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: High a b c 40 80 120 160 200 SE +/- 0.20, N = 3 170.8 171.1 170.7
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream a b c 30 60 90 120 150 SE +/- 1.91, N = 3 136.27 146.72 135.43
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream a b c 5 10 15 20 25 SE +/- 0.30, N = 3 22.02 20.44 22.15
KeyDB Test: GET - Parallel Connections: 100 OpenBenchmarking.org Requests Per Second, More Is Better KeyDB 6.3.2 Test: GET - Parallel Connections: 100 a b c 300K 600K 900K 1200K 1500K SE +/- 15206.41, N = 3 1283175.58 1382055.38 1273333.88 1. (CXX) g++ options: -ggdb -rdynamic -lm -lz -lcrypto -lbz2 -lzstd -llz4 -lsnappy -latomic -ldl -pthread -lrt -luuid -lcurl -lssl -std=c++14 -pedantic -fno-rtti -O2 -flto -MMD
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast a b c 3 6 9 12 15 SE +/- 0.08, N = 3 13.25 13.57 13.50
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream a b c 40 80 120 160 200 SE +/- 0.52, N = 3 182.98 185.09 185.10
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream a b c 1.2296 2.4592 3.6888 4.9184 6.148 SE +/- 0.0157, N = 3 5.4650 5.4027 5.4023
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream a b c 40 80 120 160 200 SE +/- 0.43, N = 3 184.65 183.89 183.69
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream a b c 1.2248 2.4496 3.6744 4.8992 6.124 SE +/- 0.0127, N = 3 5.4154 5.4379 5.4437
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream a b c 12 24 36 48 60 SE +/- 0.32, N = 3 51.15 52.80 50.82
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream a b c 5 10 15 20 25 SE +/- 0.12, N = 3 19.55 18.94 19.68
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast a b c 4 8 12 16 20 SE +/- 0.08, N = 3 13.98 14.30 14.24
OpenEMS Test: openEMS MSL_NotchFilter OpenBenchmarking.org MCells/s, More Is Better OpenEMS 0.0.35-86 Test: openEMS MSL_NotchFilter a b c 20 40 60 80 100 SE +/- 0.06, N = 3 98.88 98.72 98.77 1. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream a b c 13 26 39 52 65 SE +/- 0.15, N = 3 49.64 58.91 48.52
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream a b c 5 10 15 20 25 SE +/- 0.06, N = 3 20.14 16.97 20.61
Cpuminer-Opt Algorithm: LBC, LBRY Credits OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits a b c 4K 8K 12K 16K 20K SE +/- 186.26, N = 5 18438 19200 19710 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream a b c 5 10 15 20 25 SE +/- 0.08, N = 3 20.33 20.39 20.26
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream a b c 11 22 33 44 55 SE +/- 0.19, N = 3 49.18 49.03 49.33
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org FPS, More Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live a b c 50 100 150 200 250 SE +/- 0.14, N = 3 239.86 241.95 235.80 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx264 - Scenario: Live OpenBenchmarking.org Seconds, Fewer Is Better FFmpeg 6.0 Encoder: libx264 - Scenario: Live a b c 5 10 15 20 25 SE +/- 0.01, N = 3 21.05 20.87 21.42 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
EnCodec Target Bandwidth: 6 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 6 kbps a b c 9 18 27 36 45 SE +/- 0.47, N = 3 38.52 41.18 40.12
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream a b c 20 40 60 80 100 SE +/- 0.97, N = 3 91.19 88.78 90.16
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream a b c 8 16 24 32 40 SE +/- 0.35, N = 3 32.89 33.78 33.26
AOM AV1 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K a b c 12 24 36 48 60 SE +/- 0.37, N = 14 55.33 54.93 55.31 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
EnCodec Target Bandwidth: 1.5 kbps OpenBenchmarking.org Seconds, Fewer Is Better EnCodec 0.1.1 Target Bandwidth: 1.5 kbps a b c 9 18 27 36 45 SE +/- 0.20, N = 3 36.92 41.03 38.71
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream a b c 6 12 18 24 30 SE +/- 0.23, N = 3 26.09 26.57 25.25
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream a b c 9 18 27 36 45 SE +/- 0.34, N = 3 38.34 37.64 39.60
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream a b c 9 18 27 36 45 SE +/- 0.13, N = 3 40.47 38.43 39.01
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream a b c 20 40 60 80 100 SE +/- 0.23, N = 3 74.10 78.04 76.88
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream a b c 4 8 12 16 20 SE +/- 0.17, N = 3 15.57 15.37 15.38
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream a b c 15 30 45 60 75 SE +/- 0.70, N = 3 64.23 65.03 64.99
Stress-NG Test: Pthread OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Pthread a b c 30K 60K 90K 120K 150K SE +/- 1404.99, N = 4 128698.01 130862.38 132268.72 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Kvazaar Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast a b c 4 8 12 16 20 SE +/- 0.12, N = 3 16.45 17.22 17.13 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Cpuminer-Opt Algorithm: Garlicoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin a b c 400 800 1200 1600 2000 SE +/- 21.45, N = 4 1836.59 1908.99 1895.32 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast a b c 4 8 12 16 20 SE +/- 0.04, N = 3 16.99 17.49 17.41
Unvanquished Resolution: 1920 x 1080 - Effects Quality: Medium OpenBenchmarking.org Frames Per Second, More Is Better Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Medium a b c 50 100 150 200 250 SE +/- 0.09, N = 3 248.2 248.1 248.2
AOM AV1 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K a b c 13 26 39 52 65 SE +/- 0.42, N = 12 58.76 58.66 58.53 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
oneDNN Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU a b c 0.5635 1.127 1.6905 2.254 2.8175 SE +/- 0.02403, N = 15 2.50462 2.45278 2.43532 MIN: 2.34 MIN: 2.41 MIN: 2.39 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet a b c 14 28 42 56 70 SE +/- 0.10, N = 3 60.81 61.24 60.69
Stress-NG Test: Zlib OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Zlib a b c 150 300 450 600 750 SE +/- 0.29, N = 3 717.35 717.62 716.14 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: System V Message Passing a b c 2M 4M 6M 8M 10M SE +/- 10695.76, N = 3 8216877.60 8225295.79 8192747.72 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Hash OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Hash a b c 300K 600K 900K 1200K 1500K SE +/- 854.18, N = 3 1548492.99 1549710.05 1548182.16 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Poll OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Poll a b c 200K 400K 600K 800K 1000K SE +/- 379.65, N = 3 823762.13 823948.19 823174.05 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Memory Copying a b c 500 1000 1500 2000 2500 SE +/- 14.39, N = 3 2301.69 2295.12 2285.43 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: NUMA OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: NUMA a b c 50 100 150 200 250 SE +/- 0.70, N = 3 244.13 246.58 245.00 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Cpuminer-Opt Algorithm: Myriad-Groestl OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Myriad-Groestl a b c 2K 4K 6K 8K 10K SE +/- 68.39, N = 3 11237 11090 11100 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Malloc a b c 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 19639.79, N = 3 5226456.99 5241054.32 5200128.82 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Matrix Math a b c 10K 20K 30K 40K 50K SE +/- 69.96, N = 3 45892.79 46046.48 45978.84 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Function Call OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Function Call a b c 11K 22K 33K 44K 55K SE +/- 1.32, N = 3 49787.62 49807.05 49784.19 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Vector Math a b c 9K 18K 27K 36K 45K SE +/- 3.69, N = 3 41733.97 41733.47 41779.98 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Cpuminer-Opt Algorithm: Skeincoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin a b c 10K 20K 30K 40K 50K SE +/- 360.94, N = 3 47853 48410 48670 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Blake-2 S OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Blake-2 S a b c 60K 120K 180K 240K 300K SE +/- 791.71, N = 3 282207 302980 295250 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Stress-NG Test: Mutex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Mutex a b c 900K 1800K 2700K 3600K 4500K SE +/- 2569.53, N = 3 4254720.23 4273551.98 4254389.29 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: CPU Stress OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: CPU Stress a b c 4K 8K 12K 16K 20K SE +/- 32.25, N = 3 17781.86 17780.76 17782.21 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: SENDFILE a b c 40K 80K 120K 160K 200K SE +/- 184.17, N = 3 177365.84 176973.24 178115.64 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: x86_64 RdRand OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: x86_64 RdRand a b c 20K 40K 60K 80K 100K SE +/- 0.57, N = 3 81909.45 81907.97 81907.39 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Glibc Qsort Data Sorting OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Glibc Qsort Data Sorting a b c 20 40 60 80 100 SE +/- 0.60, N = 3 101.42 102.53 102.73 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Crypto a b c 3K 6K 9K 12K 15K SE +/- 2.58, N = 3 14276.39 14261.23 14271.88 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Semaphores a b c 300K 600K 900K 1200K 1500K SE +/- 593.53, N = 3 1189258.32 1190334.27 1188758.84 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Forking a b c 12K 24K 36K 48K 60K SE +/- 302.19, N = 3 54276.34 52494.81 54204.65 1. (CC) gcc options: -std=gnu99 -O2 -lm -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Cpuminer-Opt Algorithm: Triple SHA-256, Onecoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin a b c 20K 40K 60K 80K 100K SE +/- 108.37, N = 3 78157 77950 77940 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Magi OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Magi a b c 70 140 210 280 350 SE +/- 2.70, N = 3 331.49 327.09 326.58 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Deepcoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Deepcoin a b c 1400 2800 4200 5600 7000 SE +/- 12.35, N = 3 6392.10 6428.90 6368.98 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: x25x OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: x25x a b c 80 160 240 320 400 SE +/- 0.59, N = 3 344.30 367.28 368.41 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: scrypt OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: scrypt a b c 20 40 60 80 100 SE +/- 0.41, N = 3 110.87 111.65 111.66 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Cpuminer-Opt Algorithm: Ringcoin OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Ringcoin a b c 300 600 900 1200 1500 SE +/- 14.19, N = 3 1560.09 1583.58 1586.86 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
VVenC Video Input: Bosphorus 1080p - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster a b c 5 10 15 20 25 SE +/- 0.07, N = 3 20.16 20.86 20.59 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
Cpuminer-Opt Algorithm: Quad SHA-256, Pyrite OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite a b c 10K 20K 30K 40K 50K SE +/- 70.24, N = 3 48250 48310 48320 1. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast a b c 5 10 15 20 25 SE +/- 0.11, N = 3 20.38 21.04 20.92 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
uvg266 Video Input: Bosphorus 1080p - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow a b c 5 10 15 20 25 SE +/- 0.02, N = 3 21.53 22.34 22.14
JPEG XL Decoding libjxl CPU Threads: All OpenBenchmarking.org MP/s, More Is Better JPEG XL Decoding libjxl 0.7 CPU Threads: All a b c 50 100 150 200 250 SE +/- 0.07, N = 3 217.33 226.31 225.63
Scikit-Learn Benchmark: TSNE MNIST Dataset OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 1.1.3 Benchmark: TSNE MNIST Dataset a b c 6 12 18 24 30 SE +/- 0.22, N = 3 26.91 26.71 26.86
uvg266 Video Input: Bosphorus 1080p - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium a b c 6 12 18 24 30 SE +/- 0.14, N = 3 24.11 25.05 24.96
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K a b c 7 14 21 28 35 SE +/- 0.22, N = 3 27.44 27.78 27.50 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
AOM AV1 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p a b c 8 16 24 32 40 SE +/- 0.42, N = 3 31.69 31.54 32.35 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
libavif avifenc Encoder Speed: 10, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 10, Lossless a b c 2 4 6 8 10 SE +/- 0.185, N = 15 6.571 6.438 6.439 1. (CXX) g++ options: -O3 -fPIC -lm
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 1080p a b c 2 4 6 8 10 SE +/- 0.018, N = 3 7.737 7.809 7.750 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast a b c 7 14 21 28 35 SE +/- 0.21, N = 3 27.83 29.11 28.85 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
VP9 libvpx Encoding Speed: Speed 5 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 1080p a b c 8 16 24 32 40 SE +/- 0.02, N = 3 32.75 32.33 32.38 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
Kvazaar Video Input: Bosphorus 1080p - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow a b c 8 16 24 32 40 SE +/- 0.14, N = 3 32.53 33.27 33.22 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 1080p - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium a b c 8 16 24 32 40 SE +/- 0.14, N = 3 34.46 34.52 34.50 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
AOM AV1 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p a b c 40 80 120 160 200 SE +/- 2.71, N = 15 147.69 145.58 169.96 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
AOM AV1 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K a b c 10 20 30 40 50 SE +/- 0.05, N = 3 45.87 46.20 46.08 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
libavif avifenc Encoder Speed: 6, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 6, Lossless a b c 4 8 12 16 20 SE +/- 0.14, N = 3 13.46 13.72 13.73 1. (CXX) g++ options: -O3 -fPIC -lm
AOM AV1 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p a b c 40 80 120 160 200 SE +/- 3.61, N = 15 175.80 177.46 168.56 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU a b c 0.8116 1.6232 2.4348 3.2464 4.058 SE +/- 0.00059, N = 3 3.59719 3.59364 3.60705 MIN: 3.53 MIN: 3.53 MIN: 3.54 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU a b c 0.2705 0.541 0.8115 1.082 1.3525 SE +/- 0.00770, N = 3 1.20219 1.19925 1.18228 MIN: 1.13 MIN: 1.13 MIN: 1.12 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
AOM AV1 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p a b c 30 60 90 120 150 SE +/- 1.01, N = 11 139.13 139.06 140.47 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
AOM AV1 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p a b c 40 80 120 160 200 SE +/- 3.99, N = 15 188.81 171.53 201.29 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
AOM AV1 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K a b c 13 26 39 52 65 SE +/- 0.04, N = 3 57.99 58.45 58.38 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU a b c 3 6 9 12 15 SE +/- 0.66035, N = 15 8.93885 8.13373 9.33670 MIN: 7.53 MIN: 8.1 MIN: 9.28 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU a b c 0.4526 0.9052 1.3578 1.8104 2.263 SE +/- 0.01841, N = 15 2.00020 2.01154 2.01050 MIN: 1.92 MIN: 2 MIN: 2 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
uvg266 Video Input: Bosphorus 1080p - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast a b c 14 28 42 56 70 SE +/- 0.17, N = 3 62.33 64.10 64.13
oneDNN Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU a b c 3 6 9 12 15 SE +/- 0.00, N = 3 10.37 10.56 10.43 MIN: 10.1 MIN: 10.29 MIN: 10.17 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 6 a b c 3 6 9 12 15 SE +/- 0.071, N = 3 9.175 9.277 9.268 1. (CXX) g++ options: -O3 -fPIC -lm
uvg266 Video Input: Bosphorus 1080p - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast a b c 15 30 45 60 75 SE +/- 0.36, N = 3 67.09 67.46 67.36
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K a b c 20 40 60 80 100 SE +/- 0.17, N = 3 88.43 69.57 68.86 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
RocksDB Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill a b c 300K 600K 900K 1200K 1500K SE +/- 3413.48, N = 3 1502792 1511361 1461566 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Kvazaar Video Input: Bosphorus 1080p - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Very Fast a b c 20 40 60 80 100 SE +/- 0.07, N = 3 74.79 74.73 75.04 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 1080p a b c 20 40 60 80 100 SE +/- 0.56, N = 3 81.45 81.40 81.02 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
uvg266 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast a b c 20 40 60 80 100 SE +/- 0.06, N = 3 80.01 79.81 79.41
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K a b c 20 40 60 80 100 SE +/- 0.27, N = 3 95.57 96.58 95.09 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Kvazaar Video Input: Bosphorus 1080p - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Super Fast a b c 20 40 60 80 100 SE +/- 0.19, N = 3 93.48 93.52 93.30 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU a b c 4 8 12 16 20 SE +/- 0.00, N = 3 16.59 16.61 16.59 MIN: 16.45 MIN: 16.47 MIN: 16.43 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
oneDNN Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU a b c 5 10 15 20 25 SE +/- 0.03, N = 3 18.28 18.41 18.23 MIN: 17.89 MIN: 18.02 MIN: 17.93 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Kvazaar Video Input: Bosphorus 1080p - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast a b c 30 60 90 120 150 SE +/- 0.14, N = 3 123.26 121.82 123.33 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 1080p a b c 80 160 240 320 400 SE +/- 1.08, N = 3 348.11 348.91 347.22 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 1080p a b c 90 180 270 360 450 SE +/- 0.84, N = 3 398.86 399.08 397.31 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Phoronix Test Suite v10.8.5