Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403223-NE-28881544411 2888 - Phoronix Test Suite 2888 Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2403223-NE-28881544411&sor&grs .
2888 Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution a b c d Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads) Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) Intel Device 7a27 2 x 32GB DRAM-4400MT/s Micron MTC20C2085S1EC48BA1 960GB Micron_7450_MTFDKBA960TFR + 3201GB Micron_7450_MTFDKCC3T2TFS llvmpipe VE228 2 x Intel I210 Ubuntu 22.04 6.2.0-26-generic (x86_64) GNOME Shell 42.9 X Server 1.21.1.4 4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits) 1.3.238 GCC 11.4.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x11f - Thermald 2.4.9 Python Details - Python 3.10.12 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2888 speedb: Seq Fill onednn: Deconvolution Batch shapes_1d - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K quicksilver: CORAL2 P1 rocksdb: Read While Writing speedb: Read While Writing primesieve: 1e12 stockfish: Chess Benchmark openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU rocksdb: Seq Fill openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream speedb: Rand Read deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream onednn: IP Shapes 1D - CPU svt-av1: Preset 8 - Bosphorus 4K quicksilver: CORAL2 P2 openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU svt-av1: Preset 4 - Bosphorus 4K deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream namd: ATPase with 327,506 Atoms rocksdb: Overwrite ospray: gravity_spheres_volume/dim_512/scivis/real_time speedb: Read Rand Write Rand deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream quicksilver: CTS2 rocksdb: Rand Read deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream svt-av1: Preset 4 - Bosphorus 1080p openvino: Face Detection FP16-INT8 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Face Detection FP16-INT8 - CPU deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream openvino: Face Detection Retail FP16-INT8 - CPU deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream openvino: Vehicle Detection FP16-INT8 - CPU deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU primesieve: 1e13 deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream rocksdb: Read Rand Write Rand openvino: Vehicle Detection FP16 - CPU build-linux-kernel: defconfig openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU ospray-studio: 2 - 1080p - 16 - Path Tracer - CPU rocksdb: Rand Fill openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU ospray-studio: 3 - 1080p - 16 - Path Tracer - CPU deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream rocksdb: Update Rand blender: BMW27 - CPU-Only openvino: Age Gender Recognition Retail 0013 FP16 - CPU ospray: gravity_spheres_volume/dim_512/ao/real_time speedb: Update Rand openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream speedb: Rand Fill openvino: Handwritten English Recognition FP16 - CPU svt-av1: Preset 12 - Bosphorus 1080p openvino: Handwritten English Recognition FP16 - CPU blender: Fishy Cat - CPU-Only ospray-studio: 1 - 1080p - 32 - Path Tracer - CPU ospray-studio: 3 - 1080p - 32 - Path Tracer - CPU v-ray: CPU deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream svt-av1: Preset 13 - Bosphorus 1080p compress-7zip: Compression Rating speedb: Rand Fill Sync brl-cad: VGR Performance Metric openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream compress-7zip: Decompression Rating ospray-studio: 2 - 1080p - 32 - Path Tracer - CPU ospray: particle_volume/scivis/real_time ospray-studio: 2 - 4K - 16 - Path Tracer - CPU deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream ospray-studio: 1 - 1080p - 16 - Path Tracer - CPU blender: Barbershop - CPU-Only onednn: Convolution Batch Shapes Auto - CPU deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Face Detection FP16 - CPU ospray: particle_volume/pathtracer/real_time deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream openvino: Person Vehicle Bike Detection FP16 - CPU onednn: Recurrent Neural Network Training - CPU ospray-studio: 1 - 4K - 16 - Path Tracer - CPU rocksdb: Rand Fill Sync ospray-studio: 2 - 4K - 32 - Path Tracer - CPU ospray-studio: 3 - 4K - 16 - Path Tracer - CPU namd: STMV with 1,066,628 Atoms blender: Pabellon Barcelona - CPU-Only ospray-studio: 3 - 4K - 32 - Path Tracer - CPU blender: Classroom - CPU-Only onednn: Deconvolution Batch shapes_3d - CPU ospray: particle_volume/ao/real_time ospray-studio: 2 - 1080p - 1 - Path Tracer - CPU ospray: gravity_spheres_volume/dim_512/pathtracer/real_time gromacs: MPI CPU - water_GMX50_bare ospray-studio: 3 - 4K - 1 - Path Tracer - CPU build-linux-kernel: allmodconfig openvino: Face Detection FP16 - CPU onednn: Recurrent Neural Network Inference - CPU deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream ospray-studio: 1 - 1080p - 1 - Path Tracer - CPU ospray-studio: 3 - 1080p - 1 - Path Tracer - CPU ospray-studio: 1 - 4K - 1 - Path Tracer - CPU onednn: IP Shapes 3D - CPU ospray-studio: 2 - 4K - 1 - Path Tracer - CPU ospray-studio: 1 - 4K - 32 - Path Tracer - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c d 1057203 7.18796 93.39 42.81 134.857 116.362 115.906 13320000 2258480 2986868 20.268 17776692 815.19 9.8 2001345 137.47 29.09 25.602 60086996 156.1413 2.89586 35.453 19000000 36.78 217.38 137.78 29.03 4.314 9.1491 437.1893 0.67383 1485724 2.65458 2449782 4.8981 111.257 35.9425 814.3312 11.7159 341.0447 12930000 56724663 9.7178 102.8021 16.2 370.26 441.47 18.11 10.78 3.8485 259.5447 4.88 1.4526 15.92 9.261 107.9743 502.11 16.47 245.051 686.1578 2236460 242.67 93.026 1036.92 1638.8 29.36 7.71 41235 1449625 180.54 44.3 272.34 48103 9.2711 107.8569 940801 123.28 8604.26 2.78974 741879 0.93 523.93 15.2 9.0749 440.7639 883180 51.92 531.292 154.02 165.69 79824 93632 20309 110.527 36.1796 72.4043 55.2365 644.326 96642 232803 187668 21993.11 33.55 119.2 53.6218 18.6441 67998 80830 5.96546 157835 93.9272 10.6449 40686 1295.39 6.42439 68.6726 14.5578 50.2694 79.5563 356.6279 11.2154 10.39 2.67 163.101 5.0827 779.3582 384.46 2817.81 155844 206255 315995 184602 0.20897 414.08 367733 336.89 4.54099 6.005 2454 3.87077 1.405 11351 1310.077 1500.07 1487.64 99.5544 10.0386 99.5916 10.0353 8.0241 124.6076 2412 2858 9569 7.84533 9730 310533 0.36 863184 6.44395 97.98 40.8 135.94 103.489 115.017 12430000 2252397 2992041 21.056 16895156 816.66 9.79 2076954 134.46 29.74 26.4489 60307089 151.1466 2.80998 34.857 18700000 37.43 213.64 138.36 28.91 4.296 8.9375 447.5375 0.67382 1468149 2.68163 2396499 4.8763 109.5083 36.5155 817.8716 11.9063 335.6214 12920000 57366733 9.7363 102.6123 15.971 372.98 440.94 18.13 10.71 3.8279 260.9455 4.89 1.4499 15.92 9.1867 108.8472 502.15 16.73 246.008 687.062 2219780 238.98 93.228 1052.53 1635.4 29.42 7.6 41382 1468080 181.28 44.11 271.84 48081 9.1535 109.2419 928889 124.06 8497.74 2.80995 736698 0.94 528.03 15.08 8.9956 444.6478 883375 52.19 531.969 153.23 166.18 79976 94309 20474 110.1287 36.3099 72.2559 55.3492 642.666 97323 231177 188736 21852.43 33.51 119.34 53.9161 18.5431 67818 80544 5.95732 158659 93.6687 10.6742 40849 1300.83 6.42538 68.97 14.4952 50.3532 79.4246 357.5452 11.1867 10.41 2.67 163.001 5.0978 777.0222 383.87 2811.37 156271 205948 314965 184046 0.20952 413.33 367376 335.93 4.53763 5.98988 2448 3.87307 1.406 11328 1310.863 1499.89 1485.18 99.5487 10.0398 99.534 10.0405 8.035 124.4398 2415 2860 9578 7.8392 9720 310594 0.36 1045594 6.03052 91.07 43.9 136.516 116.115 106.976 13410000 2374402 3165497 20.539 17408986 809.39 9.87 2042355 137.07 29.17 26.2237 59761930 152.4416 2.9002 35.323 18460000 36.47 219.22 134.9 29.64 4.317 9.0093 443.9691 0.67334 1452056 2.70994 2405977 4.9502 109.0342 36.6748 805.7857 11.9504 334.361 12900000 57492080 9.7584 102.383 16.227 377.2 437.87 18.26 10.59 3.8345 260.4541 4.92 1.4736 16.01 9.2712 107.8541 499.31 16.68 242.435 676.4009 2202547 239.66 92.622 1039.07 1626.27 29 7.69 41560 1466579 180.48 44.3 275.68 47805 9.1718 109.0246 929396 123.13 8581.04 2.80782 743285 0.93 524.06 15.2 9.0183 443.5299 875583 51.81 534.965 154.34 164.96 79629 93566 20359 109.6515 36.4683 72.8207 54.9206 643.945 97159 231664 188971 21956.68 33.72 118.6 53.5893 18.6556 67661 80517 5.93355 157963 93.7321 10.667 40759 1294.93 6.43553 68.8463 14.521 50.1496 79.7457 356.291 11.226 10.37 2.66 162.493 5.1016 776.5215 385.24 2808.2 156366 206635 315016 184423 0.20891 414.52 367235 336.35 4.54541 5.9892 2448 3.86452 1.408 11328 1308.279 1502.74 1487.05 99.5123 10.0432 99.5805 10.0368 8.0302 124.5136 2413 2857 9568 7.84377 9722 310458 0.36 1064769 6.67469 86.33 46.3 120.657 109.271 116.365 13400000 2392670 3036556 19.962 17015035 778.95 10.26 2008846 139.07 28.76 26.0051 58376227 153.7216 2.81256 35.927 18730000 37.26 214.62 138.1 28.96 4.4 9.064 441.2935 0.65844 1455423 2.71491 2421096 4.8511 110.8552 36.0728 822.157 11.7806 339.1941 12680000 56385081 9.5744 104.347 15.927 376.51 433.48 18.44 10.62 3.7815 264.1219 4.84 1.458 16.18 9.3361 107.106 494.26 16.67 242.189 683.3508 2202307 239.78 91.837 1047.18 1649.85 29.19 7.63 40969 1447290 183.06 43.68 273.91 47474 9.2635 107.946 939218 122.49 8570.68 2.82308 734814 0.93 522.81 15.23 8.9861 445.1168 880777 51.74 530.366 154.54 166.34 79324 93543 20326 110.5329 36.1779 72.2762 55.334 639.396 97044 232392 188430 21874.68 33.55 119.22 53.7675 18.5938 67622 80395 5.96271 158320 94.1551 10.6192 40641 1294.63 6.40691 68.8904 14.5116 50.3129 79.4885 356.1523 11.2304 10.4 2.66 163.088 5.0893 778.3346 384.29 2814.22 156265 206350 315601 184006 0.20937 413.9 366681 336.1 4.53315 5.99903 2448 3.86617 1.405 11327 1308.976 1501.44 1487.19 99.6579 10.0287 99.6773 10.0263 8.0335 124.4641 2414 2858 9578 7.84734 9727 310409 0.36 OpenBenchmarking.org
Speedb Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Sequential Fill d a c b 200K 400K 600K 800K 1000K 1064769 1057203 1045594 863184 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
oneDNN Harness: Deconvolution Batch shapes_1d - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_1d - Engine: CPU c b d a 2 4 6 8 10 6.03052 6.44395 6.67469 7.18796 MIN: 3.86 MIN: 3.88 MIN: 4.01 MIN: 3.96 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU b a c d 20 40 60 80 100 97.98 93.39 91.07 86.33 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU b a c d 10 20 30 40 50 40.80 42.81 43.90 46.30 MIN: 16.82 / MAX: 52.81 MIN: 32.46 / MAX: 50.96 MIN: 31.33 / MAX: 53.09 MIN: 19.55 / MAX: 53.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 1080p c b a d 30 60 90 120 150 136.52 135.94 134.86 120.66 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K a c d b 30 60 90 120 150 116.36 116.12 109.27 103.49 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K d a b c 30 60 90 120 150 116.37 115.91 115.02 106.98 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Quicksilver Input: CORAL2 P1 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P1 c d a b 3M 6M 9M 12M 15M 13410000 13400000 13320000 12430000 1. (CXX) g++ options: -fopenmp -O3 -march=native
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing d c a b 500K 1000K 1500K 2000K 2500K 2392670 2374402 2258480 2252397 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Speedb Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing c d b a 700K 1400K 2100K 2800K 3500K 3165497 3036556 2992041 2986868 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Primesieve Length: 1e12 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 d a c b 5 10 15 20 25 19.96 20.27 20.54 21.06 1. (CXX) g++ options: -O3
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark a c d b 4M 8M 12M 16M 20M 17776692 17408986 17015035 16895156 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU b a c d 200 400 600 800 1000 816.66 815.19 809.39 778.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU b a c d 3 6 9 12 15 9.79 9.80 9.87 10.26 MIN: 6.41 / MAX: 38.95 MIN: 6.12 / MAX: 36.26 MIN: 6.06 / MAX: 39.79 MIN: 5.16 / MAX: 34.39 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
RocksDB Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Sequential Fill b c d a 400K 800K 1200K 1600K 2000K 2076954 2042355 2008846 2001345 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU b c a d 30 60 90 120 150 134.46 137.07 137.47 139.07 MIN: 113.8 / MAX: 201.17 MIN: 114.71 / MAX: 226.89 MIN: 115.85 / MAX: 217.31 MIN: 116.24 / MAX: 219.99 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU b c a d 7 14 21 28 35 29.74 29.17 29.09 28.76 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream a d c b 6 12 18 24 30 25.60 26.01 26.22 26.45
Speedb Test: Random Read OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read b a c d 13M 26M 39M 52M 65M 60307089 60086996 59761930 58376227 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream a d c b 30 60 90 120 150 156.14 153.72 152.44 151.15
oneDNN Harness: IP Shapes 1D - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 1D - Engine: CPU b d a c 0.6525 1.305 1.9575 2.61 3.2625 2.80998 2.81256 2.89586 2.90020 MIN: 2.26 MIN: 2.66 MIN: 2.67 MIN: 2.68 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K d a c b 8 16 24 32 40 35.93 35.45 35.32 34.86 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Quicksilver Input: CORAL2 P2 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P2 a d b c 4M 8M 12M 16M 20M 19000000 18730000 18700000 18460000 1. (CXX) g++ options: -fopenmp -O3 -march=native
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU c a d b 9 18 27 36 45 36.47 36.78 37.26 37.43 MIN: 26.59 / MAX: 94.27 MIN: 27.1 / MAX: 93.52 MIN: 26.4 / MAX: 95 MIN: 26.59 / MAX: 83.53 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU c a d b 50 100 150 200 250 219.22 217.38 214.62 213.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU c a d b 30 60 90 120 150 134.90 137.78 138.10 138.36 MIN: 115.43 / MAX: 187.53 MIN: 113.8 / MAX: 223.99 MIN: 115.79 / MAX: 222.16 MIN: 112.35 / MAX: 208.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU c a d b 7 14 21 28 35 29.64 29.03 28.96 28.91 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K d c a b 0.99 1.98 2.97 3.96 4.95 4.400 4.317 4.314 4.296 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream a d c b 3 6 9 12 15 9.1491 9.0640 9.0093 8.9375
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream a d c b 100 200 300 400 500 437.19 441.29 443.97 447.54
NAMD Input: ATPase with 327,506 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms a b c d 0.1516 0.3032 0.4548 0.6064 0.758 0.67383 0.67382 0.67334 0.65844
RocksDB Test: Overwrite OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Overwrite a b d c 300K 600K 900K 1200K 1500K 1485724 1468149 1455423 1452056 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time d c b a 0.6109 1.2218 1.8327 2.4436 3.0545 2.71491 2.70994 2.68163 2.65458
Speedb Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read Random Write Random a d c b 500K 1000K 1500K 2000K 2500K 2449782 2421096 2405977 2396499 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream d b a c 1.1138 2.2276 3.3414 4.4552 5.569 4.8511 4.8763 4.8981 4.9502
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream a d b c 20 40 60 80 100 111.26 110.86 109.51 109.03
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream a d b c 8 16 24 32 40 35.94 36.07 36.52 36.67
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream d b a c 200 400 600 800 1000 822.16 817.87 814.33 805.79
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream a d b c 3 6 9 12 15 11.72 11.78 11.91 11.95
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream a d b c 70 140 210 280 350 341.04 339.19 335.62 334.36
Quicksilver Input: CTS2 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CTS2 a b c d 3M 6M 9M 12M 15M 12930000 12920000 12900000 12680000 1. (CXX) g++ options: -fopenmp -O3 -march=native
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read c b a d 12M 24M 36M 48M 60M 57492080 57366733 56724663 56385081 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream d a b c 3 6 9 12 15 9.5744 9.7178 9.7363 9.7584
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream d a b c 20 40 60 80 100 104.35 102.80 102.61 102.38
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 1080p c a b d 4 8 12 16 20 16.23 16.20 15.97 15.93 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b d c 80 160 240 320 400 370.26 372.98 376.51 377.20 MIN: 283.49 / MAX: 524.37 MIN: 281.79 / MAX: 526.67 MIN: 284.44 / MAX: 525.09 MIN: 285.21 / MAX: 479.42 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c d 100 200 300 400 500 441.47 440.94 437.87 433.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c d 5 10 15 20 25 18.11 18.13 18.26 18.44 MIN: 9.91 / MAX: 54.39 MIN: 9.61 / MAX: 57.54 MIN: 9.63 / MAX: 63.68 MIN: 9.76 / MAX: 47.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b d c 3 6 9 12 15 10.78 10.71 10.62 10.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream d b c a 0.8659 1.7318 2.5977 3.4636 4.3295 3.7815 3.8279 3.8345 3.8485
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream d b c a 60 120 180 240 300 264.12 260.95 260.45 259.54
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU d a b c 1.107 2.214 3.321 4.428 5.535 4.84 4.88 4.89 4.92 MIN: 3.29 / MAX: 23.14 MIN: 3.58 / MAX: 23.42 MIN: 3.47 / MAX: 23.33 MIN: 3.55 / MAX: 24.13 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream b a d c 0.3316 0.6632 0.9948 1.3264 1.658 1.4499 1.4526 1.4580 1.4736
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 4 8 12 16 20 15.92 15.92 16.01 16.18 MIN: 10.19 / MAX: 56.15 MIN: 10.24 / MAX: 55.12 MIN: 10.09 / MAX: 56.58 MIN: 10.16 / MAX: 60.6 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream d c a b 3 6 9 12 15 9.3361 9.2712 9.2610 9.1867
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream d c a b 20 40 60 80 100 107.11 107.85 107.97 108.85
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU b a c d 110 220 330 440 550 502.15 502.11 499.31 494.26 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a d c b 4 8 12 16 20 16.47 16.67 16.68 16.73 MIN: 7.97 / MAX: 25.24 MIN: 9 / MAX: 53.32 MIN: 9.11 / MAX: 50.09 MIN: 11.82 / MAX: 45.31 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Primesieve Length: 1e13 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 d c a b 50 100 150 200 250 242.19 242.44 245.05 246.01 1. (CXX) g++ options: -O3
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream b a d c 150 300 450 600 750 687.06 686.16 683.35 676.40
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read Random Write Random a b c d 500K 1000K 1500K 2000K 2500K 2236460 2219780 2202547 2202307 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a d c b 50 100 150 200 250 242.67 239.78 239.66 238.98 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig d c a b 20 40 60 80 100 91.84 92.62 93.03 93.23
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU b d c a 200 400 600 800 1000 1052.53 1047.18 1039.07 1036.92 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU d a b c 400 800 1200 1600 2000 1649.85 1638.80 1635.40 1626.27 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU c d a b 7 14 21 28 35 29.00 29.19 29.36 29.42 MIN: 15.36 / MAX: 75.66 MIN: 15.64 / MAX: 77.79 MIN: 15.65 / MAX: 83.22 MIN: 15.68 / MAX: 85.77 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU b d c a 2 4 6 8 10 7.60 7.63 7.69 7.71 MIN: 5.28 / MAX: 31.11 MIN: 4.81 / MAX: 36.08 MIN: 3.6 / MAX: 34.51 MIN: 5.4 / MAX: 34.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU d a b c 9K 18K 27K 36K 45K 40969 41235 41382 41560
RocksDB Test: Random Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Fill b c a d 300K 600K 900K 1200K 1500K 1468080 1466579 1449625 1447290 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU d b a c 40 80 120 160 200 183.06 181.28 180.54 180.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU d b a c 10 20 30 40 50 43.68 44.11 44.30 44.30 MIN: 32.82 / MAX: 111.75 MIN: 32.5 / MAX: 99.14 MIN: 32.51 / MAX: 109.66 MIN: 31.6 / MAX: 110.49 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU c d a b 60 120 180 240 300 275.68 273.91 272.34 271.84 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU d c b a 10K 20K 30K 40K 50K 47474 47805 48081 48103
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream a d c b 3 6 9 12 15 9.2711 9.2635 9.1718 9.1535
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream a d c b 20 40 60 80 100 107.86 107.95 109.02 109.24
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Update Random a d c b 200K 400K 600K 800K 1000K 940801 939218 929396 928889 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: BMW27 - Compute: CPU-Only d c a b 30 60 90 120 150 122.49 123.13 123.28 124.06
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a c d b 2K 4K 6K 8K 10K 8604.26 8581.04 8570.68 8497.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time d b c a 0.6352 1.2704 1.9056 2.5408 3.176 2.82308 2.80995 2.80782 2.78974
Speedb Test: Update Random OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Update Random c a b d 160K 320K 480K 640K 800K 743285 741879 736698 734814 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a c d b 0.2115 0.423 0.6345 0.846 1.0575 0.93 0.93 0.93 0.94 MIN: 0.48 / MAX: 9.25 MIN: 0.47 / MAX: 9.58 MIN: 0.56 / MAX: 13.16 MIN: 0.48 / MAX: 9.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU b c a d 110 220 330 440 550 528.03 524.06 523.93 522.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU b a c d 4 8 12 16 20 15.08 15.20 15.20 15.23 MIN: 11.22 / MAX: 48.52 MIN: 9.51 / MAX: 54.41 MIN: 9.34 / MAX: 56.08 MIN: 11.43 / MAX: 46.02 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream a c b d 3 6 9 12 15 9.0749 9.0183 8.9956 8.9861
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream a c b d 100 200 300 400 500 440.76 443.53 444.65 445.12
Speedb Test: Random Fill OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Fill b a d c 200K 400K 600K 800K 1000K 883375 883180 880777 875583 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU d c a b 12 24 36 48 60 51.74 51.81 51.92 52.19 MIN: 39.4 / MAX: 103.75 MIN: 39.16 / MAX: 119.83 MIN: 35.62 / MAX: 120.48 MIN: 39.05 / MAX: 127.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 1080p c b a d 120 240 360 480 600 534.97 531.97 531.29 530.37 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU d c a b 30 60 90 120 150 154.54 154.34 154.02 153.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Fishy Cat - Compute: CPU-Only c a b d 40 80 120 160 200 164.96 165.69 166.18 166.34
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU d c a b 20K 40K 60K 80K 100K 79324 79629 79824 79976
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU d c a b 20K 40K 60K 80K 100K 93543 93566 93632 94309
Chaos Group V-RAY Mode: CPU OpenBenchmarking.org vsamples, More Is Better Chaos Group V-RAY 6.0 Mode: CPU b c d a 4K 8K 12K 16K 20K 20474 20359 20326 20309
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream d a b c 20 40 60 80 100 110.53 110.53 110.13 109.65
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream d a b c 8 16 24 32 40 36.18 36.18 36.31 36.47
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream b d a c 16 32 48 64 80 72.26 72.28 72.40 72.82
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream b d a c 12 24 36 48 60 55.35 55.33 55.24 54.92
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 1080p a c b d 140 280 420 560 700 644.33 643.95 642.67 639.40 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating b c d a 20K 40K 60K 80K 100K 97323 97159 97044 96642 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Speedb Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Fill Sync a d c b 50K 100K 150K 200K 250K 232803 232392 231664 231177 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.38.2 VGR Performance Metric c b d a 40K 80K 120K 160K 200K 188971 188736 188430 187668 1. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a c d b 5K 10K 15K 20K 25K 21993.11 21956.68 21874.68 21852.43 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU c d a b 8 16 24 32 40 33.72 33.55 33.55 33.51 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU c a d b 30 60 90 120 150 118.60 119.20 119.22 119.34 MIN: 92.28 / MAX: 205.27 MIN: 90.34 / MAX: 220.76 MIN: 90.11 / MAX: 225.31 MIN: 91.54 / MAX: 206.51 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream b d a c 12 24 36 48 60 53.92 53.77 53.62 53.59
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream b d a c 5 10 15 20 25 18.54 18.59 18.64 18.66
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating a b c d 15K 30K 45K 60K 75K 67998 67818 67661 67622 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU d c b a 20K 40K 60K 80K 100K 80395 80517 80544 80830
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time a d b c 1.3422 2.6844 4.0266 5.3688 6.711 5.96546 5.96271 5.95732 5.93355
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU a c d b 30K 60K 90K 120K 150K 157835 157963 158320 158659
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream b c a d 20 40 60 80 100 93.67 93.73 93.93 94.16
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream b c a d 3 6 9 12 15 10.67 10.67 10.64 10.62
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU d a c b 9K 18K 27K 36K 45K 40641 40686 40759 40849
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Barbershop - Compute: CPU-Only d c a b 300 600 900 1200 1500 1294.63 1294.93 1295.39 1300.83
oneDNN Harness: Convolution Batch Shapes Auto - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU d a b c 2 4 6 8 10 6.40691 6.42439 6.42538 6.43553 MIN: 6.37 MIN: 6.36 MIN: 6.36 MIN: 6.37 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream b d c a 15 30 45 60 75 68.97 68.89 68.85 68.67
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream b d c a 4 8 12 16 20 14.50 14.51 14.52 14.56
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream c a d b 11 22 33 44 55 50.15 50.27 50.31 50.35
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream c a d b 20 40 60 80 100 79.75 79.56 79.49 79.42
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream d c a b 80 160 240 320 400 356.15 356.29 356.63 357.55
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream d c a b 3 6 9 12 15 11.23 11.23 11.22 11.19
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU c a d b 3 6 9 12 15 10.37 10.39 10.40 10.41 MIN: 6.3 / MAX: 33.94 MIN: 6.23 / MAX: 30.2 MIN: 6.06 / MAX: 37.34 MIN: 6.28 / MAX: 28.53 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU b a d c 0.6008 1.2016 1.8024 2.4032 3.004 2.67 2.67 2.66 2.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time a d b c 40 80 120 160 200 163.10 163.09 163.00 162.49
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream c b d a 1.1479 2.2958 3.4437 4.5916 5.7395 5.1016 5.0978 5.0893 5.0827
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream c b d a 200 400 600 800 1000 776.52 777.02 778.33 779.36
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU c a d b 80 160 240 320 400 385.24 384.46 384.29 383.87 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
oneDNN Harness: Recurrent Neural Network Training - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU c b d a 600 1200 1800 2400 3000 2808.20 2811.37 2814.22 2817.81 MIN: 2797.01 MIN: 2799.48 MIN: 2802.8 MIN: 2806.13 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU a d b c 30K 60K 90K 120K 150K 155844 156265 156271 156366
RocksDB Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Fill Sync c d a b 40K 80K 120K 160K 200K 206635 206350 206255 205948 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU b c d a 70K 140K 210K 280K 350K 314965 315016 315601 315995
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU d b c a 40K 80K 120K 160K 200K 184006 184046 184423 184602
NAMD Input: STMV with 1,066,628 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms b d a c 0.0471 0.0942 0.1413 0.1884 0.2355 0.20952 0.20937 0.20897 0.20891
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Pabellon Barcelona - Compute: CPU-Only b d a c 90 180 270 360 450 413.33 413.90 414.08 414.52
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU d c b a 80K 160K 240K 320K 400K 366681 367235 367376 367733
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.0 Blend File: Classroom - Compute: CPU-Only b d c a 70 140 210 280 350 335.93 336.10 336.35 336.89
oneDNN Harness: Deconvolution Batch shapes_3d - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU d b a c 1.0227 2.0454 3.0681 4.0908 5.1135 4.53315 4.53763 4.54099 4.54541 MIN: 4.52 MIN: 4.52 MIN: 4.52 MIN: 4.53 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time a d b c 2 4 6 8 10 6.00500 5.99903 5.98988 5.98920
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU b c d a 500 1000 1500 2000 2500 2448 2448 2448 2454
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time b a d c 0.8714 1.7428 2.6142 3.4856 4.357 3.87307 3.87077 3.86617 3.86452
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare c b d a 0.3168 0.6336 0.9504 1.2672 1.584 1.408 1.406 1.405 1.405 1. (CXX) g++ options: -O3 -lm
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU d b c a 2K 4K 6K 8K 10K 11327 11328 11328 11351
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig c d a b 300 600 900 1200 1500 1308.28 1308.98 1310.08 1310.86
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU b a d c 300 600 900 1200 1500 1499.89 1500.07 1501.44 1502.74 MIN: 1179.88 / MAX: 1674.65 MIN: 1182.11 / MAX: 1680.75 MIN: 1178.14 / MAX: 1634.11 MIN: 1180.43 / MAX: 1615.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
oneDNN Harness: Recurrent Neural Network Inference - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Inference - Engine: CPU b c d a 300 600 900 1200 1500 1485.18 1487.05 1487.19 1487.64 MIN: 1474.21 MIN: 1477.55 MIN: 1477.26 MIN: 1477.71 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream d a b c 20 40 60 80 100 99.66 99.55 99.55 99.51
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream d a b c 3 6 9 12 15 10.03 10.04 10.04 10.04
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream d a c b 20 40 60 80 100 99.68 99.59 99.58 99.53
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream d a c b 3 6 9 12 15 10.03 10.04 10.04 10.04
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream b d c a 2 4 6 8 10 8.0350 8.0335 8.0302 8.0241
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream b d c a 30 60 90 120 150 124.44 124.46 124.51 124.61
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU a c d b 500 1000 1500 2000 2500 2412 2413 2414 2415
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU c a d b 600 1200 1800 2400 3000 2857 2858 2858 2860
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU c a b d 2K 4K 6K 8K 10K 9568 9569 9578 9578
oneDNN Harness: IP Shapes 3D - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU b c a d 2 4 6 8 10 7.83920 7.84377 7.84533 7.84734 MIN: 7.8 MIN: 7.8 MIN: 7.81 MIN: 7.82 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU b c d a 2K 4K 6K 8K 10K 9720 9722 9727 9730
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU d c a b 70K 140K 210K 280K 350K 310409 310458 310533 310594
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 0.081 0.162 0.243 0.324 0.405 0.36 0.36 0.36 0.36 MIN: 0.19 / MAX: 26.87 MIN: 0.22 / MAX: 3.74 MIN: 0.2 / MAX: 8.11 MIN: 0.22 / MAX: 3.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Phoronix Test Suite v10.8.4