Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403172-NE-FGGG8186960 fggg - Phoronix Test Suite fggg d
HTML result view exported from: https://openbenchmarking.org/result/2403172-NE-FGGG8186960&grw&sro .
fggg Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c Intel Core Ultra 7 155H Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads) MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) Intel Device 7e7f 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026 1024GB Micron_2550_MTFDKBA1T0TGE Intel Arc MTL 8GB (2250MHz) Intel Meteor Lake-P HD Audio Intel Device 7e40 Ubuntu 23.10 6.8.0-060800rc1daily20240126-generic (x86_64) GNOME Shell 45.2 X Server 1.21.1.7 + Wayland 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa) GCC 13.2.0 ext4 1920x1200 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x13 - Thermald 2.5.4 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
fggg selenium: Kraken - Firefox selenium: SilverBench - Firefox selenium: Kraken - Google Chrome selenium: PSPDFKit WASM - Firefox selenium: Speedometer 3.0 - Firefox selenium: SilverBench - Google Chrome selenium: PSPDFKit WASM - Google Chrome selenium: WASM imageConvolute - Firefox selenium: Speedometer 3.0 - Google Chrome selenium: WASM collisionDetection - Firefox selenium: WASM imageConvolute - Google Chrome selenium: WASM collisionDetection - Google Chrome deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream primesieve: 1e12 primesieve: 1e13 stockfish: Chess Benchmark compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compression build-linux-kernel: defconfig build-linux-kernel: allmodconfig svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p a b c Intel Core Ultra 7 155H 599.8 1370 489.1 1082 14.6 49974 1041 23.2 18.2 280 20.9 221.42 5.5525 1224.52 5.6812 175.9984 202.1139 34.566 100.7221 9.9143 74.7832 93.5642 50.0414 19.9703 566.5714 12.3239 316.5831 3.143 2.8856 2353.9928 7.9943 125.0509 78.0041 89.4874 53.893 18.5416 36.2569 192.2847 28.7886 34.7133 54.0806 128.9833 39.669 25.1971 7.0047 983.938 6.4397 155.2639 95.9326 72.8034 44.1331 22.6399 5.5873 1234.8017 5.6903 175.7184 24.848 361.144 10417995 7.669184 143.5 2198.954 3.351 25.796 85.012 84.385 12.038 86.334 355.611 434.212 614.6 1459 462.6 1084 15.4 68068 1023 22.4 19.2 276.4 20.29 219.6 5.7537 1190.1515 5.6702 176.3418 201.7476 34.6216 99.305 10.0563 76.9425 90.8958 53.6917 18.612 574.6701 12.1523 325.4391 3.0565 2.9188 2313.3715 7.986 125.1786 75.3695 92.6519 52.5759 19.0076 36.5825 190.558 30.3345 32.9456 55.1778 126.6007 39.9828 24.9998 6.7585 1016.0045 6.3497 157.4653 95.9642 72.7549 42.681 23.4112 5.5932 1235.5842 5.6314 177.5584 24.761 349.939 10579637 7.290079 139.052 2018.834 3.375 25.902 64.854 64.166 12.281 85.862 355.158 433.457 608.2 1372 463.4 1072 14.6 48962 1098 22.6 18.6 280.7 21.2 220.99 5.6993 1217.1789 5.5998 178.5596 198.9342 35.1325 94.0627 10.6166 74.7778 93.4946 51.2776 19.4889 557.739 12.524 311.4965 3.1954 2.8684 2364.778 7.9907 125.1081 74.664 93.6256 51.5251 19.3953 36.6946 190.0904 29.9021 33.4221 54.2522 128.6802 39.1848 25.5085 6.7557 1020.2272 6.2871 159.0351 94.9722 73.5534 40.9163 24.4207 5.5129 1242.9553 5.5888 178.9118 25.104 351.481 12001097 7.602462 141.985 2069.486 3.372 25.944 79.674 84.845 12.191 85.49 356.155 425.855 629 1347 487 1054 15.2 44225 1028 22.3 18 287.5 21.91 220.12 5.7059 1218.9412 5.6851 175.8798 198.8137 35.1396 98.3373 10.1554 74.9318 93.2036 52.1316 19.1685 571.9535 12.2097 308.0782 3.2294 3.0156 2249.4924 7.9919 125.0865 74.3398 94.0979 52.0291 19.2051 36.6392 190.2256 30.3372 32.9409 53.4604 130.4653 38.8108 25.7552 6.6736 1030.8408 6.3123 158.3979 92.5958 75.391 40.4041 24.7316 5.4819 1243.6077 5.584 179.0672 25.039 353.136 10327383 7.399834 142.4 2111.002 3.344 25.755 62.424 78.957 11.921 85.726 359.211 436.602 OpenBenchmarking.org
Selenium Benchmark: Kraken - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Firefox Intel Core Ultra 7 155H a b c 140 280 420 560 700 629.0 599.8 614.6 608.2 1. firefox 121.0.1
Selenium Benchmark: SilverBench - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: SilverBench - Browser: Firefox Intel Core Ultra 7 155H a b c 300 600 900 1200 1500 1347 1370 1459 1372 1. firefox 121.0.1
Selenium Benchmark: Kraken - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Google Chrome Intel Core Ultra 7 155H a b c 110 220 330 440 550 487.0 489.1 462.6 463.4 1. chrome 122.0.6261.128
Selenium Benchmark: PSPDFKit WASM - Browser: Firefox OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Firefox Intel Core Ultra 7 155H a b c 200 400 600 800 1000 1054 1082 1084 1072 1. firefox 121.0.1
Selenium Benchmark: Speedometer 3.0 - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Speedometer 3.0 - Browser: Firefox Intel Core Ultra 7 155H a b c 4 8 12 16 20 15.2 14.6 15.4 14.6 1. firefox 121.0.1
Selenium Benchmark: SilverBench - Browser: Google Chrome OpenBenchmarking.org Score, More Is Better Selenium Benchmark: SilverBench - Browser: Google Chrome Intel Core Ultra 7 155H a b c 15K 30K 45K 60K 75K 44225 49974 68068 48962 1. chrome 122.0.6261.128
Selenium Benchmark: PSPDFKit WASM - Browser: Google Chrome OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Google Chrome Intel Core Ultra 7 155H a b c 200 400 600 800 1000 1028 1041 1023 1098 1. chrome 122.0.6261.128
Selenium Benchmark: WASM imageConvolute - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Firefox Intel Core Ultra 7 155H a b c 6 12 18 24 30 22.3 23.2 22.4 22.6 1. firefox 121.0.1
Selenium Benchmark: Speedometer 3.0 - Browser: Google Chrome OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Speedometer 3.0 - Browser: Google Chrome Intel Core Ultra 7 155H a b c 5 10 15 20 25 18.0 18.2 19.2 18.6 1. chrome 122.0.6261.128
Selenium Benchmark: WASM collisionDetection - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Firefox Intel Core Ultra 7 155H a b c 60 120 180 240 300 287.5 280.0 276.4 280.7 1. firefox 121.0.1
Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome Intel Core Ultra 7 155H a b c 5 10 15 20 25 21.91 20.90 20.29 21.20 1. chrome 122.0.6261.128
Selenium Benchmark: WASM collisionDetection - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Google Chrome Intel Core Ultra 7 155H a b c 50 100 150 200 250 220.12 221.42 219.60 220.99 1. chrome 122.0.6261.128
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 1.2946 2.5892 3.8838 5.1784 6.473 5.7059 5.5525 5.7537 5.6993
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 300 600 900 1200 1500 1218.94 1224.52 1190.15 1217.18
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 1.2791 2.5582 3.8373 5.1164 6.3955 5.6851 5.6812 5.6702 5.5998
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 175.88 176.00 176.34 178.56
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 198.81 202.11 201.75 198.93
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 8 16 24 32 40 35.14 34.57 34.62 35.13
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 98.34 100.72 99.31 94.06
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 3 6 9 12 15 10.1554 9.9143 10.0563 10.6166
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 74.93 74.78 76.94 74.78
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 93.20 93.56 90.90 93.49
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 12 24 36 48 60 52.13 50.04 53.69 51.28
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 5 10 15 20 25 19.17 19.97 18.61 19.49
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 120 240 360 480 600 571.95 566.57 574.67 557.74
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 3 6 9 12 15 12.21 12.32 12.15 12.52
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 70 140 210 280 350 308.08 316.58 325.44 311.50
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 0.7266 1.4532 2.1798 2.9064 3.633 3.2294 3.1430 3.0565 3.1954
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 0.6785 1.357 2.0355 2.714 3.3925 3.0156 2.8856 2.9188 2.8684
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 500 1000 1500 2000 2500 2249.49 2353.99 2313.37 2364.78
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 2 4 6 8 10 7.9919 7.9943 7.9860 7.9907
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 30 60 90 120 150 125.09 125.05 125.18 125.11
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 74.34 78.00 75.37 74.66
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 94.10 89.49 92.65 93.63
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 12 24 36 48 60 52.03 53.89 52.58 51.53
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 5 10 15 20 25 19.21 18.54 19.01 19.40
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 8 16 24 32 40 36.64 36.26 36.58 36.69
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 190.23 192.28 190.56 190.09
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 7 14 21 28 35 30.34 28.79 30.33 29.90
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 8 16 24 32 40 32.94 34.71 32.95 33.42
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 12 24 36 48 60 53.46 54.08 55.18 54.25
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 30 60 90 120 150 130.47 128.98 126.60 128.68
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 9 18 27 36 45 38.81 39.67 39.98 39.18
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.76 25.20 25.00 25.51
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 2 4 6 8 10 6.6736 7.0047 6.7585 6.7557
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 200 400 600 800 1000 1030.84 983.94 1016.00 1020.23
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 2 4 6 8 10 6.3123 6.4397 6.3497 6.2871
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 158.40 155.26 157.47 159.04
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 92.60 95.93 95.96 94.97
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 75.39 72.80 72.75 73.55
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 10 20 30 40 50 40.40 44.13 42.68 40.92
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 6 12 18 24 30 24.73 22.64 23.41 24.42
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 1.2585 2.517 3.7755 5.034 6.2925 5.4819 5.5873 5.5932 5.5129
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 300 600 900 1200 1500 1243.61 1234.80 1235.58 1242.96
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 1.2803 2.5606 3.8409 5.1212 6.4015 5.5840 5.6903 5.6314 5.5888
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 179.07 175.72 177.56 178.91
Primesieve Length: 1e12 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.04 24.85 24.76 25.10 1. (CXX) g++ options: -O3
Primesieve Length: 1e13 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Intel Core Ultra 7 155H a b c 80 160 240 320 400 353.14 361.14 349.94 351.48 1. (CXX) g++ options: -O3
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Intel Core Ultra 7 155H a b c 3M 6M 9M 12M 15M 10327383 10417995 10579637 12001097 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
Parallel BZIP2 Compression FreeBSD-13.0-RELEASE-amd64-memstick.img Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Intel Core Ultra 7 155H a b c 2 4 6 8 10 7.399834 7.669184 7.290079 7.602462 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Intel Core Ultra 7 155H a b c 30 60 90 120 150 142.40 143.50 139.05 141.99
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Intel Core Ultra 7 155H a b c 500 1000 1500 2000 2500 2111.00 2198.95 2018.83 2069.49
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 0.7594 1.5188 2.2782 3.0376 3.797 3.344 3.351 3.375 3.372 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.76 25.80 25.90 25.94 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 20 40 60 80 100 62.42 85.01 64.85 79.67 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 20 40 60 80 100 78.96 84.39 64.17 84.85 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 3 6 9 12 15 11.92 12.04 12.28 12.19 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 20 40 60 80 100 85.73 86.33 85.86 85.49 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 80 160 240 320 400 359.21 355.61 355.16 356.16 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 90 180 270 360 450 436.60 434.21 433.46 425.86 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Phoronix Test Suite v10.8.4