Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403172-NE-FGGG8186960 fggg - Phoronix Test Suite fggg d
HTML result view exported from: https://openbenchmarking.org/result/2403172-NE-FGGG8186960&export=pdf&gru&sor&rro .
fggg Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c Intel Core Ultra 7 155H Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads) MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) Intel Device 7e7f 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026 1024GB Micron_2550_MTFDKBA1T0TGE Intel Arc MTL 8GB (2250MHz) Intel Meteor Lake-P HD Audio Intel Device 7e40 Ubuntu 23.10 6.8.0-060800rc1daily20240126-generic (x86_64) GNOME Shell 45.2 X Server 1.21.1.7 + Wayland 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa) GCC 13.2.0 ext4 1920x1200 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x13 - Thermald 2.5.4 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
fggg svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream stockfish: Chess Benchmark selenium: SilverBench - Firefox selenium: Speedometer 3.0 - Firefox selenium: SilverBench - Google Chrome selenium: Speedometer 3.0 - Google Chrome selenium: Kraken - Firefox selenium: Kraken - Google Chrome selenium: WASM imageConvolute - Firefox selenium: WASM collisionDetection - Firefox selenium: WASM imageConvolute - Google Chrome selenium: WASM collisionDetection - Google Chrome deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream selenium: PSPDFKit WASM - Firefox selenium: PSPDFKit WASM - Google Chrome build-linux-kernel: defconfig build-linux-kernel: allmodconfig compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compression primesieve: 1e12 primesieve: 1e13 a b c Intel Core Ultra 7 155H 3.351 25.796 85.012 84.385 12.038 86.334 355.611 434.212 5.5525 5.6812 202.1139 100.7221 74.7832 50.0414 566.5714 316.5831 2.8856 7.9943 78.0041 53.893 36.2569 28.7886 54.0806 39.669 7.0047 6.4397 95.9326 44.1331 5.5873 5.6903 10417995 1370 14.6 49974 18.2 599.8 489.1 23.2 280 20.9 221.42 1224.52 175.9984 34.566 9.9143 93.5642 19.9703 12.3239 3.143 2353.9928 125.0509 89.4874 18.5416 192.2847 34.7133 128.9833 25.1971 983.938 155.2639 72.8034 22.6399 1234.8017 175.7184 1082 1041 143.5 2198.954 7.669184 24.848 361.144 3.375 25.902 64.854 64.166 12.281 85.862 355.158 433.457 5.7537 5.6702 201.7476 99.305 76.9425 53.6917 574.6701 325.4391 2.9188 7.986 75.3695 52.5759 36.5825 30.3345 55.1778 39.9828 6.7585 6.3497 95.9642 42.681 5.5932 5.6314 10579637 1459 15.4 68068 19.2 614.6 462.6 22.4 276.4 20.29 219.6 1190.1515 176.3418 34.6216 10.0563 90.8958 18.612 12.1523 3.0565 2313.3715 125.1786 92.6519 19.0076 190.558 32.9456 126.6007 24.9998 1016.0045 157.4653 72.7549 23.4112 1235.5842 177.5584 1084 1023 139.052 2018.834 7.290079 24.761 349.939 3.372 25.944 79.674 84.845 12.191 85.49 356.155 425.855 5.6993 5.5998 198.9342 94.0627 74.7778 51.2776 557.739 311.4965 2.8684 7.9907 74.664 51.5251 36.6946 29.9021 54.2522 39.1848 6.7557 6.2871 94.9722 40.9163 5.5129 5.5888 12001097 1372 14.6 48962 18.6 608.2 463.4 22.6 280.7 21.2 220.99 1217.1789 178.5596 35.1325 10.6166 93.4946 19.4889 12.524 3.1954 2364.778 125.1081 93.6256 19.3953 190.0904 33.4221 128.6802 25.5085 1020.2272 159.0351 73.5534 24.4207 1242.9553 178.9118 1072 1098 141.985 2069.486 7.602462 25.104 351.481 3.344 25.755 62.424 78.957 11.921 85.726 359.211 436.602 5.7059 5.6851 198.8137 98.3373 74.9318 52.1316 571.9535 308.0782 3.0156 7.9919 74.3398 52.0291 36.6392 30.3372 53.4604 38.8108 6.6736 6.3123 92.5958 40.4041 5.4819 5.584 10327383 1347 15.2 44225 18 629 487 22.3 287.5 21.91 220.12 1218.9412 175.8798 35.1396 10.1554 93.2036 19.1685 12.2097 3.2294 2249.4924 125.0865 94.0979 19.2051 190.2256 32.9409 130.4653 25.7552 1030.8408 158.3979 75.391 24.7316 1243.6077 179.0672 1054 1028 142.4 2111.002 7.399834 25.039 353.136 OpenBenchmarking.org
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Intel Core Ultra 7 155H a c b 0.7594 1.5188 2.2782 3.0376 3.797 3.344 3.351 3.372 3.375 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.76 25.80 25.90 25.94 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Intel Core Ultra 7 155H b c a 20 40 60 80 100 62.42 64.85 79.67 85.01 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K b Intel Core Ultra 7 155H a c 20 40 60 80 100 64.17 78.96 84.39 84.85 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a c b 3 6 9 12 15 11.92 12.04 12.19 12.28 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 1080p c Intel Core Ultra 7 155H b a 20 40 60 80 100 85.49 85.73 85.86 86.33 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 1080p b a c Intel Core Ultra 7 155H 80 160 240 320 400 355.16 355.61 356.16 359.21 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 1080p c b a Intel Core Ultra 7 155H 90 180 270 360 450 425.86 433.46 434.21 436.60 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream a c Intel Core Ultra 7 155H b 1.2946 2.5892 3.8838 5.1784 6.473 5.5525 5.6993 5.7059 5.7537
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream c b a Intel Core Ultra 7 155H 1.2791 2.5582 3.8373 5.1164 6.3955 5.5998 5.6702 5.6812 5.6851
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 40 80 120 160 200 198.81 198.93 201.75 202.11
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream c Intel Core Ultra 7 155H b a 20 40 60 80 100 94.06 98.34 99.31 100.72
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream c a Intel Core Ultra 7 155H b 20 40 60 80 100 74.78 74.78 74.93 76.94
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream a c Intel Core Ultra 7 155H b 12 24 36 48 60 50.04 51.28 52.13 53.69
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream c a Intel Core Ultra 7 155H b 120 240 360 480 600 557.74 566.57 571.95 574.67
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c a b 70 140 210 280 350 308.08 311.50 316.58 325.44
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream c a b Intel Core Ultra 7 155H 0.6785 1.357 2.0355 2.714 3.3925 2.8684 2.8856 2.9188 3.0156
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream b c Intel Core Ultra 7 155H a 2 4 6 8 10 7.9860 7.9907 7.9919 7.9943
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 20 40 60 80 100 74.34 74.66 75.37 78.00
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream c Intel Core Ultra 7 155H b a 12 24 36 48 60 51.53 52.03 52.58 53.89
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream a b Intel Core Ultra 7 155H c 8 16 24 32 40 36.26 36.58 36.64 36.69
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream a c b Intel Core Ultra 7 155H 7 14 21 28 35 28.79 29.90 30.33 30.34
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a c b 12 24 36 48 60 53.46 54.08 54.25 55.18
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c a b 9 18 27 36 45 38.81 39.18 39.67 39.98
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 2 4 6 8 10 6.6736 6.7557 6.7585 7.0047
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream c Intel Core Ultra 7 155H b a 2 4 6 8 10 6.2871 6.3123 6.3497 6.4397
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c a b 20 40 60 80 100 92.60 94.97 95.93 95.96
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c b a 10 20 30 40 50 40.40 40.92 42.68 44.13
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c a b 1.2585 2.517 3.7755 5.034 6.2925 5.4819 5.5129 5.5873 5.5932
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c b a 1.2803 2.5606 3.8409 5.1212 6.4015 5.5840 5.5888 5.6314 5.6903
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Intel Core Ultra 7 155H a b c 3M 6M 9M 12M 15M 10327383 10417995 10579637 12001097 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
Selenium Benchmark: SilverBench - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: SilverBench - Browser: Firefox Intel Core Ultra 7 155H a c b 300 600 900 1200 1500 1347 1370 1372 1459 1. firefox 121.0.1
Selenium Benchmark: Speedometer 3.0 - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Speedometer 3.0 - Browser: Firefox a c Intel Core Ultra 7 155H b 4 8 12 16 20 14.6 14.6 15.2 15.4 1. firefox 121.0.1
Selenium Benchmark: SilverBench - Browser: Google Chrome OpenBenchmarking.org Score, More Is Better Selenium Benchmark: SilverBench - Browser: Google Chrome Intel Core Ultra 7 155H c a b 15K 30K 45K 60K 75K 44225 48962 49974 68068 1. chrome 122.0.6261.128
Selenium Benchmark: Speedometer 3.0 - Browser: Google Chrome OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Speedometer 3.0 - Browser: Google Chrome Intel Core Ultra 7 155H a c b 5 10 15 20 25 18.0 18.2 18.6 19.2 1. chrome 122.0.6261.128
Selenium Benchmark: Kraken - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Firefox Intel Core Ultra 7 155H b c a 140 280 420 560 700 629.0 614.6 608.2 599.8 1. firefox 121.0.1
Selenium Benchmark: Kraken - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Google Chrome a Intel Core Ultra 7 155H c b 110 220 330 440 550 489.1 487.0 463.4 462.6 1. chrome 122.0.6261.128
Selenium Benchmark: WASM imageConvolute - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Firefox a c b Intel Core Ultra 7 155H 6 12 18 24 30 23.2 22.6 22.4 22.3 1. firefox 121.0.1
Selenium Benchmark: WASM collisionDetection - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Firefox Intel Core Ultra 7 155H c a b 60 120 180 240 300 287.5 280.7 280.0 276.4 1. firefox 121.0.1
Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome Intel Core Ultra 7 155H c a b 5 10 15 20 25 21.91 21.20 20.90 20.29 1. chrome 122.0.6261.128
Selenium Benchmark: WASM collisionDetection - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Google Chrome a c Intel Core Ultra 7 155H b 50 100 150 200 250 221.42 220.99 220.12 219.60 1. chrome 122.0.6261.128
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream a Intel Core Ultra 7 155H c b 300 600 900 1200 1500 1224.52 1218.94 1217.18 1190.15
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream c b a Intel Core Ultra 7 155H 40 80 120 160 200 178.56 176.34 176.00 175.88
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 8 16 24 32 40 35.14 35.13 34.62 34.57
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream c Intel Core Ultra 7 155H b a 3 6 9 12 15 10.6166 10.1554 10.0563 9.9143
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream a c Intel Core Ultra 7 155H b 20 40 60 80 100 93.56 93.49 93.20 90.90
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream a c Intel Core Ultra 7 155H b 5 10 15 20 25 19.97 19.49 19.17 18.61
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream c a Intel Core Ultra 7 155H b 3 6 9 12 15 12.52 12.32 12.21 12.15
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c a b 0.7266 1.4532 2.1798 2.9064 3.633 3.2294 3.1954 3.1430 3.0565
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream c a b Intel Core Ultra 7 155H 500 1000 1500 2000 2500 2364.78 2353.99 2313.37 2249.49
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream b c Intel Core Ultra 7 155H a 30 60 90 120 150 125.18 125.11 125.09 125.05
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 20 40 60 80 100 94.10 93.63 92.65 89.49
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream c Intel Core Ultra 7 155H b a 5 10 15 20 25 19.40 19.21 19.01 18.54
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream a b Intel Core Ultra 7 155H c 40 80 120 160 200 192.28 190.56 190.23 190.09
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream a c b Intel Core Ultra 7 155H 8 16 24 32 40 34.71 33.42 32.95 32.94
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a c b 30 60 90 120 150 130.47 128.98 128.68 126.60
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c a b 6 12 18 24 30 25.76 25.51 25.20 25.00
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 200 400 600 800 1000 1030.84 1020.23 1016.00 983.94
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream c Intel Core Ultra 7 155H b a 40 80 120 160 200 159.04 158.40 157.47 155.26
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c a b 20 40 60 80 100 75.39 73.55 72.80 72.75
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c b a 6 12 18 24 30 24.73 24.42 23.41 22.64
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H c b a 300 600 900 1200 1500 1243.61 1242.96 1235.58 1234.80
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H c b a 40 80 120 160 200 179.07 178.91 177.56 175.72
Selenium Benchmark: PSPDFKit WASM - Browser: Firefox OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Firefox b a c Intel Core Ultra 7 155H 200 400 600 800 1000 1084 1082 1072 1054 1. firefox 121.0.1
Selenium Benchmark: PSPDFKit WASM - Browser: Google Chrome OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Google Chrome c a Intel Core Ultra 7 155H b 200 400 600 800 1000 1098 1041 1028 1023 1. chrome 122.0.6261.128
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig a Intel Core Ultra 7 155H c b 30 60 90 120 150 143.50 142.40 141.99 139.05
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig a Intel Core Ultra 7 155H c b 500 1000 1500 2000 2500 2198.95 2111.00 2069.49 2018.83
Parallel BZIP2 Compression FreeBSD-13.0-RELEASE-amd64-memstick.img Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression a c Intel Core Ultra 7 155H b 2 4 6 8 10 7.669184 7.602462 7.399834 7.290079 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
Primesieve Length: 1e12 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 c Intel Core Ultra 7 155H a b 6 12 18 24 30 25.10 25.04 24.85 24.76 1. (CXX) g++ options: -O3
Primesieve Length: 1e13 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 a Intel Core Ultra 7 155H c b 80 160 240 320 400 361.14 353.14 351.48 349.94 1. (CXX) g++ options: -O3
Phoronix Test Suite v10.8.4