Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403172-NE-FGGG8186960 fggg - Phoronix Test Suite fggg d
HTML result view exported from: https://openbenchmarking.org/result/2403172-NE-FGGG8186960&sro&grr .
fggg Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c Intel Core Ultra 7 155H Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads) MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) Intel Device 7e7f 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026 1024GB Micron_2550_MTFDKBA1T0TGE Intel Arc MTL 8GB (2250MHz) Intel Meteor Lake-P HD Audio Intel Device 7e40 Ubuntu 23.10 6.8.0-060800rc1daily20240126-generic (x86_64) GNOME Shell 45.2 X Server 1.21.1.7 + Wayland 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa) GCC 13.2.0 ext4 1920x1200 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x13 - Thermald 2.5.4 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
fggg build-linux-kernel: allmodconfig selenium: SilverBench - Firefox primesieve: 1e13 stockfish: Chess Benchmark build-linux-kernel: defconfig deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream deepsparse: Llama2 Chat 7b Quantized - Asynchronous Multi-Stream selenium: Speedometer 3.0 - Firefox selenium: Speedometer 3.0 - Google Chrome deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream deepsparse: Llama2 Chat 7b Quantized - Synchronous Single-Stream svt-av1: Preset 4 - Bosphorus 4K deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream selenium: SilverBench - Google Chrome deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream selenium: Kraken - Firefox primesieve: 1e12 svt-av1: Preset 8 - Bosphorus 4K selenium: PSPDFKit WASM - Firefox selenium: Kraken - Google Chrome selenium: WASM collisionDetection - Firefox selenium: PSPDFKit WASM - Google Chrome svt-av1: Preset 4 - Bosphorus 1080p selenium: WASM collisionDetection - Google Chrome selenium: WASM imageConvolute - Firefox svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compression svt-av1: Preset 8 - Bosphorus 1080p selenium: WASM imageConvolute - Google Chrome svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p a b c Intel Core Ultra 7 155H 2198.954 1370 361.144 10417995 143.5 2353.9928 2.8856 14.6 18.2 125.0509 7.9943 3.351 128.9833 54.0806 34.566 202.1139 9.9143 100.7221 1224.52 5.5525 1234.8017 5.5873 983.938 7.0047 72.8034 95.9326 22.6399 44.1331 49974 175.7184 5.6903 175.9984 5.6812 155.2639 6.4397 25.1971 39.669 192.2847 36.2569 89.4874 78.0041 34.7133 28.7886 12.3239 566.5714 93.5642 74.7832 18.5416 53.893 19.9703 50.0414 3.143 316.5831 599.8 24.848 25.796 1082 489.1 280 1041 12.038 221.42 23.2 85.012 84.385 7.669184 86.334 20.9 355.611 434.212 2018.834 1459 349.939 10579637 139.052 2313.3715 2.9188 15.4 19.2 125.1786 7.986 3.375 126.6007 55.1778 34.6216 201.7476 10.0563 99.305 1190.1515 5.7537 1235.5842 5.5932 1016.0045 6.7585 72.7549 95.9642 23.4112 42.681 68068 177.5584 5.6314 176.3418 5.6702 157.4653 6.3497 24.9998 39.9828 190.558 36.5825 92.6519 75.3695 32.9456 30.3345 12.1523 574.6701 90.8958 76.9425 19.0076 52.5759 18.612 53.6917 3.0565 325.4391 614.6 24.761 25.902 1084 462.6 276.4 1023 12.281 219.6 22.4 64.854 64.166 7.290079 85.862 20.29 355.158 433.457 2069.486 1372 351.481 12001097 141.985 2364.778 2.8684 14.6 18.6 125.1081 7.9907 3.372 128.6802 54.2522 35.1325 198.9342 10.6166 94.0627 1217.1789 5.6993 1242.9553 5.5129 1020.2272 6.7557 73.5534 94.9722 24.4207 40.9163 48962 178.9118 5.5888 178.5596 5.5998 159.0351 6.2871 25.5085 39.1848 190.0904 36.6946 93.6256 74.664 33.4221 29.9021 12.524 557.739 93.4946 74.7778 19.3953 51.5251 19.4889 51.2776 3.1954 311.4965 608.2 25.104 25.944 1072 463.4 280.7 1098 12.191 220.99 22.6 79.674 84.845 7.602462 85.49 21.2 356.155 425.855 2111.002 1347 353.136 10327383 142.4 2249.4924 3.0156 15.2 18 125.0865 7.9919 3.344 130.4653 53.4604 35.1396 198.8137 10.1554 98.3373 1218.9412 5.7059 1243.6077 5.4819 1030.8408 6.6736 75.391 92.5958 24.7316 40.4041 44225 179.0672 5.584 175.8798 5.6851 158.3979 6.3123 25.7552 38.8108 190.2256 36.6392 94.0979 74.3398 32.9409 30.3372 12.2097 571.9535 93.2036 74.9318 19.2051 52.0291 19.1685 52.1316 3.2294 308.0782 629 25.039 25.755 1054 487 287.5 1028 11.921 220.12 22.3 62.424 78.957 7.399834 85.726 21.91 359.211 436.602 OpenBenchmarking.org
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Intel Core Ultra 7 155H a b c 500 1000 1500 2000 2500 2111.00 2198.95 2018.83 2069.49
Selenium Benchmark: SilverBench - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: SilverBench - Browser: Firefox Intel Core Ultra 7 155H a b c 300 600 900 1200 1500 1347 1370 1459 1372 1. firefox 121.0.1
Primesieve Length: 1e13 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Intel Core Ultra 7 155H a b c 80 160 240 320 400 353.14 361.14 349.94 351.48 1. (CXX) g++ options: -O3
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Intel Core Ultra 7 155H a b c 3M 6M 9M 12M 15M 10327383 10417995 10579637 12001097 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Intel Core Ultra 7 155H a b c 30 60 90 120 150 142.40 143.50 139.05 141.99
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 500 1000 1500 2000 2500 2249.49 2353.99 2313.37 2364.78
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 0.6785 1.357 2.0355 2.714 3.3925 3.0156 2.8856 2.9188 2.8684
Selenium Benchmark: Speedometer 3.0 - Browser: Firefox OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Speedometer 3.0 - Browser: Firefox Intel Core Ultra 7 155H a b c 4 8 12 16 20 15.2 14.6 15.4 14.6 1. firefox 121.0.1
Selenium Benchmark: Speedometer 3.0 - Browser: Google Chrome OpenBenchmarking.org Score, More Is Better Selenium Benchmark: Speedometer 3.0 - Browser: Google Chrome Intel Core Ultra 7 155H a b c 5 10 15 20 25 18.0 18.2 19.2 18.6 1. chrome 122.0.6261.128
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 30 60 90 120 150 125.09 125.05 125.18 125.11
Neural Magic DeepSparse Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 2 4 6 8 10 7.9919 7.9943 7.9860 7.9907
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 0.7594 1.5188 2.2782 3.0376 3.797 3.344 3.351 3.375 3.372 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 30 60 90 120 150 130.47 128.98 126.60 128.68
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 12 24 36 48 60 53.46 54.08 55.18 54.25
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 8 16 24 32 40 35.14 34.57 34.62 35.13
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 198.81 202.11 201.75 198.93
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 3 6 9 12 15 10.1554 9.9143 10.0563 10.6166
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 98.34 100.72 99.31 94.06
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 300 600 900 1200 1500 1218.94 1224.52 1190.15 1217.18
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 1.2946 2.5892 3.8838 5.1784 6.473 5.7059 5.5525 5.7537 5.6993
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 300 600 900 1200 1500 1243.61 1234.80 1235.58 1242.96
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 1.2585 2.517 3.7755 5.034 6.2925 5.4819 5.5873 5.5932 5.5129
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 200 400 600 800 1000 1030.84 983.94 1016.00 1020.23
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 2 4 6 8 10 6.6736 7.0047 6.7585 6.7557
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 75.39 72.80 72.75 73.55
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 92.60 95.93 95.96 94.97
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 6 12 18 24 30 24.73 22.64 23.41 24.42
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 10 20 30 40 50 40.40 44.13 42.68 40.92
Selenium Benchmark: SilverBench - Browser: Google Chrome OpenBenchmarking.org Score, More Is Better Selenium Benchmark: SilverBench - Browser: Google Chrome Intel Core Ultra 7 155H a b c 15K 30K 45K 60K 75K 44225 49974 68068 48962 1. chrome 122.0.6261.128
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 179.07 175.72 177.56 178.91
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 1.2803 2.5606 3.8409 5.1212 6.4015 5.5840 5.6903 5.6314 5.5888
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 175.88 176.00 176.34 178.56
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 1.2791 2.5582 3.8373 5.1164 6.3955 5.6851 5.6812 5.6702 5.5998
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 158.40 155.26 157.47 159.04
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 2 4 6 8 10 6.3123 6.4397 6.3497 6.2871
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.76 25.20 25.00 25.51
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 9 18 27 36 45 38.81 39.67 39.98 39.18
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 40 80 120 160 200 190.23 192.28 190.56 190.09
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 8 16 24 32 40 36.64 36.26 36.58 36.69
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 94.10 89.49 92.65 93.63
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 74.34 78.00 75.37 74.66
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 8 16 24 32 40 32.94 34.71 32.95 33.42
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 7 14 21 28 35 30.34 28.79 30.33 29.90
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 3 6 9 12 15 12.21 12.32 12.15 12.52
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 120 240 360 480 600 571.95 566.57 574.67 557.74
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 93.20 93.56 90.90 93.49
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Intel Core Ultra 7 155H a b c 20 40 60 80 100 74.93 74.78 76.94 74.78
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 5 10 15 20 25 19.21 18.54 19.01 19.40
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 12 24 36 48 60 52.03 53.89 52.58 51.53
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 5 10 15 20 25 19.17 19.97 18.61 19.49
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 12 24 36 48 60 52.13 50.04 53.69 51.28
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 0.7266 1.4532 2.1798 2.9064 3.633 3.2294 3.1430 3.0565 3.1954
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream Intel Core Ultra 7 155H a b c 70 140 210 280 350 308.08 316.58 325.44 311.50
Selenium Benchmark: Kraken - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Firefox Intel Core Ultra 7 155H a b c 140 280 420 560 700 629.0 599.8 614.6 608.2 1. firefox 121.0.1
Primesieve Length: 1e12 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.04 24.85 24.76 25.10 1. (CXX) g++ options: -O3
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 6 12 18 24 30 25.76 25.80 25.90 25.94 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Selenium Benchmark: PSPDFKit WASM - Browser: Firefox OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Firefox Intel Core Ultra 7 155H a b c 200 400 600 800 1000 1054 1082 1084 1072 1. firefox 121.0.1
Selenium Benchmark: Kraken - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: Kraken - Browser: Google Chrome Intel Core Ultra 7 155H a b c 110 220 330 440 550 487.0 489.1 462.6 463.4 1. chrome 122.0.6261.128
Selenium Benchmark: WASM collisionDetection - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Firefox Intel Core Ultra 7 155H a b c 60 120 180 240 300 287.5 280.0 276.4 280.7 1. firefox 121.0.1
Selenium Benchmark: PSPDFKit WASM - Browser: Google Chrome OpenBenchmarking.org Score, Fewer Is Better Selenium Benchmark: PSPDFKit WASM - Browser: Google Chrome Intel Core Ultra 7 155H a b c 200 400 600 800 1000 1028 1041 1023 1098 1. chrome 122.0.6261.128
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 3 6 9 12 15 11.92 12.04 12.28 12.19 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Selenium Benchmark: WASM collisionDetection - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM collisionDetection - Browser: Google Chrome Intel Core Ultra 7 155H a b c 50 100 150 200 250 220.12 221.42 219.60 220.99 1. chrome 122.0.6261.128
Selenium Benchmark: WASM imageConvolute - Browser: Firefox OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Firefox Intel Core Ultra 7 155H a b c 6 12 18 24 30 22.3 23.2 22.4 22.6 1. firefox 121.0.1
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 20 40 60 80 100 62.42 85.01 64.85 79.67 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Intel Core Ultra 7 155H a b c 20 40 60 80 100 78.96 84.39 64.17 84.85 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Parallel BZIP2 Compression FreeBSD-13.0-RELEASE-amd64-memstick.img Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Intel Core Ultra 7 155H a b c 2 4 6 8 10 7.399834 7.669184 7.290079 7.602462 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 20 40 60 80 100 85.73 86.33 85.86 85.49 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome OpenBenchmarking.org ms, Fewer Is Better Selenium Benchmark: WASM imageConvolute - Browser: Google Chrome Intel Core Ultra 7 155H a b c 5 10 15 20 25 21.91 20.90 20.29 21.20 1. chrome 122.0.6261.128
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 80 160 240 320 400 359.21 355.61 355.16 356.16 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Intel Core Ultra 7 155H a b c 90 180 270 360 450 436.60 434.21 433.46 425.86 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Phoronix Test Suite v10.8.4