H610-i312100-1

Intel Core i3-12100 testing with a ASRock H610M-HDV/M.2 R2.0 (6.03 BIOS) and Intel ADL-S GT1 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2408228-HERT-H610I3171
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Intel ADL-S GT1 - Intel Core i3-12100
August 20
  2 Days, 17 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

H610-i312100-1, "PyTorch 2.2.1 - Device: CPU - Batch Size: 1 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",25.426087220852,24.173327759531,24.87408851119,25.075768550799 "PyTorch 2.2.1 - Device: CPU - Batch Size: 1 - Model: ResNet-152", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",11.366746967892,11.280929240803,11.373654663141 "PyTorch 2.2.1 - Device: CPU - Batch Size: 16 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.774847244118,12.41025530461,12.515782977046 "PyTorch 2.2.1 - Device: CPU - Batch Size: 32 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.835804087633,12.001026861519,12.725575466387,12.254408392991,12.830615066253,12.706371068258,12.430564956282,12.717903059018 "PyTorch 2.2.1 - Device: CPU - Batch Size: 64 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.592267772298,12.929812177196,12.535395317054 "PyTorch 2.2.1 - Device: CPU - Batch Size: 16 - Model: ResNet-152", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.2692245879963,6.3249239597877,6.3966978970902 "PyTorch 2.2.1 - Device: CPU - Batch Size: 256 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.958100249468,12.732359188501,13.030237146176 "PyTorch 2.2.1 - Device: CPU - Batch Size: 32 - Model: ResNet-152", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.2860584471378,6.2295185059927,6.1897317965318 "PyTorch 2.2.1 - Device: CPU - Batch Size: 512 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.653618433175,12.508549989777,13.103831251826 "PyTorch 2.2.1 - Device: CPU - Batch Size: 64 - Model: ResNet-152", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.2708010835521,6.2571142850995,6.1757063617725 "PyTorch 2.2.1 - Device: CPU - Batch Size: 256 - Model: ResNet-152", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.259580333942,6.1878398227747,6.221751644575 "PyTorch 2.2.1 - Device: CPU - Batch Size: 512 - Model: ResNet-152", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.1026605748566,6.198132163862,6.2044594305526 "PyTorch 2.2.1 - Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",8.2355806425896,7.8048226736313,8.2558886547339,8.0771632572853,8.1390509470416 "PyTorch 2.2.1 - Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.5175859415573,4.5669333766936,4.4333870006657 "PyTorch 2.2.1 - Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.548002821208,4.5683664808979,4.5298604401684 "PyTorch 2.2.1 - Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.4998680452365,4.5344962213239,4.524403268003 "PyTorch 2.2.1 - Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_l", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.5170613701073,4.4562820977106,4.5264881395398 "PyTorch 2.2.1 - Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_l", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.4060456942587,4.5427549687621,4.4814914907945 "PlaidML - FP16: No - Mode: Inference - Network: VGG16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",9.01,8.86,8.71 "PlaidML - FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.61,4.64,4.62 "OpenVINO 2024.0 - Model: Face Detection FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1.24,1.24,1.24 "OpenVINO 2024.0 - Model: Person Detection FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",10.01,10.12,10.04 "OpenVINO 2024.0 - Model: Person Detection FP32 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",10.04,10,10.07 "OpenVINO 2024.0 - Model: Vehicle Detection FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",62.69,62.65,62.49 "OpenVINO 2024.0 - Model: Face Detection FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5.28,5.27,5.24 "OpenVINO 2024.0 - Model: Face Detection Retail FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",334.34,330.75,326.17 "OpenVINO 2024.0 - Model: Road Segmentation ADAS FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",18.24,18.17,18.32 "OpenVINO 2024.0 - Model: Vehicle Detection FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",213.2,213.66,215.77 "OpenVINO 2024.0 - Model: Weld Porosity Detection FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",137.25,136.53,136.45 "OpenVINO 2024.0 - Model: Face Detection Retail FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",837.29,826.19,836.54 "OpenVINO 2024.0 - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",62.74,63.48,63.34 "OpenVINO 2024.0 - Model: Machine Translation EN To DE FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",14.92,14.93,14.99 "OpenVINO 2024.0 - Model: Weld Porosity Detection FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",511.8,513.76,513.56 "OpenVINO 2024.0 - Model: Person Vehicle Bike Detection FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",167.38,170.12,162.63 "OpenVINO 2024.0 - Model: Noise Suppression Poconet-Like FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",208.04,210.32,208.15 "OpenVINO 2024.0 - Model: Handwritten English Recognition FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",66.05,66.87,66.28 "OpenVINO 2024.0 - Model: Person Re-Identification Retail FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",200.54,200.06,205.09 "OpenVINO 2024.0 - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3490.69,3429.6,3525.48 "OpenVINO 2024.0 - Model: Handwritten English Recognition FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",88.75,87.65,88.84 "OpenVINO 2024.0 - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",10595.51,10611.42,10571.09 "TensorFlow 2.16.1 - Device: CPU - Batch Size: 1 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 1 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 1 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 16 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 32 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 64 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 1 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 16 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 32 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 64 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 16 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 256 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 32 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 512 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 64 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 16 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 256 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 32 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 512 - Model: VGG-16", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 64 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 1 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 1 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 256 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 512 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 1 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 1 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 256 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 512 - Model: AlexNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 16 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 16 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 32 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 32 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 64 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 64 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 16 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 16 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 32 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 32 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 64 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 64 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 256 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 256 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 512 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: CPU - Batch Size: 512 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 256 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 256 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 512 - Model: GoogLeNet", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "TensorFlow 2.16.1 - Device: GPU - Batch Size: 512 - Model: ResNet-50", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",50.1839,50.3033,50.4575 "ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",50.7724,52.1218,50.4621 "ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ONNX Runtime 1.17 - Model: yolov4 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",56.0994,56.0238,55.9521 "ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",57.6253,57.5716,57.579 "ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5.74519,5.10505,5.00137,5.23614,5.33124,5.57637,5.45828,4.90591,4.69496,5.43104,5.46315,5.78554,5.53838,5.38625,5.5153 "ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",8.3887,5.00118,4.89929,8.46782,8.47617,8.42537,8.03072,8.48255,8.49016,8.49967,8.40625,8.53152,8.32989,8.38103 "ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",211.963,211.506,204.873 "ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",236.06,227.99,235.713 "ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.4681,0.498602,0.59124,0.457677,0.510536,0.458642,0.538754,0.583258,0.607404,0.581857,0.486515,0.559398,0.463561,0.440209,0.441384 "ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.767928,0.771492,0.63906,0.722443,0.75659,0.766648,0.764777,0.75703,0.76978,0.771926,0.765509,0.612857,0.771677,0.770747,0.729514 "ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",11.1639,11.712,11.1823,11.7483,11.686,11.7488 "ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",17.5063,16.5612,17.4962,17.4992,17.4977 "ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",122.232,124.21,119.581 "ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",144.294,141.426,142.495 "ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",37.8238,37.2531,39.2197,37.8722 "ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",42.0687,33.7538,56.6211,56.9609,56.6671,56.9998,56.8393,55.4357,56.7889,56.7388,56.6463,56.916,43.8779,56.9246,55.7011 "ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.49128,4.37599,4.43999 "ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5.2037,4.42013,5.19969,5.19651,4.95223,5.18843,5.19053,5.18032,5.19556,5.09565,5.19474,5.19571 "Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.0501,4.0886,4.0861 "Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.3153,4.3065,4.3196 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",164.7053,164.7407,164.5083 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",144.8162,145.0712,145.9347 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",51.8043,51.3195,51.9364 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",47.573,47.4478,47.6339 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",367.9648,368.4895,371.6205 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",302.3055,299.7405,298.2903 "Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.0075,0.0071,0.0071,0.007,0.0067,0.0071,0.0068,0.007,0.0067 "Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.0094,0.0088,0.0093,0.0087,0.0094,0.009,0.0092,0.0096,0.0093 "Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",51.4175,51.8718,51.4302 "Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",47.546,47.4558,47.4199 "Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",23.8573,23.8388,23.9338 "Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",23.4503,23.4743,23.4386 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",34.5468,34.5064,34.1782 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",32.3273,32.1735,32.224 "Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.9245,5.0567,5.0306 "Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.8063,4.8028,4.8357 "Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",78.2396,78.2683,78.0595 "Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",64.739,64.9174,64.9029 "Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.1556,4.0798,4.1184 "Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.3387,4.3204,4.3373 "LeelaChessZero 0.31.1 - Backend: BLAS", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Numpy Benchmark - ", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",462.4,463.68,463.42 "AI Benchmark Alpha 0.1.2 - ", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Llama.cpp b3067 - Model: llama-2-7b.Q4_0.gguf", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Llama.cpp b3067 - Model: llama-2-13b.Q4_0.gguf", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Llama.cpp b3067 - Model: llama-2-70b-chat.Q5_0.gguf", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Llamafile 0.8.6 - Test: llava-v1.5-7b-q4 - Acceleration: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Llamafile 0.8.6 - Test: mistral-7b-instruct-v0.2.Q8_0 - Acceleration: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Llamafile 0.8.6 - Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "spaCy 3.4.1 - ", Higher Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",19.9239,19.8761,19.8158 "ONNX Runtime 1.17 - Model: GPT-2 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",19.691,19.1807,19.8111 "ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",17.8249,17.8488,17.8717 "ONNX Runtime 1.17 - Model: T5 Encoder - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",17.3526,17.3688,17.3666 "ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",174.057,195.883,199.944,190.979,187.572,179.327,183.206,203.834,212.993,184.125,183.043,172.843,180.557,185.657,181.312 "ONNX Runtime 1.17 - Model: bertsquad-12 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",119.206,199.951,204.109,118.092,117.976,118.687,124.52,117.887,117.781,117.65,118.957,117.21,120.048,119.315 "ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.71701,4.72685,4.88029 "ONNX Runtime 1.17 - Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.2356,4.38561,4.24192 "ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2136.3,2005.6,1691.36,2184.95,1958.72,2180.35,1856.13,1714.5,1646.35,1718.63,2055.43,1787.63,2157.21,2271.64,2265.6 "ONNX Runtime 1.17 - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1302.2,1296.19,1564.8,1384.19,1321.72,1304.38,1307.57,1320.95,1299.07,1295.46,1306.32,1631.7,1295.88,1297.44,1370.77 "ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",89.5734,85.3819,89.4266,85.1182,85.5715,85.1147 "ONNX Runtime 1.17 - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",57.1213,60.381,57.1542,57.1444,57.1492 "ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",8.18031,8.05009,8.36171 "ONNX Runtime 1.17 - Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.9293,7.06993,7.01686 "ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",26.4372,26.8421,25.4958,26.4032 "ONNX Runtime 1.17 - Model: super-resolution-10 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",23.7692,29.625,17.6599,17.5546,17.6457,17.5426,17.5922,18.0376,17.6077,17.6234,17.6521,17.5684,22.7892,17.5657,17.9517 "ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",222.652,228.518,225.224 "ONNX Runtime 1.17 - Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",192.168,226.235,192.317,192.435,201.927,192.734,192.656,193.036,192.469,196.243,192.5,192.464 "TensorFlow Lite 2022-05-18 - Model: SqueezeNet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4298.31,4327.37,4342.46 "TensorFlow Lite 2022-05-18 - Model: Inception V4", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",64711.9,65067.8,65015.8 "TensorFlow Lite 2022-05-18 - Model: NASNet Mobile", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12000.9,12002.3,12012.3 "TensorFlow Lite 2022-05-18 - Model: Mobilenet Float", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3557.98,3599.96,3566.98 "TensorFlow Lite 2022-05-18 - Model: Mobilenet Quant", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5180.81,5202.09,5211.31 "TensorFlow Lite 2022-05-18 - Model: Inception ResNet V2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",60913.8,61046.6,60886.7 "Caffe 2020-02-13 - Model: AlexNet - Acceleration: CPU - Iterations: 100", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",44317,44123,45425 "Caffe 2020-02-13 - Model: AlexNet - Acceleration: CPU - Iterations: 200", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",91225,90991,88470 "Caffe 2020-02-13 - Model: AlexNet - Acceleration: CPU - Iterations: 1000", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",441062,455259,441477 "Caffe 2020-02-13 - Model: GoogleNet - Acceleration: CPU - Iterations: 100", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",103119,103605,103508 "Caffe 2020-02-13 - Model: GoogleNet - Acceleration: CPU - Iterations: 200", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",206500,206374,206512 "Caffe 2020-02-13 - Model: GoogleNet - Acceleration: CPU - Iterations: 1000", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1044380,1033260,1037320 "oneDNN 3.4 - Harness: IP Shapes 1D - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.03664,5.97669,6.00471 "oneDNN 3.4 - Harness: IP Shapes 3D - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",26.6379,26.7062,26.7552 "oneDNN 3.4 - Harness: Convolution Batch Shapes Auto - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",43.7105,43.7136,45.0074 "oneDNN 3.4 - Harness: Deconvolution Batch shapes_1d - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",11.5871,10.669,10.503,10.4684,10.5714,10.566,10.5068,10.8085,11.1168,10.7583,10.8924,11.3287,10.1942,10.2528,11.0766 "oneDNN 3.4 - Harness: Deconvolution Batch shapes_3d - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",10.1963,10.4478,10.4712 "oneDNN 3.4 - Harness: Recurrent Neural Network Training - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5718.05,5701.96,5706.91 "oneDNN 3.4 - Harness: Recurrent Neural Network Inference - Engine: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3092.64,3049.93,3071.36 "Mobile Neural Network 2.9.b11b7037d - Model: nasnet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",9.036,9.069,9.111 "Mobile Neural Network 2.9.b11b7037d - Model: mobilenetV3", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1.141,1.141,1.281 "Mobile Neural Network 2.9.b11b7037d - Model: squeezenetv1.1", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2.876,2.897,2.927 "Mobile Neural Network 2.9.b11b7037d - Model: resnet-v2-50", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",26.392,26.296,26.249 "Mobile Neural Network 2.9.b11b7037d - Model: SqueezeNetV1.0", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.727,4.747,4.759 "Mobile Neural Network 2.9.b11b7037d - Model: MobileNetV2_224", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2.694,2.703,2.717 "Mobile Neural Network 2.9.b11b7037d - Model: mobilenet-v1-1.0", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.284,3.386,3.45 "Mobile Neural Network 2.9.b11b7037d - Model: inception-v3", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",33.372,33.558,33.59 "NCNN 20230517 - Target: CPU - Model: mobilenet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",22.28,21.11,21.36,21.26 "NCNN 20230517 - Target: CPU-v2-v2 - Model: mobilenet-v2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5.28,5.43,5.29,5.39 "NCNN 20230517 - Target: CPU-v3-v3 - Model: mobilenet-v3", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.15,3.22,3.2,3.16 "NCNN 20230517 - Target: CPU - Model: shufflenet-v2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2.21,2.33,2.21,2.23 "NCNN 20230517 - Target: CPU - Model: mnasnet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.18,3.38,4.28,3.27 "NCNN 20230517 - Target: CPU - Model: efficientnet-b0", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",8.03,8.06,8.25,8.26 "NCNN 20230517 - Target: CPU - Model: blazeface", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.62,0.61,0.63,0.63 "NCNN 20230517 - Target: CPU - Model: googlenet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",16.97,15.8,15.92,15.83 "NCNN 20230517 - Target: CPU - Model: vgg16", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",109.9,110.07,109.67,110.02 "NCNN 20230517 - Target: CPU - Model: resnet18", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.41,12.3,12.33,12.33 "NCNN 20230517 - Target: CPU - Model: alexnet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.65,12.67,12.63,12.56 "NCNN 20230517 - Target: CPU - Model: resnet50", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",26.84,26.47,26.57,26.95 "NCNN 20230517 - Target: CPU - Model: yolov4-tiny", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",40.14,40.28,40.08,39.98 "NCNN 20230517 - Target: CPU - Model: squeezenet_ssd", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",17.39,17.27,17.63,17.39 "NCNN 20230517 - Target: CPU - Model: regnety_400m", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.64,6.53,6.6,6.52 "NCNN 20230517 - Target: CPU - Model: vision_transformer", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",135.03,135.01,135.33,136.6 "NCNN 20230517 - Target: CPU - Model: FastestDet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.2,3.32,3.27,3.44 "NCNN 20230517 - Target: Vulkan GPU - Model: mobilenet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",21.04,20.99,21.11 "NCNN 20230517 - Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5.25,5.3,5.31 "NCNN 20230517 - Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.19,3.19,3.19 "NCNN 20230517 - Target: Vulkan GPU - Model: shufflenet-v2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2.2,2.22,2.22 "NCNN 20230517 - Target: Vulkan GPU - Model: mnasnet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.17,3.21 "NCNN 20230517 - Target: Vulkan GPU - Model: efficientnet-b0", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",7.95,8,8.03 "NCNN 20230517 - Target: Vulkan GPU - Model: blazeface", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.62,0.61,0.61 "NCNN 20230517 - Target: Vulkan GPU - Model: googlenet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",15.81,15.91,15.76 "NCNN 20230517 - Target: Vulkan GPU - Model: vgg16", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",110.54,111.42,111.41 "NCNN 20230517 - Target: Vulkan GPU - Model: resnet18", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.28,12.25,12.22 "NCNN 20230517 - Target: Vulkan GPU - Model: alexnet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.53,12.57,12.51 "NCNN 20230517 - Target: Vulkan GPU - Model: resnet50", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",27.55,26.73,26.63 "NCNN 20230517 - Target: Vulkan GPU - Model: yolov4-tiny", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",39.97,39.53,39.9 "NCNN 20230517 - Target: Vulkan GPU - Model: squeezenet_ssd", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",17.55,17.45,17.47 "NCNN 20230517 - Target: Vulkan GPU - Model: regnety_400m", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.52,6.53,6.53 "NCNN 20230517 - Target: Vulkan GPU - Model: vision_transformer", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",136.19,136.09,136.4 "NCNN 20230517 - Target: Vulkan GPU - Model: FastestDet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.34,3.28,3.27 "TNN 0.3 - Target: CPU - Model: DenseNet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2449.663,2443.621,2446.451 "TNN 0.3 - Target: CPU - Model: MobileNet v2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",201.214,201.233,200.879 "TNN 0.3 - Target: CPU - Model: SqueezeNet v2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",46.338,46.168,46.108 "TNN 0.3 - Target: CPU - Model: SqueezeNet v1.1", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",166.044,166.316,166.034 "OpenVINO 2024.0 - Model: Face Detection FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3216.62,3212.76,3210.46 "OpenVINO 2024.0 - Model: Person Detection FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",398.78,395.21,398.42 "OpenVINO 2024.0 - Model: Person Detection FP32 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",398.38,399.78,397.34 "OpenVINO 2024.0 - Model: Vehicle Detection FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",63.76,63.81,63.97 "OpenVINO 2024.0 - Model: Face Detection FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",757.23,758.57,761.91 "OpenVINO 2024.0 - Model: Face Detection Retail FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",11.95,12.08,12.25 "OpenVINO 2024.0 - Model: Road Segmentation ADAS FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",219.12,220,218.17 "OpenVINO 2024.0 - Model: Vehicle Detection FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",18.75,18.71,18.52 "OpenVINO 2024.0 - Model: Weld Porosity Detection FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",29.13,29.29,29.31 "OpenVINO 2024.0 - Model: Face Detection Retail FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",4.77,4.84,4.78 "OpenVINO 2024.0 - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",63.71,62.98,63.11 "OpenVINO 2024.0 - Model: Machine Translation EN To DE FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",267.84,267.75,266.74 "OpenVINO 2024.0 - Model: Weld Porosity Detection FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",7.81,7.78,7.78 "OpenVINO 2024.0 - Model: Person Vehicle Bike Detection FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",23.88,23.5,24.58 "OpenVINO 2024.0 - Model: Noise Suppression Poconet-Like FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",19.16,18.97,19.16 "OpenVINO 2024.0 - Model: Handwritten English Recognition FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",60.53,59.79,60.32 "OpenVINO 2024.0 - Model: Person Re-Identification Retail FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",19.93,19.98,19.49 "OpenVINO 2024.0 - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1.14,1.16,1.13 "OpenVINO 2024.0 - Model: Handwritten English Recognition FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",45.05,45.62,45 "OpenVINO 2024.0 - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.37,0.37,0.38 "OpenCV 4.7 - Test: DNN - Deep Neural Network", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",24211,25759,26935,25886,26788,25505,28193,25866,30312,26520,34904,25342 "Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",493.796,489.1498,489.4473 "Neural Magic DeepSparse 1.7 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",231.725,232.1972,231.4969 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",12.1259,12.1228,12.1384 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",6.8992,6.8874,6.8466 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",38.5923,38.9461,38.4941 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",21.0148,21.0701,20.9881 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5.4127,5.4052,5.3594 "Neural Magic DeepSparse 1.7 - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3.2977,3.3257,3.3425 "Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",198331.9055,208338.8507,210130.2834,209457.3906,220804.3507,208297.1633,215202.9153,211450.5625,219583.7801 "Neural Magic DeepSparse 1.7 - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",105856.9695,113366.1615,107529.4254,114647.5304,106869.7832,111522.5886,108452.6821,104501.1989,107262.2673 "Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",38.8784,38.5424,38.8581 "Neural Magic DeepSparse 1.7 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",21.027,21.0667,21.0824 "Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",83.8102,83.8735,83.541 "Neural Magic DeepSparse 1.7 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",42.6381,42.594,42.6591 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",57.8776,57.9457,58.4686 "Neural Magic DeepSparse 1.7 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",30.9291,31.0769,31.0277 "Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",405.8857,395.484,397.1311 "Neural Magic DeepSparse 1.7 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",208.0422,208.1955,206.7811 "Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",25.541,25.5284,25.5996 "Neural Magic DeepSparse 1.7 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",15.4378,15.3956,15.3986 "Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",481.2478,489.2712,485.608 "Neural Magic DeepSparse 1.7 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",230.4787,231.4553,230.5496 "DeepSpeech 0.6 - Acceleration: CPU", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",88.71517,86.91509,86.92493 "R Benchmark - ", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",0.18426501106769,0.18236565716307,0.18738461232023 "RNNoise 0.2 - Input: 26 Minute Long Talking Sample", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ECP-CANDLE 0.4 - Benchmark: P1B2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ECP-CANDLE 0.4 - Benchmark: P3B1", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "ECP-CANDLE 0.4 - Benchmark: P3B2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Numenta Anomaly Benchmark 1.1 - Detector: KNN CAD", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",248.872,242.529,243.862 "Numenta Anomaly Benchmark 1.1 - Detector: Relative Entropy", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",21.366,20.82,19.878,20.993,20.935,20.25,20.198,20.33 "Numenta Anomaly Benchmark 1.1 - Detector: Windowed Gaussian", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",11.715,11.71,11.663 "Numenta Anomaly Benchmark 1.1 - Detector: Earthgecko Skyline", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",212.189,207.574,207.72 "Numenta Anomaly Benchmark 1.1 - Detector: Bayesian Changepoint", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",46.214,48.878,48,49.808,49.051,46.758,46.17,46.891,46.714,46.759,46.96,46.999,48.003 "Numenta Anomaly Benchmark 1.1 - Detector: Contextual Anomaly Detector OSE", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",53.393,52.572,52.614 "Mlpack Benchmark - Benchmark: scikit_ica", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",66.699126243591,63.261912822723,64.216259241104,64.785461187363 "Mlpack Benchmark - Benchmark: scikit_qda", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Mlpack Benchmark - Benchmark: scikit_svm", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",14.454304695129,14.536738634109,14.535684585571 "Mlpack Benchmark - Benchmark: scikit_linearridgeregression", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: GLM", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",609.507,611.829,612.732 "Scikit-Learn 1.2.2 - Benchmark: SAGA", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",727.689,727.766,728.976 "Scikit-Learn 1.2.2 - Benchmark: Tree", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",41.647,39.847,38.444,38.918,40.256,39.214,37.981,39.877,38.215,39.163,40.16,38.647,41.49,41.244,39.811 "Scikit-Learn 1.2.2 - Benchmark: Lasso", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",491.767,494.739,491.516 "Scikit-Learn 1.2.2 - Benchmark: Glmnet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Sparsify", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",75.148,75.349,74.448 "Scikit-Learn 1.2.2 - Benchmark: Plot Ward", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",52.255,52.37,52.031 "Scikit-Learn 1.2.2 - Benchmark: MNIST Dataset", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",64.63,64.553,64.502 "Scikit-Learn 1.2.2 - Benchmark: Plot Neighbors", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",105.136,105.59,105.606 "Scikit-Learn 1.2.2 - Benchmark: SGD Regression", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",120.736,120.308,118.869 "Scikit-Learn 1.2.2 - Benchmark: SGDOneClassSVM", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Plot Lasso Path", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",223.458,226.548,228.228 "Scikit-Learn 1.2.2 - Benchmark: Isolation Forest", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Plot Fast KMeans", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Text Vectorizers", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",51.934,51.963,52.101 "Scikit-Learn 1.2.2 - Benchmark: Plot Hierarchical", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",186.047,187.264,186.352 "Scikit-Learn 1.2.2 - Benchmark: Plot OMP vs. LARS", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",134.609,134.531,134.852 "Scikit-Learn 1.2.2 - Benchmark: Feature Expansions", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",242.315,241.167,240.944 "Scikit-Learn 1.2.2 - Benchmark: LocalOutlierFactor", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",84.032,83.789,83.797 "Scikit-Learn 1.2.2 - Benchmark: TSNE MNIST Dataset", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",323.691,324.913,325.052 "Scikit-Learn 1.2.2 - Benchmark: Isotonic / Logistic", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Plot Incremental PCA", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",44.386,45.317,45.427 "Scikit-Learn 1.2.2 - Benchmark: Hist Gradient Boosting", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",96.752,96.771,96.213 "Scikit-Learn 1.2.2 - Benchmark: Plot Parallel Pairwise", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Isotonic / Pathological", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: RCV1 Logreg Convergencet", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Sample Without Replacement", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",95.391,95.778,95.543 "Scikit-Learn 1.2.2 - Benchmark: Covertype Dataset Benchmark", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",446.863,446.871,446.434 "Scikit-Learn 1.2.2 - Benchmark: Hist Gradient Boosting Adult", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",60.295,60.312,60.034 "Scikit-Learn 1.2.2 - Benchmark: Isotonic / Perturbed Logarithm", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Hist Gradient Boosting Threading", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",334.773,343.153,330.371 "Scikit-Learn 1.2.2 - Benchmark: Plot Singular Value Decomposition", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",199.783,199.864,199.806 "Scikit-Learn 1.2.2 - Benchmark: Hist Gradient Boosting Higgs Boson", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",132.465,137.049,144.411,137.506,135.845,139.754,139.215,143.85,134.261,137.455,140.53,139.719 "Scikit-Learn 1.2.2 - Benchmark: 20 Newsgroups / Logistic Regression", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",49.53,49.553,49.49 "Scikit-Learn 1.2.2 - Benchmark: Plot Polynomial Kernel Approximation", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",234.644,231.144,234.895 "Scikit-Learn 1.2.2 - Benchmark: Plot Non-Negative Matrix Factorization", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "Scikit-Learn 1.2.2 - Benchmark: Hist Gradient Boosting Categorical Only", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",14.778,14.507,14.47 "Scikit-Learn 1.2.2 - Benchmark: Kernel PCA Solvers / Time vs. N Samples", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",277.938,275.995,276.702 "Scikit-Learn 1.2.2 - Benchmark: Kernel PCA Solvers / Time vs. N Components", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",320.171,290.996,380.496,292.957,316.135,320.232,257.706,390.568,305.983 "Scikit-Learn 1.2.2 - Benchmark: Sparse Random Projections / 100 Iterations", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",904.149,904.27,906.827 "Whisper.cpp 1.6.2 - Model: ggml-base.en - Input: 2016 State of the Union", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",246.55592,246.25712,246.05609 "Whisper.cpp 1.6.2 - Model: ggml-small.en - Input: 2016 State of the Union", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",753.46425,754.08075,752.53694 "Whisper.cpp 1.6.2 - Model: ggml-medium.en - Input: 2016 State of the Union", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2287.44125,2275.70375,2278.3635 "XNNPACK 2cd86b - Model: FP32MobileNetV2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5516,5551,5568 "XNNPACK 2cd86b - Model: FP32MobileNetV3Large", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",5528,5432,5492 "XNNPACK 2cd86b - Model: FP32MobileNetV3Small", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1276,1325,1304 "XNNPACK 2cd86b - Model: FP16MobileNetV2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100", "XNNPACK 2cd86b - Model: FP16MobileNetV3Large", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",3476,3357,3355 "XNNPACK 2cd86b - Model: FP16MobileNetV3Small", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",960,959,977 "XNNPACK 2cd86b - Model: QU8MobileNetV2", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",2200,2163,2127 "XNNPACK 2cd86b - Model: QU8MobileNetV3Large", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",1947,1962,2014 "XNNPACK 2cd86b - Model: QU8MobileNetV3Small", Lower Results Are Better "Intel ADL-S GT1 - Intel Core i3-12100",727,729,727