deepsparse new, "Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",6.1311,6.1968,6.1465 "Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",652.3888,645.3203,650.5513 "Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",5.804,5.8032,6.0556 "Neural Magic DeepSparse 1.3.2 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",172.2873,172.3093,165.1277 "Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",71.1952,71.1899,71.5753 "Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",56.1676,56.1724,55.8699 "Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",57.8126,57.7136,58.4148 "Neural Magic DeepSparse 1.3.2 - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",17.2887,17.319,17.1112 "Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",19.1335,19.5081,19.2776 "Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",208.9476,204.9781,207.133 "Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",18.5454,18.4789,18.5229 "Neural Magic DeepSparse 1.3.2 - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",53.9115,54.1057,53.9769 "Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",31.5813,31.7765,31.583 "Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",126.6041,125.8239,126.4833 "Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",29.0197,28.9248,29.061 "Neural Magic DeepSparse 1.3.2 - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",34.4475,34.5598,34.3976 "Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",75.9245,75.1918,75.4572 "Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",52.6423,53.147,52.9745 "Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",72.0201,68.7434,71.2074 "Neural Magic DeepSparse 1.3.2 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",13.8743,14.5359,14.0335 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",54.7916,55.0115,55.2275 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",72.991,72.6991,72.3919 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",47.247,47.4619,47.2434 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",21.1591,21.0632,21.1604 "Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",8.4163,8.5003,8.4783 "Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",475.2466,470.5511,471.7703 "Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",8.3359,8.0869,8.1888 "Neural Magic DeepSparse 1.3.2 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",119.9491,123.6433,122.1032 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",28.141,28.1394,28.1436 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",142.0285,142.1319,142.1093 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",23.8542,23.9104,23.8237 "Neural Magic DeepSparse 1.3.2 - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",41.9141,41.8161,41.9674 "Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a", "b", "c",6.2055,6.2281,6.152 "Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a", "b", "c",644.5481,642.0937,650.1786 "Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a", "b", "c",6.026,5.7764,5.838 "Neural Magic DeepSparse 1.3.2 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a", "b", "c",165.9408,173.1103,171.2838