a

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312143-NE-A8154652071
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
Fortran Tests 2 Tests
HPC - High Performance Computing 3 Tests
LAPACK (Linear Algebra Pack) Tests 2 Tests
OpenMPI Tests 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 12 2023
  6 Hours, 14 Minutes
b
December 12 2023
  6 Hours, 8 Minutes
c
December 12 2023
  5 Hours, 57 Minutes
d
December 13 2023
  6 Hours, 19 Minutes
Invert Hiding All Results Option
  6 Hours, 9 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

a, "WRF 4.2.2 - Input: conus 2.5km", Lower Results Are Better "a", "b", "c", "d", "Neural Magic DeepSparse 1.6 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",133.6595,133.6736,133.2146 "b",133.7771,133.4772,133.9025 "c",133.6947,133.5856,133.1726 "d",133.0396,132.8115,133.1725 "Neural Magic DeepSparse 1.6 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",474.9468,475.2392,476.9033 "b",473.52,475.089,473.9466 "c",474.643,476.179,476.2193 "d",478.4754,477.2985,477.0586 "Neural Magic DeepSparse 1.6 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",31.8472,30.2515,30.894,31.7852 "b",31.3707,32.0972,29.8946,32.6973,30.9873,31.9093,31.166,28.8775,30.2327,32.1206,31.0725,31.6181,32.014,31.1161,31.3308 "c",30.4899,32.5252,32.4543,32.7597,33.6976,31.0034,31.917,33.2243,30.5873,29.2714,31.1215,30.7792,32.6914,31.295,30.6328 "d",30.3236,32.1274,33.58,32.4507,34.0501,32.0077,32.72,32.828,33.7721,32.2101,33.9453,33.927,32.6912,32.7823,33.9879 "Neural Magic DeepSparse 1.6 - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",31.3898,33.0459,32.3582,31.4513 "b",31.8669,31.1452,33.4404,30.5761,32.2612,31.3285,32.0757,34.6185,33.0665,31.1226,32.1724,31.6177,31.2262,32.1273,31.9067 "c",32.787,30.7343,30.8027,30.5151,29.6655,32.2432,31.3214,30.0883,32.6832,34.1521,32.1216,32.4799,30.5791,31.9435,32.6343 "d",32.9703,31.1186,29.7721,30.809,29.3613,31.235,30.5554,30.4543,29.6029,31.039,29.4518,29.4679,30.5825,30.4971,29.4153 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",4357.4994,4610.3423,4599.6768,4604.2749,4603.1047 "b",4321.4761,4607.5537,4610.7986,4605.068,4602.3802,4593.9571,4603.3343 "c",4345.5583,4602.3938,4611.704,4608.0241,4603.8211,4609.0652 "d",4341.9707,4598.7616,4599.8551,4604.0869,4593.4773,4597.9883 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",14.663,13.858,13.8944,13.8813,13.8844 "b",14.7861,13.8668,13.8611,13.8717,13.8796,13.912,13.8793 "c",14.706,13.8861,13.8544,13.8597,13.8815,13.8664 "d",14.7164,13.8964,13.8886,13.8813,13.9067,13.8997 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",247.1122,215.0505,254.2377,244.182,228.5318,226.0527,239.1098,206.9638,255.0872,273.319,239.1293,246.9419,256.4332,222.1426,225.4905 "b",234.751,213.8861,226.9108,234.308,231.0838,262.1637,259.5422,221.8357,230.6845,221.773,237.1055,235.9948,258.139,233.9364,253.5748 "c",218.0167,240.9266,234.2411,221.1254,266.622,214.1045,222.4442,235.6638,230.9559,243.4782,218.4119,231.875,239.9474,211.3077,232.3397 "d",237.1523,237.0007,246.5478 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",4.043,4.6458,3.9294,4.091,4.3718,4.4198,4.1779,4.8276,3.9163,3.6551,4.1773,4.0455,3.8956,4.4978,4.4305 "b",4.2554,4.6709,4.4031,4.264,4.3233,3.8109,3.8488,4.5042,4.3309,4.5043,4.2135,4.2333,3.8701,4.2708,3.9391 "c",4.5813,4.1469,4.2652,4.5179,3.7469,4.6649,4.4919,4.2396,4.3256,4.103,4.573,4.3072,4.1638,4.7268,4.2996 "d",4.2131,4.2158,4.0524 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",1820.5863,1832.4885,1836.8183 "b",1799.4085,1844.2437,1829.4755 "c",1792.3079,1842.4119,1849.2142 "d",1808.6834,1856.5968,1847.2128 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",35.071,34.8904,34.7892 "b",35.4894,34.6257,34.9037 "c",35.6593,34.6765,34.5691 "d",35.3171,34.3803,34.5727 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",316.8615,341.9029,342.3561,341.7913,341.8,341.9265,341.1323,341.2117,341.6239 "b",320.5092,340.6329,341.5133,341.3873,341.9162,340.1202 "c",310.4306,340.1378,340.9024,341.5935,341.1331,340.9396,340.7893,341.186,341.6628,341.3805,340.4317,342.0555 "d",305.8077,341.1861,341.1267,340.6595,339.7263,341.2406,341.3887,341.6012,341.2884,340.9519,341.7107,341.0709 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",3.1533,2.9221,2.9181,2.9231,2.9229,2.9218,2.9288,2.928,2.9244 "b",3.1174,2.933,2.9254,2.9264,2.922,2.9371 "c",3.2186,2.9371,2.9307,2.9247,2.9289,2.9303,2.9316,2.9281,2.9237,2.9265,2.9349,2.9209 "d",3.2673,2.9283,2.9286,2.9328,2.9409,2.9278,2.9265,2.9246,2.9275,2.9303,2.9235,2.9292 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",10373.454,11293.1136,11238.6831,11328.5566,11282.0282,11268.1594,11322.0822,11347.0441,11284.4553,11326.0166,11309.4652,11328.1787,11271.3751 "b",10456.0678,11267.2631,11272.3898,11227.7613,11270.5039,11206.1842,11295.2873,11297.335,11235.8732 "c",10557.0594,11245.6577,11278.6913,11250.5207,11274.6759,11300.6012,11238.4092 "d",10373.2947,11319.9045,11327.2489,11293.2756,11301.3221,11315.3555,11330.7587,11282.0149,11260.841,11270.4357,11273.9888,11305.1882 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",6.1539,5.648,5.6771,5.6324,5.6564,5.6641,5.636,5.6213,5.6548,5.6287,5.6427,5.6333,5.6594 "b",6.0994,5.6605,5.6611,5.6808,5.6628,5.6911,5.646,5.6481,5.6763 "c",6.0422,5.6722,5.6578,5.6704,5.656,5.646,5.6706 "d",6.1565,5.6397,5.6355,5.651,5.6443,5.6426,5.6316,5.6544,5.667,5.6628,5.6595,5.6448 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",1032.409,998.504,1048.8468,1041.5125 "b",1008.5916,1037.5945,1036.349 "c",1032.9929,1051.1167,1045.7315 "d",977.2585,1044.0829,1037.2108,1047.7821,1036.9852,1053.2175,1029.15 "Neural Magic DeepSparse 1.6 - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",0.9659,0.9982,0.9508,0.9573 "b",0.9885,0.9608,0.9625 "c",0.9648,0.9484,0.9536 "d",1.0203,0.9553,0.9613,0.9518,0.9618,0.947,0.9692 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",813.0134,835.4567,835.6451 "b",815.9332,834.3717,835.6548 "c",814.8581,834.3928,836.0877 "d",806.6484,833.9459,834.6579 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",78.5749,76.4571,76.4953 "b",78.3593,76.465,76.4529 "c",78.4093,76.5143,76.447 "d",79.1885,76.6269,76.5566 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",176.6469,191.7589,192.3955,191.4809,191.7701,191.8345,192.221,192.1125,192.7137,192.4571,192.2437,192.4697 "b",171.1174,191.8549,191.2017,191.9281,191.3976,192.2624,192.197,191.5308,190.4391,192.1979,192.2769,192.075 "c",179.7137,191.8092,192.0055,191.5137,190.9038,191.0946,191.6823 "d",173.4204,191.8932,191.8242,191.9579,191.6576,192.0141,191.6093,191.3315,191.1465,191.7698,191.2743,191.7528 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",5.6568,5.2096,5.1933,5.2176,5.2102,5.2083,5.198,5.2008,5.1848,5.1917,5.1967,5.1909 "b",5.8386,5.2068,5.2247,5.2047,5.2184,5.1964,5.1975,5.2142,5.2443,5.198,5.1955,5.201 "c",5.5593,5.2082,5.2018,5.2163,5.2318,5.2268,5.2116 "d",5.7615,5.2071,5.2089,5.2051,5.213,5.2036,5.2143,5.2225,5.2272,5.2096,5.2233,5.2109 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",154.9522,155.9839,157.2327 "b",154.8548,155.2836,157.0281 "c",157.9388,155.5166,153.8477 "d",157.7619,154.8618,154.1822 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",410.1384,407.1606,404.5341 "b",410.5646,410.5139,404.8003 "c",404.3799,409.3272,413.2027 "d",404.1508,409.3959,410.9448 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",29.6659,30.6102,28.6284,30.3957,29.972,30.3804 "b",30.6768,29.8482,30.6422 "c",30.4969,30.3811,30.0051 "d",29.3382,29.6936,29.5374 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",33.6962,32.656,34.9198,32.8868,33.3512,32.9033 "b",32.5852,33.4897,32.6219 "c",32.7775,32.9032,33.3146 "d",34.0759,33.6683,33.8462 "Neural Magic DeepSparse 1.6 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",1787.4358,1851.4177,1859.5245 "b",1810.0175,1810.5611,1833.4031 "c",1824.3138,1843.6695,1835.4481 "d",1779.1521,1850.7045,1829.2017 "Neural Magic DeepSparse 1.6 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",35.7191,34.5125,34.3728 "b",35.2613,35.307,34.8586 "c",35.0289,34.6502,34.7861 "d",35.8547,34.5314,34.9179 "Neural Magic DeepSparse 1.6 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",315.1498,342.0493,341.6824,341.591,342.1381,341.8448,341.3646,340.6203,342.1162,341.8591 "b",316.3556,342.0869,341.0511,341.0736,341.8074,342.2399,341.909,341.7272,341.4737 "c",321.714,341.6275,341.7621,341.5263,341.2146,341.4706 "d",315.0563,342.5452,341.7037,342.2956,342.4853,341.7894,341.884,342.2871,337.9417,341.7071,341.339,341.3703 "Neural Magic DeepSparse 1.6 - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",3.1703,2.9207,2.9235,2.9248,2.9201,2.9221,2.9267,2.9333,2.9204,2.9224 "b",3.1581,2.9206,2.9295,2.9292,2.9225,2.9191,2.922,2.9237,2.9257 "c",3.1057,2.9247,2.9233,2.9256,2.9281,2.9257 "d",3.1713,2.9168,2.9238,2.9186,2.9172,2.9233,2.9223,2.9186,2.9565,2.9237,2.927,2.9268 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",836.6643,863.0648,862.4285 "b",832.4918,861.8568,864.488 "c",836.1914,865.1859,861.379 "d",829.0002,860.9194,862.7583 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",76.356,74.0452,74.0518 "b",76.7727,74.1043,73.9534 "c",76.3952,73.8888,74.0995 "d",77.0261,74.2009,74.0273 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",179.2731,195.6501,195.8926,195.7438,195.552,194.9721,195.9452,195.805,195.1997,195.2729,195.6915,195.9736 "b",175.3309,193.8461,195.2884,195.3991,195.0782,195.0386,195.5583,195.3557,195.2752,195.4232,195.1021,195.4219,194.6458 "c",174.4458,194.5043,194.2285,195.0036,195.1995,195.2774,193.9365,195.2189,194.6353,195.54,194.3527,194.7037 "d",176.0218,195.0575,195.6663,195.7453,195.1989,195.7557,195.1618,195.6518,195.6142,194.8673,195.5274,195.5552 "Neural Magic DeepSparse 1.6 - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",5.5753,5.1083,5.1025,5.1063,5.1114,5.1259,5.1011,5.1047,5.1202,5.1187,5.1077,5.1002 "b",5.6987,5.1543,5.1166,5.114,5.1216,5.124,5.1103,5.116,5.1174,5.1142,5.1223,5.1138,5.1333 "c",5.7288,5.1375,5.1452,5.1242,5.1184,5.1177,5.1525,5.1194,5.1332,5.111,5.1419,5.1321 "d",5.6789,5.1229,5.1084,5.1064,5.1207,5.1059,5.1214,5.1089,5.11,5.1293,5.1121,5.1115 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",1201.5498,1246.1218,1245.9432 "b",1187.6224,1243.7879,1244.8813,1248.8838 "c",1203.457,1245.6208,1244.7431 "d",1192.045,1243.6877,1244.6554 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",53.1828,51.3151,51.2924 "b",53.7298,51.3999,51.3822,51.1974 "c",53.151,51.2934,51.3132 "d",53.4765,51.3966,51.3386 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",183.9534,202.6665,199.9283,201.5137,200.2115,200.3289,202.0127,201.0265,200.9837,201.2582,202.037,200.3956 "b",176.9235,202.1015,201.9992,201.4661,199.8189,201.6464,201.8341,200.4302,200.6179,202.2941,201.7619,201.1617 "c",180.1162,200.781,201.0036,201.3284,200.2923,201.9198,202.0225,202.2485,200.4568,200.4486,201.2396,200.1305 "d",185.4607,200.1535,200.1346,199.5515,196.7592,197.4654,197.9639,196.8101 "Neural Magic DeepSparse 1.6 - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",5.432,4.9303,4.9984,4.9592,4.9918,4.9886,4.9467,4.9706,4.9724,4.965,4.9461,4.9865 "b",5.6473,4.9451,4.9472,4.96,5.0009,4.956,4.9516,4.9861,4.981,4.9401,4.9524,4.9674 "c",5.5473,4.9775,4.9713,4.9639,4.989,4.9492,4.9465,4.9411,4.9849,4.9851,4.9661,4.993 "d",5.3885,4.9928,4.9933,5.0069,5.079,5.0608,5.0478,5.0774 "Neural Magic DeepSparse 1.6 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",175.9713,182.5358,187.4464,186.8141,186.4829,177.5071,185.274,185.9413 "b",176.2035,181.7552,182.9883 "c",173.8582,177.395,180.2003 "d",173.2914,179.724,186.5523,183.7023,178.2535,177.9201,186.3554,184.5251,180.502 "Neural Magic DeepSparse 1.6 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",362.2428,348.9792,340.7597,341.245,342.4433,359.254,343.5883,342.7969 "b",361.9694,350.6956,348.4017 "c",366.292,359.0337,354.35 "d",367.9889,355.0747,342.2756,347.428,356.7305,358.4748,341.9911,346.1813,353.867 "Neural Magic DeepSparse 1.6 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",32.9913,35.1702,35.2466,35.2726,35.434,35.292,35.3274 "b",33.4508,35.5831,35.8259,35.2383,35.1961,35.3446 "c",33.2785,35.173,35.4447,35.4197,35.3614,35.3569 "d",32.4406,35.2398,35.2558,35.237,35.1573,35.2201,35.1414,35.1432,35.3213,35.346,35.3308,35.1514 "Neural Magic DeepSparse 1.6 - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",30.2785,28.4017,28.3429,28.3157,28.1924,28.3032,28.2785 "b",29.8644,28.0762,27.8881,28.3487,28.3819,28.2612 "c",30.0188,28.3994,28.1815,28.207,28.2521,28.2536 "d",30.7965,28.3469,28.3343,28.3524,28.4101,28.3624,28.428,28.4257,28.2845,28.2657,28.2754,28.4209 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",1837.9389,1903.0462,1901.3212 "b",1823.0091,1903.8267,1900.8746 "c",1837.4874,1899.5448,1902.4842 "d",1821.9945,1888.4571,1884.6062 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",34.7369,33.5901,33.6155 "b",35.0459,33.5719,33.6266 "c",34.7528,33.6493,33.5796 "d",35.0481,33.8251,33.8793 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",96.598,96.473,96.2191 "b",96.2157,96.9648,95.9566 "c",96.8731,96.3813,96.3878 "d",89.3131,96.2508,96.4496,96.2081,97.0011,96.5321,95.9353,97.2218,96.2112,95.8581 "Neural Magic DeepSparse 1.6 - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",10.3454,10.3584,10.3863 "b",10.3861,10.3072,10.4153 "c",10.3157,10.3687,10.3676 "d",11.1915,10.384,10.3633,10.3891,10.3038,10.3542,10.4184,10.2806,10.3889,10.4269 "Neural Magic DeepSparse 1.6 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Higher Results Are Better "a",133.5525,133.4063,133.8482 "b",134.0649,133.5901,133.8166 "c",133.2327,133.7219,133.8467 "d",133.1461,133.6005,134.044 "Neural Magic DeepSparse 1.6 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", Lower Results Are Better "a",475.0196,475.7241,474.6357 "b",473.8209,475.119,474.1661 "c",476.3634,475.2184,474.4674 "d",476.8354,475.242,474.2618 "Neural Magic DeepSparse 1.6 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", Higher Results Are Better "a",30.8556,32.2087,33.0027,33.1959,30.9969,33.6852,30.2742,32.3851,31.6883,30.9071,30.8555,29.4269,32.517,32.4291,31.003 "b",32.5288,31.6948,30.4177,30.0211,32.009,30.7478,33.3138,31.2329,30.8637,31.1773,32.5695,32.4353,32.0207,31.8474,30.1185 "c",32.0144,30.8099,30.2491,34.0548,31.5597,32.6175,32.4551,30.2121,30.5286,32.455,33.9502,31.3187,32.2261,29.9712,31.3799 "d",29.8406,31.885,33.5154,34.1075,32.7068,32.3423,34.1039,34.0355,34.1847,31.4322,32.5208,33.8164,33.7225,33.4689,34.1269 "Neural Magic DeepSparse 1.6 - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", Lower Results Are Better "a",32.3994,31.0389,30.2903,30.1141,32.2509,29.6763,33.0212,30.8678,31.5464,32.3441,32.3984,33.9717,30.7423,30.8261,32.2443 "b",30.7312,31.5402,32.8647,33.299,31.2294,32.5119,30.0074,32.0073,32.39,32.0639,30.693,30.8209,31.2192,31.3886,33.1878 "c",31.2247,32.4467,33.0479,29.3541,31.6751,30.6478,30.8014,33.0884,32.7442,30.8012,29.4447,31.9189,31.0206,33.3546,31.8573 "d",33.5046,31.3536,29.8296,29.3114,30.5675,30.9123,29.3147,29.3739,29.2457,31.8071,30.7409,29.5641,29.6452,29.871,29.295 "NWChem 7.0.2 - Input: C240 Buckyball", Lower Results Are Better "a", "b", "c", "d",