Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403223-NE-28881544411
2888
Intel Xeon E E-2488 testing with a Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS) and llvmpipe on Ubuntu 22.04 via the Phoronix Test Suite.
,,"a","b","c","d"
Processor,,Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads),Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads),Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads),Intel Xeon E E-2488 @ 3.20GHz (8 Cores / 16 Threads)
Motherboard,,Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS),Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS),Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS),Supermicro Super Server X13SCL-F v0123456789 (1.1 BIOS)
Chipset,,Intel Device 7a27,Intel Device 7a27,Intel Device 7a27,Intel Device 7a27
Memory,,2 x 32GB DRAM-4400MT/s Micron MTC20C2085S1EC48BA1,2 x 32GB DRAM-4400MT/s Micron MTC20C2085S1EC48BA1,2 x 32GB DRAM-4400MT/s Micron MTC20C2085S1EC48BA1,2 x 32GB DRAM-4400MT/s Micron MTC20C2085S1EC48BA1
Disk,,960GB Micron_7450_MTFDKBA960TFR + 3201GB Micron_7450_MTFDKCC3T2TFS,960GB Micron_7450_MTFDKBA960TFR + 3201GB Micron_7450_MTFDKCC3T2TFS,960GB Micron_7450_MTFDKBA960TFR + 3201GB Micron_7450_MTFDKCC3T2TFS,960GB Micron_7450_MTFDKBA960TFR + 3201GB Micron_7450_MTFDKCC3T2TFS
Graphics,,llvmpipe,llvmpipe,llvmpipe,llvmpipe
Monitor,,VE228,VE228,VE228,VE228
Network,,2 x Intel I210,2 x Intel I210,2 x Intel I210,2 x Intel I210
OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04
Kernel,,6.2.0-26-generic (x86_64),6.2.0-26-generic (x86_64),6.2.0-26-generic (x86_64),6.2.0-26-generic (x86_64)
Desktop,,GNOME Shell 42.9,GNOME Shell 42.9,GNOME Shell 42.9,GNOME Shell 42.9
Display Server,,X Server 1.21.1.4,X Server 1.21.1.4,X Server 1.21.1.4,X Server 1.21.1.4
OpenGL,,4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits),4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits),4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits),4.5 Mesa 23.0.4-0ubuntu1~22.04.1 (LLVM 15.0.7 256 bits)
Vulkan,,1.3.238,1.3.238,1.3.238,1.3.238
Compiler,,GCC 11.4.0,GCC 11.4.0,GCC 11.4.0,GCC 11.4.0
File-System,,ext4,ext4,ext4,ext4
Screen Resolution,,1920x1080,1920x1080,1920x1080,1920x1080
,,"a","b","c","d"
"Quicksilver - Input: CTS2 (Figure Of Merit)",HIB,12930000,12920000,12900000,12680000
"Quicksilver - Input: CORAL2 P1 (Figure Of Merit)",HIB,13320000,12430000,13410000,13400000
"Quicksilver - Input: CORAL2 P2 (Figure Of Merit)",HIB,19000000,18700000,18460000,18730000
"OpenVINO - Model: Face Detection FP16 - Device: CPU (FPS)",HIB,2.67,2.67,2.66,2.66
"OpenVINO - Model: Person Detection FP16 - Device: CPU (FPS)",HIB,29.03,28.91,29.64,28.96
"OpenVINO - Model: Person Detection FP32 - Device: CPU (FPS)",HIB,29.09,29.74,29.17,28.76
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (FPS)",HIB,242.67,238.98,239.66,239.78
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (FPS)",HIB,10.78,10.71,10.59,10.62
"OpenVINO - Model: Face Detection Retail FP16 - Device: CPU (FPS)",HIB,815.19,816.66,809.39,778.95
"OpenVINO - Model: Road Segmentation ADAS FP16 - Device: CPU (FPS)",HIB,93.39,97.98,91.07,86.33
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (FPS)",HIB,502.11,502.15,499.31,494.26
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (FPS)",HIB,272.34,271.84,275.68,273.91
"OpenVINO - Model: Face Detection Retail FP16-INT8 - Device: CPU (FPS)",HIB,1638.8,1635.4,1626.27,1649.85
"OpenVINO - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU (FPS)",HIB,217.38,213.64,219.22,214.62
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (FPS)",HIB,33.55,33.51,33.72,33.55
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (FPS)",HIB,1036.92,1052.53,1039.07,1047.18
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (FPS)",HIB,384.46,383.87,385.24,384.29
"OpenVINO - Model: Noise Suppression Poconet-Like FP16 - Device: CPU (FPS)",HIB,523.93,528.03,524.06,522.81
"OpenVINO - Model: Handwritten English Recognition FP16 - Device: CPU (FPS)",HIB,154.02,153.23,154.34,154.54
"OpenVINO - Model: Person Re-Identification Retail FP16 - Device: CPU (FPS)",HIB,441.47,440.94,437.87,433.48
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (FPS)",HIB,8604.26,8497.74,8581.04,8570.68
"OpenVINO - Model: Handwritten English Recognition FP16-INT8 - Device: CPU (FPS)",HIB,180.54,181.28,180.48,183.06
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (FPS)",HIB,21993.11,21852.43,21956.68,21874.68
"SVT-AV1 - Encoder Mode: Preset 4 - Input: Bosphorus 4K (FPS)",HIB,4.314,4.296,4.317,4.4
"SVT-AV1 - Encoder Mode: Preset 8 - Input: Bosphorus 4K (FPS)",HIB,35.453,34.857,35.323,35.927
"SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 4K (FPS)",HIB,115.906,115.017,106.976,116.365
"SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 4K (FPS)",HIB,116.362,103.489,116.115,109.271
"SVT-AV1 - Encoder Mode: Preset 4 - Input: Bosphorus 1080p (FPS)",HIB,16.2,15.971,16.227,15.927
"SVT-AV1 - Encoder Mode: Preset 8 - Input: Bosphorus 1080p (FPS)",HIB,134.857,135.94,136.516,120.657
"SVT-AV1 - Encoder Mode: Preset 12 - Input: Bosphorus 1080p (FPS)",HIB,531.292,531.969,534.965,530.366
"SVT-AV1 - Encoder Mode: Preset 13 - Input: Bosphorus 1080p (FPS)",HIB,644.326,642.666,643.945,639.396
"OSPRay - Benchmark: particle_volume/ao/real_time (Items/sec)",HIB,6.005,5.98988,5.9892,5.99903
"OSPRay - Benchmark: particle_volume/scivis/real_time (Items/sec)",HIB,5.96546,5.95732,5.93355,5.96271
"OSPRay - Benchmark: particle_volume/pathtracer/real_time (Items/sec)",HIB,163.101,163.001,162.493,163.088
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/ao/real_time (Items/sec)",HIB,2.78974,2.80995,2.80782,2.82308
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/scivis/real_time (Items/sec)",HIB,2.65458,2.68163,2.70994,2.71491
"OSPRay - Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time (Items/sec)",HIB,3.87077,3.87307,3.86452,3.86617
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,9.1491,8.9375,9.0093,9.064
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,9.2711,9.1535,9.1718,9.2635
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,341.0447,335.6214,334.361,339.1941
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,259.5447,260.9455,260.4541,264.1219
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,110.527,110.1287,109.6515,110.5329
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (items/sec)",HIB,99.5916,99.534,99.5805,99.6773
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,814.3312,817.8716,805.7857,822.157
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,686.1578,687.062,676.4009,683.3508
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,5.0827,5.0978,5.1016,5.0893
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream (items/sec)",HIB,8.0241,8.035,8.0302,8.0335
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,111.257,109.5083,109.0342,110.8552
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,99.5544,99.5487,99.5123,99.6579
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,55.2365,55.3492,54.9206,55.334
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,53.6218,53.9161,53.5893,53.7675
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,79.5563,79.4246,79.7457,79.4885
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,68.6726,68.97,68.8463,68.8904
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,11.2154,11.1867,11.226,11.2304
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,10.6449,10.6742,10.667,10.6192
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,156.1413,151.1466,152.4416,153.7216
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (items/sec)",HIB,102.8021,102.6123,102.383,104.347
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,9.0749,8.9956,9.0183,8.9861
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,9.261,9.1867,9.2712,9.3361
"7-Zip Compression - Test: Compression Rating (MIPS)",HIB,96642,97323,97159,97044
"7-Zip Compression - Test: Decompression Rating (MIPS)",HIB,67998,67818,67661,67622
"Stockfish - Chess Benchmark (Nodes/s)",HIB,17776692,16895156,17408986,17015035
"GROMACS - Implementation: MPI CPU - Input: water_GMX50_bare (Ns/Day)",HIB,1.405,1.406,1.408,1.405
"NAMD - Input: ATPase with 327,506 Atoms (ns/day)",HIB,0.67383,0.67382,0.67334,0.65844
"NAMD - Input: STMV with 1,066,628 Atoms (ns/day)",HIB,0.20897,0.20952,0.20891,0.20937
"RocksDB - Test: Overwrite (Op/s)",HIB,1485724,1468149,1452056,1455423
"RocksDB - Test: Random Fill (Op/s)",HIB,1449625,1468080,1466579,1447290
"RocksDB - Test: Random Read (Op/s)",HIB,56724663,57366733,57492080,56385081
"RocksDB - Test: Update Random (Op/s)",HIB,940801,928889,929396,939218
"RocksDB - Test: Sequential Fill (Op/s)",HIB,2001345,2076954,2042355,2008846
"RocksDB - Test: Random Fill Sync (Op/s)",HIB,206255,205948,206635,206350
"RocksDB - Test: Read While Writing (Op/s)",HIB,2258480,2252397,2374402,2392670
"RocksDB - Test: Read Random Write Random (Op/s)",HIB,2236460,2219780,2202547,2202307
"Speedb - Test: Random Fill (Op/s)",HIB,883180,883375,875583,880777
"Speedb - Test: Random Read (Op/s)",HIB,60086996,60307089,59761930,58376227
"Speedb - Test: Update Random (Op/s)",HIB,741879,736698,743285,734814
"Speedb - Test: Sequential Fill (Op/s)",HIB,1057203,863184,1045594,1064769
"Speedb - Test: Random Fill Sync (Op/s)",HIB,232803,231177,231664,232392
"Speedb - Test: Read While Writing (Op/s)",HIB,2986868,2992041,3165497,3036556
"Speedb - Test: Read Random Write Random (Op/s)",HIB,2449782,2396499,2405977,2421096
"BRL-CAD - VGR Performance Metric (VGR Performance Metric)",HIB,187668,188736,188971,188430
"Chaos Group V-RAY - Mode: CPU (vsamples)",HIB,20309,20474,20359,20326
"oneDNN - Harness: IP Shapes 1D - Engine: CPU (ms)",LIB,2.89586,2.80998,2.9002,2.81256
"oneDNN - Harness: IP Shapes 3D - Engine: CPU (ms)",LIB,7.84533,7.8392,7.84377,7.84734
"oneDNN - Harness: Convolution Batch Shapes Auto - Engine: CPU (ms)",LIB,6.42439,6.42538,6.43553,6.40691
"oneDNN - Harness: Deconvolution Batch shapes_1d - Engine: CPU (ms)",LIB,7.18796,6.44395,6.03052,6.67469
"oneDNN - Harness: Deconvolution Batch shapes_3d - Engine: CPU (ms)",LIB,4.54099,4.53763,4.54541,4.53315
"oneDNN - Harness: Recurrent Neural Network Training - Engine: CPU (ms)",LIB,2817.81,2811.37,2808.2,2814.22
"oneDNN - Harness: Recurrent Neural Network Inference - Engine: CPU (ms)",LIB,1487.64,1485.18,1487.05,1487.19
"OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,9569,9578,9568,9578
"OSPRay Studio - Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,9730,9720,9722,9727
"OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,11351,11328,11328,11327
"OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,155844,156271,156366,156265
"OSPRay Studio - Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,310533,310594,310458,310409
"OSPRay Studio - Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,157835,158659,157963,158320
"OSPRay Studio - Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,315995,314965,315016,315601
"OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,184602,184046,184423,184006
"OSPRay Studio - Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,367733,367376,367235,366681
"OSPRay Studio - Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,2412,2415,2413,2414
"OSPRay Studio - Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,2454,2448,2448,2448
"OSPRay Studio - Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,2858,2860,2857,2858
"OSPRay Studio - Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,40686,40849,40759,40641
"OSPRay Studio - Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,79824,79976,79629,79324
"OSPRay Studio - Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,41235,41382,41560,40969
"OSPRay Studio - Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,80830,80544,80517,80395
"OSPRay Studio - Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,48103,48081,47805,47474
"OSPRay Studio - Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU (ms)",LIB,93632,94309,93566,93543
"OpenVINO - Model: Face Detection FP16 - Device: CPU (ms)",LIB,1500.07,1499.89,1502.74,1501.44
"OpenVINO - Model: Person Detection FP16 - Device: CPU (ms)",LIB,137.78,138.36,134.9,138.1
"OpenVINO - Model: Person Detection FP32 - Device: CPU (ms)",LIB,137.47,134.46,137.07,139.07
"OpenVINO - Model: Vehicle Detection FP16 - Device: CPU (ms)",LIB,16.47,16.73,16.68,16.67
"OpenVINO - Model: Face Detection FP16-INT8 - Device: CPU (ms)",LIB,370.26,372.98,377.2,376.51
"OpenVINO - Model: Face Detection Retail FP16 - Device: CPU (ms)",LIB,9.8,9.79,9.87,10.26
"OpenVINO - Model: Road Segmentation ADAS FP16 - Device: CPU (ms)",LIB,42.81,40.8,43.9,46.3
"OpenVINO - Model: Vehicle Detection FP16-INT8 - Device: CPU (ms)",LIB,15.92,15.92,16.01,16.18
"OpenVINO - Model: Weld Porosity Detection FP16 - Device: CPU (ms)",LIB,29.36,29.42,29,29.19
"OpenVINO - Model: Face Detection Retail FP16-INT8 - Device: CPU (ms)",LIB,4.88,4.89,4.92,4.84
"OpenVINO - Model: Road Segmentation ADAS FP16-INT8 - Device: CPU (ms)",LIB,36.78,37.43,36.47,37.26
"OpenVINO - Model: Machine Translation EN To DE FP16 - Device: CPU (ms)",LIB,119.2,119.34,118.6,119.22
"OpenVINO - Model: Weld Porosity Detection FP16-INT8 - Device: CPU (ms)",LIB,7.71,7.6,7.69,7.63
"OpenVINO - Model: Person Vehicle Bike Detection FP16 - Device: CPU (ms)",LIB,10.39,10.41,10.37,10.4
"OpenVINO - Model: Noise Suppression Poconet-Like FP16 - Device: CPU (ms)",LIB,15.2,15.08,15.2,15.23
"OpenVINO - Model: Handwritten English Recognition FP16 - Device: CPU (ms)",LIB,51.92,52.19,51.81,51.74
"OpenVINO - Model: Person Re-Identification Retail FP16 - Device: CPU (ms)",LIB,18.11,18.13,18.26,18.44
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU (ms)",LIB,0.93,0.94,0.93,0.93
"OpenVINO - Model: Handwritten English Recognition FP16-INT8 - Device: CPU (ms)",LIB,44.3,44.11,44.3,43.68
"OpenVINO - Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU (ms)",LIB,0.36,0.36,0.36,0.36
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,437.1893,447.5375,443.9691,441.2935
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,107.8569,109.2419,109.0246,107.946
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,11.7159,11.9063,11.9504,11.7806
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,3.8485,3.8279,3.8345,3.7815
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,36.1796,36.3099,36.4683,36.1779
"Neural Magic DeepSparse - Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream (ms/batch)",LIB,10.0353,10.0405,10.0368,10.0263
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,4.8981,4.8763,4.9502,4.8511
"Neural Magic DeepSparse - Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,1.4526,1.4499,1.4736,1.458
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,779.3582,777.0222,776.5215,778.3346
"Neural Magic DeepSparse - Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream (ms/batch)",LIB,124.6076,124.4398,124.5136,124.4641
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,35.9425,36.5155,36.6748,36.0728
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,10.0386,10.0398,10.0432,10.0287
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,72.4043,72.2559,72.8207,72.2762
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,18.6441,18.5431,18.6556,18.5938
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,50.2694,50.3532,50.1496,50.3129
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,14.5578,14.4952,14.521,14.5116
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,356.6279,357.5452,356.291,356.1523
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,93.9272,93.6687,93.7321,94.1551
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,25.602,26.4489,26.2237,26.0051
"Neural Magic DeepSparse - Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,9.7178,9.7363,9.7584,9.5744
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,440.7639,444.6478,443.5299,445.1168
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,107.9743,108.8472,107.8541,107.106
"Timed Linux Kernel Compilation - Build: defconfig (sec)",LIB,93.026,93.228,92.622,91.837
"Timed Linux Kernel Compilation - Build: allmodconfig (sec)",LIB,1310.077,1310.863,1308.279,1308.976
"Primesieve - Length: 1e12 (sec)",LIB,20.268,21.056,20.539,19.962
"Primesieve - Length: 1e13 (sec)",LIB,245.051,246.008,242.435,242.189
"Blender - Blend File: BMW27 - Compute: CPU-Only (sec)",LIB,123.28,124.06,123.13,122.49
"Blender - Blend File: Classroom - Compute: CPU-Only (sec)",LIB,336.89,335.93,336.35,336.1
"Blender - Blend File: Fishy Cat - Compute: CPU-Only (sec)",LIB,165.69,166.18,164.96,166.34
"Blender - Blend File: Barbershop - Compute: CPU-Only (sec)",LIB,1295.39,1300.83,1294.93,1294.63
"Blender - Blend File: Pabellon Barcelona - Compute: CPU-Only (sec)",LIB,414.08,413.33,414.52,413.9