2 x AMD EPYC 7773X 64-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2302094-NE-NEWTESTSF98
new tests feb
2 x AMD EPYC 7773X 64-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite.
a:
Processor: 2 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 512GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710
OS: Ubuntu 20.04, Kernel: 6.2.0-rc1-phx (x86_64), Display Server: X Server, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080
b:
Processor: 2 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 512GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710
OS: Ubuntu 20.04, Kernel: 6.2.0-rc1-phx (x86_64), Display Server: X Server, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080
c:
Processor: 2 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 512GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710
OS: Ubuntu 20.04, Kernel: 6.2.0-rc1-phx (x86_64), Display Server: X Server, Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080
PostgreSQL 15
Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency
ms < Lower Is Better
a . 7.168 |====================================
b . 13.329 |===================================================================
c . 13.151 |==================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 500 - Mode: Read Write
TPS > Higher Is Better
a . 69750 |====================================================================
b . 37511 |=====================================
c . 38019 |=====================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 500 - Mode: Read Write
TPS > Higher Is Better
a . 643 |====================================================
b . 866 |======================================================================
c . 621 |==================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 500 - Mode: Read Write - Average Latency
ms < Lower Is Better
a . 778.09 |=================================================================
b . 577.60 |================================================
c . 804.51 |===================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 127.45 |===================================================================
b . 92.17 |================================================
c . 115.67 |=============================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 12.64 |=================================================
b . 17.40 |====================================================================
c . 17.27 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 79.10 |====================================================================
b . 57.45 |=================================================
c . 57.87 |==================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write
TPS > Higher Is Better
a . 31028 |====================================================================
b . 25287 |=======================================================
c . 25872 |=========================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency
ms < Lower Is Better
a . 32.23 |=======================================================
b . 39.55 |====================================================================
c . 38.65 |==================================================================
RocksDB 7.9.2
Test: Random Fill Sync
Op/s > Higher Is Better
a . 248033 |=======================================================
b . 303632 |===================================================================
c . 289690 |================================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 1000 - Mode: Read Write - Average Latency
ms < Lower Is Better
a . 2713.48 |==================================================================
b . 2256.38 |=======================================================
c . 2397.17 |==========================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 1000 - Mode: Read Write
TPS > Higher Is Better
a . 369 |==========================================================
b . 443 |======================================================================
c . 417 |==================================================================
AOM AV1 3.6
Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 108.92 |========================================================
b . 124.02 |================================================================
c . 129.87 |===================================================================
Memcached 1.6.18
Set To Get Ratio: 1:5
Ops/sec > Higher Is Better
a . 1715028.52 |=====================================================
b . 2036178.01 |===============================================================
c . 1920833.99 |===========================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 48.86 |====================================================================
b . 46.79 |=================================================================
c . 41.33 |==========================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency
ms < Lower Is Better
a . 23.62 |==========================================================
b . 27.84 |====================================================================
c . 26.51 |=================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 800 - Mode: Read Write
TPS > Higher Is Better
a . 33875 |====================================================================
b . 28732 |==========================================================
c . 30172 |=============================================================
AOM AV1 3.6
Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 47.22 |==========================================================
b . 53.27 |==================================================================
c . 54.93 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 48.34 |============================================================
b . 50.79 |===============================================================
c . 55.01 |====================================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 800 - Mode: Read Write - Average Latency
ms < Lower Is Better
a . 1962.74 |==================================================================
b . 1822.51 |=============================================================
c . 1733.17 |==========================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 800 - Mode: Read Write
TPS > Higher Is Better
a . 408 |==============================================================
b . 439 |===================================================================
c . 462 |======================================================================
AOM AV1 3.6
Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 115.22 |============================================================
b . 121.56 |===============================================================
c . 128.76 |===================================================================
RocksDB 7.9.2
Test: Update Random
Op/s > Higher Is Better
a . 355548 |===================================================================
b . 322635 |=============================================================
c . 321956 |=============================================================
RocksDB 7.9.2
Test: Read While Writing
Op/s > Higher Is Better
a . 16405765 |===========================================================
b . 17477979 |===============================================================
c . 18106083 |=================================================================
AOM AV1 3.6
Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 131.46 |===============================================================
b . 139.32 |===================================================================
c . 126.75 |=============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 42.08 |====================================================================
b . 38.86 |===============================================================
c . 41.26 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 23.75 |===============================================================
b . 25.71 |====================================================================
c . 24.22 |================================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 800 - Mode: Read Only - Average Latency
ms < Lower Is Better
a . 0.267 |===============================================================
b . 0.282 |===================================================================
c . 0.287 |====================================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 800 - Mode: Read Only
TPS > Higher Is Better
a . 2990818 |==================================================================
b . 2839215 |===============================================================
c . 2784063 |=============================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 1000 - Mode: Read Only
TPS > Higher Is Better
a . 3023662 |==================================================================
b . 2878852 |===============================================================
c . 2840003 |==============================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 1000 - Mode: Read Only - Average Latency
ms < Lower Is Better
a . 0.331 |================================================================
b . 0.347 |===================================================================
c . 0.352 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 51.50 |================================================================
b . 54.31 |====================================================================
c . 51.09 |================================================================
Embree 4.0
Binary: Pathtracer ISPC - Model: Asian Dragon
Frames Per Second > Higher Is Better
a . 99.74 |====================================================================
b . 93.92 |================================================================
c . 95.44 |=================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 1000 - Mode: Read Only
TPS > Higher Is Better
a . 3077262 |==================================================================
b . 2980639 |================================================================
c . 2903654 |==============================================================
AOM AV1 3.6
Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 20.73 |====================================================================
b . 19.57 |================================================================
c . 20.20 |==================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency
ms < Lower Is Better
a . 0.325 |================================================================
b . 0.335 |==================================================================
c . 0.344 |====================================================================
Memcached 1.6.18
Set To Get Ratio: 1:10
Ops/sec > Higher Is Better
a . 3329591.88 |===============================================================
b . 3250297.65 |=============================================================
c . 3154402.40 |============================================================
AOM AV1 3.6
Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 10.38 |=================================================================
b . 10.94 |====================================================================
c . 10.67 |==================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency
ms < Lower Is Better
a . 0.173 |===================================================================
b . 0.167 |=================================================================
c . 0.176 |====================================================================
Embree 4.0
Binary: Pathtracer - Model: Asian Dragon Obj
Frames Per Second > Higher Is Better
a . 86.46 |====================================================================
b . 82.97 |=================================================================
c . 82.09 |=================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 500 - Mode: Read Only
TPS > Higher Is Better
a . 2882020 |================================================================
b . 2993559 |==================================================================
c . 2842685 |===============================================================
RocksDB 7.9.2
Test: Read Random Write Random
Op/s > Higher Is Better
a . 1930699 |===============================================================
b . 1986053 |=================================================================
c . 2026415 |==================================================================
Embree 4.0
Binary: Pathtracer ISPC - Model: Asian Dragon Obj
Frames Per Second > Higher Is Better
a . 85.10 |===================================================================
b . 83.05 |=================================================================
c . 86.95 |====================================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 500 - Mode: Read Only
TPS > Higher Is Better
a . 2922544 |==================================================================
b . 2907436 |==================================================================
c . 2806211 |===============================================================
PostgreSQL 15
Scaling Factor: 1 - Clients: 500 - Mode: Read Only - Average Latency
ms < Lower Is Better
a . 0.171 |=================================================================
b . 0.172 |==================================================================
c . 0.178 |====================================================================
Embree 4.0
Binary: Pathtracer - Model: Asian Dragon
Frames Per Second > Higher Is Better
a . 99.23 |====================================================================
b . 95.68 |==================================================================
c . 95.80 |==================================================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, First Run / Cold Cache
Queries Per Minute, Geo Mean > Higher Is Better
a . 400.63 |=================================================================
b . 414.74 |===================================================================
c . 414.77 |===================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 18.56 |==================================================================
b . 19.15 |====================================================================
c . 18.66 |==================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency
ms < Lower Is Better
a . 0.270 |===================================================================
b . 0.268 |==================================================================
c . 0.276 |====================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 800 - Mode: Read Only
TPS > Higher Is Better
a . 2966831 |==================================================================
b . 2985790 |==================================================================
c . 2900704 |================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 112.29 |===================================================================
b . 109.98 |==================================================================
c . 109.10 |=================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 8.9018 |=================================================================
b . 9.0882 |==================================================================
c . 9.1614 |===================================================================
AOM AV1 3.6
Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 52.06 |==================================================================
b . 52.81 |===================================================================
c . 53.52 |====================================================================
Memcached 1.6.18
Set To Get Ratio: 1:100
Ops/sec > Higher Is Better
a . 2544101.48 |==============================================================
b . 2589721.87 |===============================================================
c . 2525635.19 |=============================================================
AOM AV1 3.6
Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 0.42 |===================================================================
b . 0.42 |===================================================================
c . 0.43 |=====================================================================
VVenC 1.7
Video Input: Bosphorus 4K - Video Preset: Faster
Frames Per Second > Higher Is Better
a . 7.785 |===================================================================
b . 7.936 |====================================================================
c . 7.950 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 48.70 |====================================================================
b . 48.69 |====================================================================
c . 47.84 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 20.53 |===================================================================
b . 20.53 |===================================================================
c . 20.90 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 152.73 |===================================================================
b . 150.46 |==================================================================
c . 150.20 |==================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 6.5448 |==================================================================
b . 6.6434 |===================================================================
c . 6.6553 |===================================================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, Second Run
Queries Per Minute, Geo Mean > Higher Is Better
a . 409.80 |==================================================================
b . 416.27 |===================================================================
c . 414.21 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 20.78 |====================================================================
b . 20.48 |===================================================================
c . 20.75 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 48.10 |===================================================================
b . 48.82 |====================================================================
c . 48.17 |===================================================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, Third Run
Queries Per Minute, Geo Mean > Higher Is Better
a . 410.46 |==================================================================
b . 413.96 |===================================================================
c . 415.86 |===================================================================
VVenC 1.7
Video Input: Bosphorus 4K - Video Preset: Fast
Frames Per Second > Higher Is Better
a . 4.171 |===================================================================
b . 4.216 |====================================================================
c . 4.217 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 308.82 |===================================================================
b . 307.04 |===================================================================
c . 305.86 |==================================================================
AOM AV1 3.6
Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 1.18 |=====================================================================
b . 1.17 |====================================================================
c . 1.17 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 206.49 |==================================================================
b . 207.90 |===================================================================
c . 208.22 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 919.74 |===================================================================
b . 915.49 |===================================================================
c . 921.90 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 69.48 |====================================================================
b . 69.76 |====================================================================
c . 69.29 |====================================================================
VVenC 1.7
Video Input: Bosphorus 1080p - Video Preset: Faster
Frames Per Second > Higher Is Better
a . 19.48 |====================================================================
b . 19.40 |====================================================================
c . 19.53 |====================================================================
RocksDB 7.9.2
Test: Sequential Fill
Op/s > Higher Is Better
a . 312683 |===================================================================
b . 311113 |===================================================================
c . 313140 |===================================================================
RocksDB 7.9.2
Test: Random Fill
Op/s > Higher Is Better
a . 324824 |===================================================================
b . 326914 |===================================================================
c . 325125 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 28.99 |====================================================================
b . 28.81 |====================================================================
c . 28.87 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 34.47 |====================================================================
b . 34.68 |====================================================================
c . 34.61 |====================================================================
RocksDB 7.9.2
Test: Random Read
Op/s > Higher Is Better
a . 490161595 |================================================================
b . 489362655 |================================================================
c . 487197889 |================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 157.69 |===================================================================
b . 158.30 |===================================================================
c . 158.55 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 148.03 |===================================================================
b . 147.88 |===================================================================
c . 147.28 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 6.7527 |===================================================================
b . 6.7592 |===================================================================
c . 6.7869 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 72.93 |====================================================================
b . 73.04 |====================================================================
c . 73.27 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 77.12 |====================================================================
b . 77.47 |====================================================================
c . 77.17 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 828.71 |===================================================================
b . 825.01 |===================================================================
c . 827.97 |===================================================================
Embree 4.0
Binary: Pathtracer ISPC - Model: Crown
Frames Per Second > Higher Is Better
a . 122.29 |===================================================================
b . 122.73 |===================================================================
c . 122.83 |===================================================================
VVenC 1.7
Video Input: Bosphorus 1080p - Video Preset: Fast
Frames Per Second > Higher Is Better
a . 9.199 |====================================================================
b . 9.189 |====================================================================
c . 9.159 |====================================================================
Embree 4.0
Binary: Pathtracer - Model: Crown
Frames Per Second > Higher Is Better
a . 130.99 |===================================================================
b . 130.46 |===================================================================
c . 130.49 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 309.82 |===================================================================
b . 309.05 |===================================================================
c . 310.17 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 404.30 |===================================================================
b . 403.16 |===================================================================
c . 402.86 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 108.44 |===================================================================
b . 108.65 |===================================================================
c . 108.26 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 104.47 |===================================================================
b . 104.48 |===================================================================
c . 104.79 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 611.20 |===================================================================
b . 611.21 |===================================================================
c . 609.45 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 866.60 |===================================================================
b . 867.57 |===================================================================
c . 868.83 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 73.27 |====================================================================
b . 73.09 |====================================================================
c . 73.19 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 206.10 |===================================================================
b . 206.28 |===================================================================
c . 205.81 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 586.64 |===================================================================
b . 585.82 |===================================================================
c . 586.36 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 57.68 |====================================================================
b . 57.67 |====================================================================
c . 57.62 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 17.33 |====================================================================
b . 17.33 |====================================================================
c . 17.35 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 867.52 |===================================================================
b . 867.21 |===================================================================
c . 867.26 |===================================================================
PostgreSQL 15
Scaling Factor: 100 - Clients: 5000 - Mode: Read Write
TPS > Higher Is Better
PostgreSQL 15
Scaling Factor: 100 - Clients: 5000 - Mode: Read Only
TPS > Higher Is Better
PostgreSQL 15
Scaling Factor: 1 - Clients: 5000 - Mode: Read Write
TPS > Higher Is Better
PostgreSQL 15
Scaling Factor: 1 - Clients: 5000 - Mode: Read Only
TPS > Higher Is Better