new tests thurs AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.10 via the Phoronix Test Suite. A: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc7daily20220927-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.48), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc7daily20220927-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.48), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc7daily20220927-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.48), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 3840x2160 D: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc7daily20220927-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.48), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 3840x2160 Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 33.89 |==================================================================== B . 33.78 |==================================================================== D . 33.93 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 934.23 |================================================================== B . 944.46 |=================================================================== D . 932.58 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 12.61 |================================================================= B . 12.94 |=================================================================== D . 13.19 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 79.28 |==================================================================== B . 77.26 |================================================================== D . 75.83 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 89.16 |==================================================================== B . 89.50 |==================================================================== D . 89.26 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 358.23 |=================================================================== B . 356.48 |=================================================================== D . 357.07 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 19.60 |================================================================ B . 20.91 |==================================================================== D . 20.92 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 51.02 |==================================================================== B . 47.80 |================================================================ D . 47.78 |================================================================ Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 181.96 |=================================================================== B . 182.84 |=================================================================== D . 183.12 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 175.42 |=================================================================== B . 174.61 |=================================================================== D . 174.25 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 75.13 |==================================================================== B . 75.55 |==================================================================== D . 75.53 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 13.30 |==================================================================== B . 13.22 |==================================================================== D . 13.23 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 403.39 |=================================================================== B . 405.27 |=================================================================== D . 403.54 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 79.24 |==================================================================== B . 78.92 |==================================================================== D . 79.26 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 94.89 |=================================================================== B . 95.75 |==================================================================== D . 94.88 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 10.53 |==================================================================== B . 10.44 |=================================================================== D . 10.53 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 277.21 |================================================================== B . 280.13 |=================================================================== D . 279.34 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 115.38 |=================================================================== B . 114.18 |================================================================== D . 114.44 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 54.31 |============================================================== B . 59.26 |==================================================================== D . 56.72 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 18.41 |==================================================================== B . 16.87 |============================================================== D . 17.62 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 141.18 |================================================================== B . 142.23 |=================================================================== D . 142.46 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 226.60 |=================================================================== B . 224.92 |=================================================================== D . 224.56 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 28.70 |==================================================================== B . 28.81 |==================================================================== D . 28.91 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 34.83 |==================================================================== B . 34.71 |==================================================================== D . 34.58 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 33.38 |==================================================================== B . 33.28 |==================================================================== D . 33.50 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 949.92 |=================================================================== B . 953.58 |=================================================================== D . 942.28 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 12.57 |=================================================================== B . 12.79 |==================================================================== D . 12.83 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 79.52 |==================================================================== B . 78.20 |=================================================================== D . 77.93 |=================================================================== OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 88.66 |==================================================================== B . 87.88 |=================================================================== C . 86.18 |================================================================== D . 87.65 |=================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 42.32 |==================================================================== B . 41.87 |=================================================================== C . 41.51 |=================================================================== D . 42.27 |==================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 167.69 |=================================================================== B . 164.22 |================================================================== C . 164.62 |================================================================== D . 164.07 |================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 87.30 |==================================================================== B . 82.55 |================================================================ C . 82.32 |================================================================ D . 82.27 |================================================================ OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 214.32 |=================================================================== B . 209.60 |================================================================== C . 209.81 |================================================================== D . 212.82 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 32547 |==================================================================== B . 32725 |==================================================================== C . 32159 |=================================================================== D . 32367 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.031 |==================================================================== B . 0.031 |==================================================================== C . 0.031 |==================================================================== D . 0.031 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 650 |====================================================================== B . 640 |===================================================================== C . 643 |===================================================================== D . 644 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 1.540 |=================================================================== B . 1.563 |==================================================================== C . 1.556 |==================================================================== D . 1.552 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 961257 |================================================================= B . 982883 |=================================================================== C . 966860 |================================================================== D . 987859 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.052 |==================================================================== B . 0.051 |=================================================================== C . 0.052 |==================================================================== D . 0.051 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 1017617 |================================================================= B . 1025342 |================================================================== C . 1025806 |================================================================== D . 1027438 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.098 |==================================================================== B . 0.098 |==================================================================== C . 0.097 |=================================================================== D . 0.097 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 1259536 |================================================================= B . 1268598 |================================================================= C . 1269797 |================================================================= D . 1282061 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.198 |==================================================================== B . 0.197 |==================================================================== C . 0.197 |==================================================================== D . 0.195 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 681 |===================================================================== B . 686 |===================================================================== C . 687 |===================================================================== D . 692 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 73.46 |==================================================================== B . 72.86 |=================================================================== C . 72.83 |=================================================================== D . 72.29 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Only TPS > Higher Is Better A . 1275010 |================================================================= B . 1275503 |================================================================= C . 1278890 |================================================================= D . 1291023 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.392 |==================================================================== B . 0.392 |==================================================================== C . 0.391 |==================================================================== D . 0.387 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 29923 |================================================================== B . 30789 |==================================================================== C . 30162 |=================================================================== D . 30562 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.033 |==================================================================== B . 0.032 |================================================================== C . 0.033 |==================================================================== D . 0.033 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 675 |====================================================================== B . 675 |====================================================================== C . 673 |====================================================================== D . 672 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 148.09 |=================================================================== B . 148.19 |=================================================================== C . 148.66 |=================================================================== D . 148.78 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 626 |===================================================================== B . 626 |===================================================================== C . 628 |===================================================================== D . 637 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 399.55 |=================================================================== B . 399.54 |=================================================================== C . 398.05 |=================================================================== D . 392.64 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Write TPS > Higher Is Better A . 523 |================================================================== B . 494 |=============================================================== D . 552 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Write - Average Latency ms < Lower Is Better A . 958.56 |============================================================== B . 1012.65 |================================================================== D . 905.06 |=========================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 414 |====================================================================== B . 408 |===================================================================== D . 415 |====================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 2.415 |=================================================================== B . 2.452 |==================================================================== D . 2.408 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 908428 |================================================================== B . 923153 |=================================================================== D . 927451 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.055 |==================================================================== B . 0.054 |=================================================================== D . 0.054 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 992873 |================================================================= B . 1004363 |================================================================== D . 1002909 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.101 |==================================================================== B . 0.100 |=================================================================== D . 0.100 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 1210362 |================================================================= B . 1217946 |================================================================== D . 1225940 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.207 |==================================================================== B . 0.205 |=================================================================== D . 0.204 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 5778 |===================================================================== B . 5657 |==================================================================== D . 5211 |============================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 8.660 |============================================================= B . 8.838 |=============================================================== D . 9.595 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Only TPS > Higher Is Better A . 1222929 |================================================================== B . 1229013 |================================================================== D . 1227710 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.409 |==================================================================== B . 0.407 |==================================================================== D . 0.407 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 7898 |===================================================================== B . 7621 |=================================================================== D . 7285 |================================================================ PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 12.66 |=============================================================== B . 13.12 |================================================================= D . 13.73 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 9478 |===================================================================== B . 9255 |=================================================================== D . 8939 |================================================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 26.38 |================================================================ B . 27.01 |================================================================== D . 27.97 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Write TPS > Higher Is Better A . 9496 |=================================================================== B . 9780 |===================================================================== D . 9485 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency ms < Lower Is Better A . 52.72 |==================================================================== B . 51.13 |================================================================== D . 52.71 |====================================================================