march 2023 comet intel Intel Core i7-10700T testing with a Logic Supply RXM-181 (Z01-0002A026 BIOS) and Intel UHD 630 CML GT2 30GB on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: Intel Core i7-10700T @ 4.50GHz (8 Cores / 16 Threads), Motherboard: Logic Supply RXM-181 (Z01-0002A026 BIOS), Chipset: Intel Comet Lake PCH, Memory: 32GB, Disk: 256GB TS256GMTS800, Graphics: Intel UHD 630 CML GT2 30GB (1200MHz), Audio: Realtek ALC233, Monitor: DELL P2415Q, Network: Intel I219-LM + Intel I210 OS: Ubuntu 22.04, Kernel: 5.15.0-56-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: Intel Core i7-10700T @ 4.50GHz (8 Cores / 16 Threads), Motherboard: Logic Supply RXM-181 (Z01-0002A026 BIOS), Chipset: Intel Comet Lake PCH, Memory: 32GB, Disk: 256GB TS256GMTS800, Graphics: Intel UHD 630 CML GT2 30GB (1200MHz), Audio: Realtek ALC233, Monitor: DELL P2415Q, Network: Intel I219-LM + Intel I210 OS: Ubuntu 22.04, Kernel: 5.15.0-56-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: Intel Core i7-10700T @ 4.50GHz (8 Cores / 16 Threads), Motherboard: Logic Supply RXM-181 (Z01-0002A026 BIOS), Chipset: Intel Comet Lake PCH, Memory: 32GB, Disk: 256GB TS256GMTS800, Graphics: Intel UHD 630 CML GT2 30GB (1200MHz), Audio: Realtek ALC233, Monitor: DELL P2415Q, Network: Intel I219-LM + Intel I210 OS: Ubuntu 22.04, Kernel: 5.15.0-56-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1080 ET: Legacy 2.81 Resolution: 1920 x 1080 Frames Per Second > Higher Is Better a . 92.6 |===================================================================== b . 92.8 |===================================================================== c . 93.0 |===================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: High Frames Per Second > Higher Is Better a . 91.0 |===================================================================== b . 91.0 |===================================================================== c . 87.9 |=================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Ultra Frames Per Second > Higher Is Better a . 48.2 |===================================================================== b . 48.2 |===================================================================== c . 46.8 |=================================================================== Unvanquished 0.54 Resolution: 1920 x 1080 - Effects Quality: Medium Frames Per Second > Higher Is Better a . 162.6 |============================================================ b . 185.7 |==================================================================== c . 174.6 |================================================================ FluidX3D 2.3 Test: FP32-FP32 MLUPs/s > Higher Is Better a . 191 |=================================================================== b . 200 |====================================================================== c . 200 |====================================================================== FluidX3D 2.3 Test: FP32-FP16C MLUPs/s > Higher Is Better a . 173 |====================================================================== b . 173 |====================================================================== c . 173 |====================================================================== FluidX3D 2.3 Test: FP32-FP16S MLUPs/s > Higher Is Better a . 367 |==================================================================== b . 377 |====================================================================== c . 377 |====================================================================== dav1d 1.1 Video Input: Chimera 1080p FPS > Higher Is Better a . 363.06 |================================================================== b . 367.58 |=================================================================== c . 368.19 |=================================================================== dav1d 1.1 Video Input: Summer Nature 4K FPS > Higher Is Better a . 117.29 |=================================================================== b . 117.21 |=================================================================== c . 117.72 |=================================================================== dav1d 1.1 Video Input: Summer Nature 1080p FPS > Higher Is Better a . 601.40 |=================================================================== b . 597.77 |=================================================================== c . 601.90 |=================================================================== dav1d 1.1 Video Input: Chimera 1080p 10-bit FPS > Higher Is Better a . 310.27 |=================================================================== b . 311.73 |=================================================================== c . 310.90 |=================================================================== AOM AV1 3.6 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 0.09 |===================================================================== b . 0.09 |===================================================================== c . 0.09 |===================================================================== AOM AV1 3.6 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 3.18 |==================================================================== b . 3.21 |===================================================================== c . 3.22 |===================================================================== AOM AV1 3.6 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 49.39 |==================================================================== b . 49.15 |=================================================================== c . 49.68 |==================================================================== AOM AV1 3.6 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 5.81 |===================================================================== b . 5.83 |===================================================================== c . 5.85 |===================================================================== AOM AV1 3.6 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 36.64 |================================================================= b . 38.08 |==================================================================== c . 37.98 |==================================================================== AOM AV1 3.6 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 53.21 |==================================================================== b . 52.88 |==================================================================== c . 53.02 |==================================================================== AOM AV1 3.6 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 49.19 |============================================================== b . 53.87 |==================================================================== c . 53.43 |=================================================================== AOM AV1 3.6 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 0.26 |===================================================================== b . 0.26 |===================================================================== c . 0.26 |===================================================================== AOM AV1 3.6 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 7.88 |==================================================================== b . 7.93 |===================================================================== c . 7.94 |===================================================================== AOM AV1 3.6 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 127.09 |========================================================= b . 147.41 |=================================================================== c . 148.38 |=================================================================== AOM AV1 3.6 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 19.52 |=================================================================== b . 19.67 |==================================================================== c . 19.65 |==================================================================== AOM AV1 3.6 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 138.80 |=================================================================== b . 122.98 |=========================================================== c . 116.78 |======================================================== AOM AV1 3.6 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 174.09 |================================================================== b . 176.02 |=================================================================== c . 175.90 |=================================================================== AOM AV1 3.6 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 177.17 |================================================================== b . 179.33 |=================================================================== c . 178.77 |=================================================================== Embree 4.0 Binary: Pathtracer - Model: Crown Frames Per Second > Higher Is Better a . 5.8023 |================================================================= b . 5.9532 |=================================================================== c . 5.9277 |=================================================================== Embree 4.0 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better a . 6.2862 |=================================================================== b . 6.3143 |=================================================================== c . 6.3293 |=================================================================== Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Frames Per Second > Higher Is Better a . 7.1347 |================================================================= b . 7.2970 |=================================================================== c . 7.3332 |=================================================================== Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Obj Frames Per Second > Higher Is Better a . 6.5606 |================================================================== b . 6.6465 |=================================================================== c . 6.6207 |=================================================================== Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better a . 8.3702 |=================================================================== b . 8.3316 |=================================================================== c . 8.3854 |=================================================================== Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second > Higher Is Better a . 7.2539 |=================================================================== b . 7.3013 |=================================================================== c . 7.2903 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a . 3.70 |==================================================================== b . 3.75 |===================================================================== c . 3.72 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a . 3.81 |==================================================================== b . 3.86 |===================================================================== c . 3.85 |===================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a . 21.19 |=================================================================== b . 21.48 |==================================================================== c . 21.25 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a . 22.18 |=================================================================== b . 22.38 |==================================================================== c . 22.33 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 9.81 |==================================================================== b . 9.90 |===================================================================== c . 9.84 |===================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 12.20 |==================================================================== b . 12.29 |==================================================================== c . 12.25 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 16.95 |=================================================================== b . 17.11 |==================================================================== c . 16.94 |=================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 49.96 |=================================================================== b . 50.13 |=================================================================== c . 50.60 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 65.56 |================================================================== b . 67.01 |==================================================================== c . 67.34 |==================================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 98.61 |==================================================================== b . 98.67 |==================================================================== c . 97.78 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a . 2.35 |==================================================================== b . 2.36 |===================================================================== c . 2.37 |===================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a . 2.63 |==================================================================== b . 2.63 |==================================================================== c . 2.65 |===================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a . 13.42 |==================================================================== b . 13.51 |==================================================================== c . 13.49 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a . 14.98 |=================================================================== b . 15.11 |==================================================================== c . 14.98 |=================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 7.94 |==================================================================== b . 8.03 |===================================================================== c . 7.99 |===================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 8.40 |===================================================================== b . 8.41 |===================================================================== c . 8.46 |===================================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 10.21 |=================================================================== b . 10.29 |==================================================================== c . 10.29 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a . 41.14 |=================================================================== b . 41.28 |==================================================================== c . 41.47 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a . 43.67 |=================================================================== b . 44.50 |==================================================================== c . 44.37 |==================================================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a . 54.62 |=================================================================== b . 55.82 |==================================================================== c . 55.12 |=================================================================== VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 3.84 |==================================================================== b . 3.87 |===================================================================== c . 3.87 |===================================================================== VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a . 11.00 |==================================================================== b . 10.62 |================================================================== c . 10.59 |================================================================= VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 8.02 |===================================================================== b . 8.06 |===================================================================== c . 8.07 |===================================================================== VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a . 22.00 |=================================================================== b . 22.06 |=================================================================== c . 22.23 |==================================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better a . 1.529 |==================================================================== b . 1.537 |==================================================================== c . 1.539 |==================================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better a . 3.367 |==================================================================== b . 3.296 |================================================================== c . 3.373 |==================================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better a . 4.560 |==================================================================== b . 4.586 |==================================================================== c . 4.588 |==================================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better a . 11.26 |==================================================================== b . 11.31 |==================================================================== c . 11.26 |==================================================================== Timed FFmpeg Compilation 6.0 Time To Compile Seconds < Lower Is Better a . 100.74 |=================================================================== b . 99.64 |================================================================== c . 100.51 |=================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Live Seconds < Lower Is Better a . 28.54 |=================================================================== b . 28.63 |==================================================================== c . 28.79 |==================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Live FPS > Higher Is Better a . 176.95 |=================================================================== b . 176.41 |=================================================================== c . 175.40 |================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Live Seconds < Lower Is Better a . 60.35 |==================================================================== b . 59.79 |=================================================================== c . 60.09 |==================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Live FPS > Higher Is Better a . 83.68 |=================================================================== b . 84.46 |==================================================================== c . 84.04 |==================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Upload Seconds < Lower Is Better a . 249.98 |================================================================== b . 252.06 |=================================================================== c . 251.44 |=================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Upload FPS > Higher Is Better a . 10.10 |==================================================================== b . 10.02 |=================================================================== c . 10.04 |==================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Upload Seconds < Lower Is Better a . 186.42 |=================================================================== b . 186.86 |=================================================================== c . 186.68 |=================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Upload FPS > Higher Is Better a . 13.54 |==================================================================== b . 13.51 |==================================================================== c . 13.53 |==================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Platform Seconds < Lower Is Better a . 195.56 |=================================================================== b . 194.75 |=================================================================== c . 194.92 |=================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Platform FPS > Higher Is Better a . 38.74 |==================================================================== b . 38.90 |==================================================================== c . 38.86 |==================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Platform Seconds < Lower Is Better a . 275.57 |=================================================================== b . 275.35 |=================================================================== c . 276.43 |=================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Platform FPS > Higher Is Better a . 27.49 |==================================================================== b . 27.51 |==================================================================== c . 27.40 |==================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand Seconds < Lower Is Better a . 194.86 |=================================================================== b . 195.16 |=================================================================== c . 195.23 |=================================================================== FFmpeg 6.0 Encoder: libx264 - Scenario: Video On Demand FPS > Higher Is Better a . 38.87 |==================================================================== b . 38.82 |==================================================================== c . 38.80 |==================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand Seconds < Lower Is Better a . 274.71 |=================================================================== b . 274.25 |=================================================================== c . 274.75 |=================================================================== FFmpeg 6.0 Encoder: libx265 - Scenario: Video On Demand FPS > Higher Is Better a . 27.57 |==================================================================== b . 27.62 |==================================================================== c . 27.57 |==================================================================== ClickHouse 22.12.3.5 Queries Per Minute, Geo Mean > Higher Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better a . 0.637 |==================================================================== b . 0.638 |==================================================================== c . 0.630 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 3.5286 |=================================================================== b . 3.5259 |=================================================================== c . 3.5260 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 1117.66 |================================================================= b . 1134.44 |================================================================== c . 1134.39 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 3.4130 |================================================================== b . 3.4482 |=================================================================== c . 3.4260 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 292.99 |=================================================================== b . 290.00 |================================================================== c . 291.88 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 51.21 |==================================================================== b . 50.72 |=================================================================== c . 50.76 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 78.08 |=================================================================== b . 78.83 |==================================================================== c . 78.78 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 39.15 |=================================================================== b . 39.50 |==================================================================== c . 39.11 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 25.53 |==================================================================== b . 25.31 |=================================================================== c . 25.56 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 13.84 |==================================================================== b . 13.88 |==================================================================== c . 13.88 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 288.59 |=================================================================== b . 288.15 |=================================================================== c . 288.20 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 12.70 |==================================================================== b . 12.69 |==================================================================== c . 12.78 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 78.73 |==================================================================== b . 78.80 |==================================================================== c . 78.26 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 20.91 |=================================================================== b . 21.32 |==================================================================== c . 20.98 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 191.26 |=================================================================== b . 187.57 |================================================================== c . 190.58 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 19.73 |=================================================================== b . 20.08 |==================================================================== c . 19.74 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 50.67 |==================================================================== b . 49.80 |=================================================================== c . 50.65 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 45.26 |================================================================== b . 46.54 |==================================================================== c . 45.74 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 88.36 |==================================================================== b . 85.92 |================================================================== c . 87.43 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 40.36 |=================================================================== b . 40.81 |==================================================================== c . 40.51 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 24.76 |==================================================================== b . 24.49 |=================================================================== c . 24.67 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 33.53 |================================================================== b . 34.71 |==================================================================== c . 33.65 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 119.29 |=================================================================== b . 115.23 |================================================================= c . 118.86 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 29.19 |=================================================================== b . 29.46 |==================================================================== c . 29.07 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 34.25 |==================================================================== b . 33.94 |=================================================================== c . 34.39 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 5.6365 |=================================================================== b . 5.6492 |=================================================================== c . 5.6543 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 709.62 |=================================================================== b . 708.02 |=================================================================== c . 705.78 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 5.4884 |=================================================================== b . 5.4936 |=================================================================== c . 5.5107 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 182.19 |=================================================================== b . 182.02 |=================================================================== c . 181.45 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 15.77 |================================================================== b . 16.16 |==================================================================== c . 15.88 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 253.62 |=================================================================== b . 247.47 |================================================================= c . 251.92 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 14.04 |==================================================================== b . 14.11 |==================================================================== c . 14.10 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 71.23 |==================================================================== b . 70.85 |==================================================================== c . 70.89 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 3.5075 |=================================================================== b . 3.4908 |=================================================================== c . 3.5063 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 1132.37 |================================================================== b . 1135.02 |================================================================== c . 1134.67 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 3.4116 |=================================================================== b . 3.4168 |=================================================================== c . 3.4150 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 293.11 |=================================================================== b . 292.66 |=================================================================== c . 292.82 |=================================================================== Stress-NG 0.15.04 Test: Hash Bogo Ops/s > Higher Is Better a . 1152437.43 |=============================================================== b . 1155239.66 |=============================================================== c . 1156438.12 |=============================================================== Stress-NG 0.15.04 Test: MMAP Bogo Ops/s > Higher Is Better a . 96.64 |=================================================================== b . 97.22 |=================================================================== c . 98.07 |==================================================================== Stress-NG 0.15.04 Test: NUMA Bogo Ops/s > Higher Is Better a . 119.81 |=================================================================== b . 119.10 |================================================================== c . 120.45 |=================================================================== Stress-NG 0.15.04 Test: Poll Bogo Ops/s > Higher Is Better a . 1054294.44 |=============================================================== b . 1056290.80 |=============================================================== c . 1055279.37 |=============================================================== Stress-NG 0.15.04 Test: Zlib Bogo Ops/s > Higher Is Better a . 561.02 |=================================================================== b . 562.72 |=================================================================== c . 563.41 |=================================================================== Stress-NG 0.15.04 Test: Futex Bogo Ops/s > Higher Is Better a . 1676958.12 |========================================================= b . 1857762.75 |=============================================================== c . 1683694.62 |========================================================= Stress-NG 0.15.04 Test: MEMFD Bogo Ops/s > Higher Is Better a . 88.32 |==================================================================== b . 85.82 |================================================================== c . 85.29 |================================================================== Stress-NG 0.15.04 Test: Mutex Bogo Ops/s > Higher Is Better a . 3859835.88 |============================================================== b . 3031043.34 |================================================= c . 3897100.02 |=============================================================== Stress-NG 0.15.04 Test: Atomic Bogo Ops/s > Higher Is Better a . 68.91 |================================== b . 105.44 |=================================================== c . 137.37 |=================================================================== Stress-NG 0.15.04 Test: Crypto Bogo Ops/s > Higher Is Better a . 9690.98 |================================================================== b . 9679.26 |================================================================== c . 9697.04 |================================================================== Stress-NG 0.15.04 Test: Malloc Bogo Ops/s > Higher Is Better a . 4017159.85 |============================================================== b . 4054637.17 |=============================================================== c . 4047097.98 |=============================================================== Stress-NG 0.15.04 Test: Forking Bogo Ops/s > Higher Is Better a . 28253.40 |================================================================= b . 28247.00 |================================================================= c . 28324.73 |================================================================= Stress-NG 0.15.04 Test: Pthread Bogo Ops/s > Higher Is Better a . 109414.70 |================================================================ b . 109604.00 |================================================================ c . 109182.16 |================================================================ Stress-NG 0.15.04 Test: IO_uring Bogo Ops/s > Higher Is Better a . 3875.78 |================================================================== b . 3883.29 |================================================================== c . 3878.58 |================================================================== Stress-NG 0.15.04 Test: SENDFILE Bogo Ops/s > Higher Is Better a . 119280.63 |=============================================================== b . 120347.73 |================================================================ c . 119357.53 |=============================================================== Stress-NG 0.15.04 Test: CPU Cache Bogo Ops/s > Higher Is Better a . 108.73 |=================================================================== b . 107.60 |================================================================== c . 99.50 |============================================================= Stress-NG 0.15.04 Test: CPU Stress Bogo Ops/s > Higher Is Better a . 12408.32 |================================================================ b . 12393.81 |================================================================ c . 12615.80 |================================================================= Stress-NG 0.15.04 Test: Semaphores Bogo Ops/s > Higher Is Better a . 1659587.14 |=============================================================== b . 1663834.65 |=============================================================== c . 1659959.94 |=============================================================== Stress-NG 0.15.04 Test: Matrix Math Bogo Ops/s > Higher Is Better a . 26701.79 |================================================================= b . 26420.87 |================================================================ c . 25730.34 |=============================================================== Stress-NG 0.15.04 Test: Vector Math Bogo Ops/s > Higher Is Better a . 22459.64 |================================================================= b . 22572.70 |================================================================= c . 22574.05 |================================================================= Stress-NG 0.15.04 Test: Function Call Bogo Ops/s > Higher Is Better a . 35987.58 |================================================================ b . 36591.66 |================================================================= c . 36721.34 |================================================================= Stress-NG 0.15.04 Test: x86_64 RdRand Bogo Ops/s > Higher Is Better a . 3085.54 |================================================================= b . 3110.73 |================================================================== c . 3110.85 |================================================================== Stress-NG 0.15.04 Test: Memory Copying Bogo Ops/s > Higher Is Better a . 1405.88 |================================================================== b . 1406.48 |================================================================== c . 1406.51 |================================================================== Stress-NG 0.15.04 Test: Socket Activity Bogo Ops/s > Higher Is Better a . 6567.68 |================================================================== b . 6597.40 |================================================================== c . 6557.76 |================================================================== Stress-NG 0.15.04 Test: Context Switching Bogo Ops/s > Higher Is Better a . 936761.95 |============================= b . 2040743.26 |=============================================================== c . 940696.74 |============================= Stress-NG 0.15.04 Test: Glibc C String Functions Bogo Ops/s > Higher Is Better a . 792235.76 |============================================================== b . 802664.62 |=============================================================== c . 815257.91 |================================================================ Stress-NG 0.15.04 Test: Glibc Qsort Data Sorting Bogo Ops/s > Higher Is Better a . 73.97 |==================================================================== b . 74.40 |==================================================================== c . 74.17 |==================================================================== Stress-NG 0.15.04 Test: System V Message Passing Bogo Ops/s > Higher Is Better a . 6138783.08 |=============================================================== b . 6151689.27 |=============================================================== c . 6177858.50 |=============================================================== OpenEMS 0.0.35-86 Test: pyEMS Coupler MCells/s > Higher Is Better a . 18.31 |=================================================================== b . 18.36 |==================================================================== c . 18.46 |==================================================================== OpenEMS 0.0.35-86 Test: openEMS MSL_NotchFilter MCells/s > Higher Is Better a . 47.35 |=================================================================== b . 48.00 |==================================================================== c . 47.97 |==================================================================== RocksDB 7.9.2 Test: Random Fill Op/s > Higher Is Better a . 484315 |================================================================== b . 487821 |=================================================================== c . 488285 |=================================================================== RocksDB 7.9.2 Test: Random Read Op/s > Higher Is Better a . 21056507 |============================================================== b . 22204260 |================================================================= c . 21649206 |=============================================================== RocksDB 7.9.2 Test: Update Random Op/s > Higher Is Better a . 258925 |================================================================== b . 261452 |=================================================================== c . 260794 |=================================================================== RocksDB 7.9.2 Test: Sequential Fill Op/s > Higher Is Better a . 743820 |================================================================== b . 757628 |=================================================================== c . 736663 |================================================================= RocksDB 7.9.2 Test: Random Fill Sync Op/s > Higher Is Better a . 2603 |===================================================================== b . 2598 |===================================================================== c . 2595 |===================================================================== RocksDB 7.9.2 Test: Read While Writing Op/s > Higher Is Better a . 1280871 |================================================================ b . 1319744 |================================================================== c . 1300980 |================================================================= RocksDB 7.9.2 Test: Read Random Write Random Op/s > Higher Is Better a . 911028 |=================================================================== b . 916611 |=================================================================== c . 917781 |===================================================================