Google Cloud c3 Sapphire Rapids Benchmarks by Michael Larabel for a future article. c3-highcpu-8 SPR: Processor: Intel Xeon Platinum 8481C (4 Cores / 8 Threads), Motherboard: Google Compute Engine c3-highcpu-8, Chipset: Intel 440FX 82441FX PMC, Memory: 16GB, Disk: 322GB nvme_card-pd, Network: Google Compute Engine Virtual OS: Ubuntu 22.10, Kernel: 5.19.0-1015-gcp (x86_64), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, System Layer: KVM c2-standard-8 CLX: Processor: Intel Xeon (4 Cores / 8 Threads), Motherboard: Google Compute Engine c2-standard-8, Chipset: Intel 440FX 82441FX PMC, Memory: 32GB, Disk: 322GB PersistentDisk, Network: Red Hat Virtio device OS: Ubuntu 22.10, Kernel: 5.19.0-1015-gcp (x86_64), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, System Layer: KVM n2-standard-8 CLX: Processor: Intel Xeon (4 Cores / 8 Threads), Motherboard: Google Compute Engine n2-standard-8, Chipset: Intel 440FX 82441FX PMC, Memory: 32GB, Disk: 322GB PersistentDisk, Network: Red Hat Virtio device OS: Ubuntu 22.10, Kernel: 5.19.0-1015-gcp (x86_64), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, System Layer: KVM LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better c3-highcpu-8 SPR .. 1272 |===================================================== c2-standard-8 CLX . 909 |====================================== n2-standard-8 CLX . 810 |================================== LeelaChessZero 0.28 Backend: Eigen Nodes Per Second > Higher Is Better c3-highcpu-8 SPR .. 1221 |===================================================== c2-standard-8 CLX . 902 |======================================= n2-standard-8 CLX . 808 |=================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 GFInst/s > Higher Is Better c3-highcpu-8 SPR .. 188.65 |=================================================== c2-standard-8 CLX . 152.80 |========================================= n2-standard-8 CLX . 133.95 |==================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s > Higher Is Better c3-highcpu-8 SPR .. 7.546 |==================================================== c2-standard-8 CLX . 6.112 |========================================== n2-standard-8 CLX . 5.358 |===================================== NAMD 2.14 ATPase Simulation - 327,506 Atoms days/ns < Lower Is Better c3-highcpu-8 SPR .. 3.35779 |================================= c2-standard-8 CLX . 4.44534 |============================================ n2-standard-8 CLX . 5.06706 |================================================== nekRS 22.0 Input: TurboPipe Periodic FLOP/s > Higher Is Better c3-highcpu-8 SPR .. 30667900000 |============================================== c2-standard-8 CLX . 25100766667 |====================================== n2-standard-8 CLX . 22963566667 |================================== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 129 Cells Per Direction Seconds < Lower Is Better c3-highcpu-8 SPR .. 32.39 |========================================== c2-standard-8 CLX . 37.76 |================================================ n2-standard-8 CLX . 40.54 |==================================================== OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Seconds < Lower Is Better c3-highcpu-8 SPR .. 62.04 |================================== c2-standard-8 CLX . 85.52 |=============================================== n2-standard-8 CLX . 95.06 |==================================================== OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Seconds < Lower Is Better c3-highcpu-8 SPR .. 422.68 |====================================== c2-standard-8 CLX . 560.61 |================================================== n2-standard-8 CLX . 574.24 |=================================================== OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better c3-highcpu-8 SPR .. 303.38 |=================================== c2-standard-8 CLX . 390.61 |============================================== n2-standard-8 CLX . 436.27 |=================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better c3-highcpu-8 SPR .. 219.73 |=================================== c2-standard-8 CLX . 291.49 |============================================== n2-standard-8 CLX . 322.22 |=================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better c3-highcpu-8 SPR .. 595.14 |===================================== c2-standard-8 CLX . 724.80 |============================================== n2-standard-8 CLX . 811.76 |=================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better c3-highcpu-8 SPR .. 367.00 |================================ c2-standard-8 CLX . 523.45 |============================================= n2-standard-8 CLX . 591.71 |=================================================== SPECFEM3D 4.0 Model: Mount St. Helens Seconds < Lower Is Better c3-highcpu-8 SPR .. 139.52 |============================================ c2-standard-8 CLX . 145.38 |============================================== n2-standard-8 CLX . 162.43 |=================================================== SPECFEM3D 4.0 Model: Layered Halfspace Seconds < Lower Is Better c3-highcpu-8 SPR .. 372.09 |============================================== c2-standard-8 CLX . 374.76 |============================================== n2-standard-8 CLX . 415.18 |=================================================== SPECFEM3D 4.0 Model: Tomographic Model Seconds < Lower Is Better c3-highcpu-8 SPR .. 143.94 |============================================ c2-standard-8 CLX . 150.92 |============================================== n2-standard-8 CLX . 166.38 |=================================================== SPECFEM3D 4.0 Model: Homogeneous Halfspace Seconds < Lower Is Better c3-highcpu-8 SPR .. 179.55 |=========================================== c2-standard-8 CLX . 190.79 |============================================= n2-standard-8 CLX . 213.89 |=================================================== SPECFEM3D 4.0 Model: Water-layered Halfspace Seconds < Lower Is Better c3-highcpu-8 SPR .. 321.63 |=========================================== c2-standard-8 CLX . 347.81 |=============================================== n2-standard-8 CLX . 380.13 |=================================================== Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed MB/s > Higher Is Better c3-highcpu-8 SPR .. 10.30 |==================================================== c2-standard-8 CLX . 9.24 |=============================================== n2-standard-8 CLX . 8.24 |========================================== Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better c3-highcpu-8 SPR .. 905.2 |==================================================== c2-standard-8 CLX . 701.1 |======================================== n2-standard-8 CLX . 649.5 |===================================== Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better c3-highcpu-8 SPR .. 6.50 |===================================================== c2-standard-8 CLX . 5.86 |================================================ n2-standard-8 CLX . 5.13 |========================================== Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better c3-highcpu-8 SPR .. 907.2 |==================================================== c2-standard-8 CLX . 713.8 |========================================= n2-standard-8 CLX . 660.3 |====================================== John The Ripper 2023.03.14 Test: bcrypt Real C/S > Higher Is Better c3-highcpu-8 SPR .. 6932 |===================================================== c2-standard-8 CLX . 6687 |=================================================== n2-standard-8 CLX . 5970 |============================================== John The Ripper 2023.03.14 Test: WPA PSK Real C/S > Higher Is Better c3-highcpu-8 SPR .. 28818 |================================================ c2-standard-8 CLX . 31278 |==================================================== n2-standard-8 CLX . 27423 |============================================== John The Ripper 2023.03.14 Test: Blowfish Real C/S > Higher Is Better c3-highcpu-8 SPR .. 6930 |===================================================== c2-standard-8 CLX . 6684 |=================================================== n2-standard-8 CLX . 5968 |============================================== John The Ripper 2023.03.14 Test: HMAC-SHA512 Real C/S > Higher Is Better c3-highcpu-8 SPR .. 37509000 |============================================== c2-standard-8 CLX . 40197000 |================================================= n2-standard-8 CLX . 35376000 |=========================================== John The Ripper 2023.03.14 Test: MD5 Real C/S > Higher Is Better c3-highcpu-8 SPR .. 765713 |=================================================== c2-standard-8 CLX . 683546 |============================================== n2-standard-8 CLX . 599637 |======================================== Embree 4.0.1 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 5.8475 |=================================================== c2-standard-8 CLX . 3.9340 |================================== n2-standard-8 CLX . 3.4584 |============================== Embree 4.0.1 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 7.3642 |=================================================== c2-standard-8 CLX . 5.1542 |==================================== n2-standard-8 CLX . 4.5768 |================================ uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 6.99 |===================================================== c2-standard-8 CLX . 5.69 |=========================================== n2-standard-8 CLX . 4.97 |====================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 7.48 |===================================================== c2-standard-8 CLX . 6.03 |=========================================== n2-standard-8 CLX . 5.28 |===================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 9.12 |===================================================== c2-standard-8 CLX . 7.45 |=========================================== n2-standard-8 CLX . 6.51 |====================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 32.39 |==================================================== c2-standard-8 CLX . 26.30 |========================================== n2-standard-8 CLX . 22.81 |===================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 34.50 |==================================================== c2-standard-8 CLX . 27.72 |========================================== n2-standard-8 CLX . 24.15 |==================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR .. 42.24 |==================================================== c2-standard-8 CLX . 34.47 |========================================== n2-standard-8 CLX . 30.05 |===================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR . 1.556 |===================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better c3-highcpu-8 SPR . 3.524 |===================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better c3-highcpu-8 SPR . 5.305 |===================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better c3-highcpu-8 SPR . 12.92 |===================================================== Intel Open Image Denoise 1.4.0 Run: RT.hdr_alb_nrm.3840x2160 Images / Sec > Higher Is Better c3-highcpu-8 SPR .. 0.24 |===================================================== c2-standard-8 CLX . 0.22 |================================================= n2-standard-8 CLX . 0.20 |============================================ Intel Open Image Denoise 1.4.0 Run: RTLightmap.hdr.4096x4096 Images / Sec > Higher Is Better c3-highcpu-8 SPR .. 0.12 |===================================================== c2-standard-8 CLX . 0.11 |================================================= n2-standard-8 CLX . 0.10 |============================================ OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec > Higher Is Better c3-highcpu-8 SPR .. 98 |======================================================= c2-standard-8 CLX . 70 |======================================= n2-standard-8 CLX . 63 |=================================== 7-Zip Compression 22.01 Test: Compression Rating MIPS > Higher Is Better c3-highcpu-8 SPR .. 35306 |==================================================== c2-standard-8 CLX . 30989 |============================================== n2-standard-8 CLX . 28062 |========================================= 7-Zip Compression 22.01 Test: Decompression Rating MIPS > Higher Is Better c3-highcpu-8 SPR .. 20468 |=============================================== c2-standard-8 CLX . 22852 |==================================================== n2-standard-8 CLX . 20514 |=============================================== Timed FFmpeg Compilation 6.0 Time To Compile Seconds < Lower Is Better c3-highcpu-8 SPR .. 120.44 |======================================== c2-standard-8 CLX . 139.04 |============================================== n2-standard-8 CLX . 154.90 |=================================================== Timed Linux Kernel Compilation 6.1 Build: defconfig Seconds < Lower Is Better c3-highcpu-8 SPR .. 244.80 |======================================= c2-standard-8 CLX . 289.66 |============================================== n2-standard-8 CLX . 322.38 |=================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 1.50004 |=== c2-standard-8 CLX . 19.52870 |=========================================== n2-standard-8 CLX . 22.02520 |================================================= oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 5.34218 |=============================== c2-standard-8 CLX . 8.02416 |=============================================== n2-standard-8 CLX . 8.51864 |================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 4.17707 |===== c2-standard-8 CLX . 34.18930 |=========================================== n2-standard-8 CLX . 38.87170 |================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 1.47145 |= c2-standard-8 CLX . 52.94210 |=========================================== n2-standard-8 CLX . 60.59250 |================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 3.54944 |==== c2-standard-8 CLX . 35.91640 |=========================================== n2-standard-8 CLX . 40.65420 |================================================= oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 4660.70 |====================================== c2-standard-8 CLX . 5767.70 |=============================================== n2-standard-8 CLX . 6078.81 |================================================== oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 2337.31 |===================================== c2-standard-8 CLX . 2998.03 |=============================================== n2-standard-8 CLX . 3172.34 |================================================== oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better c3-highcpu-8 SPR .. 0.968986 |====== c2-standard-8 CLX . 7.432600 |=========================================== n2-standard-8 CLX . 8.506780 |================================================= OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer ms < Lower Is Better c3-highcpu-8 SPR .. 20952 |============================== c2-standard-8 CLX . 30911 |============================================= n2-standard-8 CLX . 35884 |==================================================== OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer ms < Lower Is Better c3-highcpu-8 SPR .. 25819 |====================== c2-standard-8 CLX . 37892 |================================ n2-standard-8 CLX . 61337 |==================================================== OpenSSL 3.1 Algorithm: SHA256 byte/s > Higher Is Better c3-highcpu-8 SPR .. 4283873987 |=============================================== c2-standard-8 CLX . 1318193530 |============== n2-standard-8 CLX . 1178513873 |============= OpenSSL 3.1 Algorithm: SHA512 byte/s > Higher Is Better c3-highcpu-8 SPR .. 1568572920 |=============================================== c2-standard-8 CLX . 1465815227 |============================================ n2-standard-8 CLX . 1308154027 |======================================= OpenSSL 3.1 Algorithm: RSA4096 sign/s > Higher Is Better c3-highcpu-8 SPR .. 2062.7 |=================================================== c2-standard-8 CLX . 1156.6 |============================= n2-standard-8 CLX . 1028.6 |========================= OpenSSL 3.1 Algorithm: RSA4096 verify/s > Higher Is Better c3-highcpu-8 SPR .. 67857.7 |============================================ c2-standard-8 CLX . 76402.3 |================================================== n2-standard-8 CLX . 68182.7 |============================================= OpenSSL 3.1 Algorithm: ChaCha20 byte/s > Higher Is Better c3-highcpu-8 SPR .. 22091557637 |============================================== c2-standard-8 CLX . 21346811813 |============================================ n2-standard-8 CLX . 19055130217 |======================================== OpenSSL 3.1 Algorithm: AES-128-GCM byte/s > Higher Is Better c3-highcpu-8 SPR .. 57594077823 |============================================== c2-standard-8 CLX . 23237312603 |=================== n2-standard-8 CLX . 20765256453 |================= OpenSSL 3.1 Algorithm: AES-256-GCM byte/s > Higher Is Better c3-highcpu-8 SPR .. 48008361573 |============================================== c2-standard-8 CLX . 16945000630 |================ n2-standard-8 CLX . 15129238003 |============== OpenSSL 3.1 Algorithm: ChaCha20-Poly1305 byte/s > Higher Is Better c3-highcpu-8 SPR .. 15970781140 |============================================== c2-standard-8 CLX . 10919151843 |=============================== n2-standard-8 CLX . 9576513353 |============================ CockroachDB 22.2 Workload: MoVR - Concurrency: 128 ops/s > Higher Is Better c3-highcpu-8 SPR .. 458.8 |============================================= c2-standard-8 CLX . 534.9 |==================================================== n2-standard-8 CLX . 383.0 |===================================== CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 128 ops/s > Higher Is Better c3-highcpu-8 SPR .. 19321.6 |================================================== c2-standard-8 CLX . 13684.5 |=================================== n2-standard-8 CLX . 12699.1 |================================= CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 128 ops/s > Higher Is Better c3-highcpu-8 SPR .. 24960.1 |================================================== c2-standard-8 CLX . 16184.2 |================================ n2-standard-8 CLX . 14976.8 |============================== Memcached 1.6.18 Set To Get Ratio: 1:10 Ops/sec > Higher Is Better c3-highcpu-8 SPR .. 1044947.13 |=============================================== c2-standard-8 CLX . 715723.53 |================================ n2-standard-8 CLX . 641713.60 |============================= Memcached 1.6.18 Set To Get Ratio: 1:100 Ops/sec > Higher Is Better c3-highcpu-8 SPR .. 1030937.28 |=============================================== c2-standard-8 CLX . 702291.93 |================================ n2-standard-8 CLX . 624980.66 |============================ GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better c3-highcpu-8 SPR .. 0.777 |==================================================== c2-standard-8 CLX . 0.579 |======================================= n2-standard-8 CLX . 0.528 |=================================== MariaDB 11.0.1 Clients: 2048 Queries Per Second > Higher Is Better c3-highcpu-8 SPR .. 332 |====================================================== c2-standard-8 CLX . 248 |======================================== n2-standard-8 CLX . 220 |==================================== MariaDB 11.0.1 Clients: 4096 Queries Per Second > Higher Is Better c3-highcpu-8 SPR .. 317 |====================================================== c2-standard-8 CLX . 237 |======================================== n2-standard-8 CLX . 207 |=================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only TPS > Higher Is Better c3-highcpu-8 SPR .. 311942 |=================================================== c2-standard-8 CLX . 173317 |============================ n2-standard-8 CLX . 158267 |========================== PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency ms < Lower Is Better c3-highcpu-8 SPR .. 2.565 |========================== c2-standard-8 CLX . 4.616 |=============================================== n2-standard-8 CLX . 5.055 |==================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only TPS > Higher Is Better c3-highcpu-8 SPR .. 293725 |=================================================== c2-standard-8 CLX . 169643 |============================= n2-standard-8 CLX . 155196 |=========================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency ms < Lower Is Better c3-highcpu-8 SPR .. 3.405 |=========================== c2-standard-8 CLX . 5.895 |================================================ n2-standard-8 CLX . 6.450 |==================================================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better c3-highcpu-8 SPR .. 14.20 |==================================================== c2-standard-8 CLX . 13.33 |================================================= n2-standard-8 CLX . 12.18 |============================================= TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 images/sec > Higher Is Better c3-highcpu-8 SPR .. 14.93 |==================================================== c2-standard-8 CLX . 14.11 |================================================= n2-standard-8 CLX . 12.95 |============================================= TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 images/sec > Higher Is Better c3-highcpu-8 SPR .. 15.69 |==================================================== c2-standard-8 CLX . 14.79 |================================================= n2-standard-8 CLX . 13.74 |============================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 3.7873 |=================================================== c2-standard-8 CLX . 2.9308 |======================================= n2-standard-8 CLX . 2.6587 |==================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 528.02 |==================================== c2-standard-8 CLX . 682.37 |============================================== n2-standard-8 CLX . 752.19 |=================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 51.89 |=========================================== c2-standard-8 CLX . 62.51 |==================================================== n2-standard-8 CLX . 57.83 |================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 38.51 |==================================================== c2-standard-8 CLX . 31.96 |=========================================== n2-standard-8 CLX . 34.54 |=============================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 19.17 |==================================================== c2-standard-8 CLX . 15.92 |=========================================== n2-standard-8 CLX . 15.36 |========================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 104.31 |========================================= c2-standard-8 CLX . 125.47 |================================================= n2-standard-8 CLX . 130.02 |=================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 64.87 |==================================================== c2-standard-8 CLX . 59.99 |================================================ n2-standard-8 CLX . 54.96 |============================================ Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 30.80 |============================================ c2-standard-8 CLX . 33.29 |================================================ n2-standard-8 CLX . 36.34 |==================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 33.11 |==================================================== c2-standard-8 CLX . 29.18 |============================================== n2-standard-8 CLX . 25.97 |========================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 60.39 |========================================= c2-standard-8 CLX . 68.51 |============================================== n2-standard-8 CLX . 76.97 |==================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 6.5372 |=================================================== c2-standard-8 CLX . 6.1893 |================================================ n2-standard-8 CLX . 5.7491 |============================================= Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 305.90 |============================================= c2-standard-8 CLX . 323.08 |=============================================== n2-standard-8 CLX . 347.83 |=================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 16.22 |==================================================== c2-standard-8 CLX . 13.99 |============================================= n2-standard-8 CLX . 12.74 |========================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 123.29 |======================================== c2-standard-8 CLX . 142.89 |============================================== n2-standard-8 CLX . 156.90 |=================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better c3-highcpu-8 SPR .. 3.7693 |=================================================== c2-standard-8 CLX . 2.9352 |======================================== n2-standard-8 CLX . 2.6597 |==================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better c3-highcpu-8 SPR .. 530.61 |==================================== c2-standard-8 CLX . 681.34 |============================================== n2-standard-8 CLX . 751.94 |=================================================== Google Draco 1.5.6 Model: Lion ms < Lower Is Better c3-highcpu-8 SPR .. 6250 |======================================== c2-standard-8 CLX . 7437 |=============================================== n2-standard-8 CLX . 8355 |===================================================== Google Draco 1.5.6 Model: Church Facade ms < Lower Is Better c3-highcpu-8 SPR .. 7573 |================================ c2-standard-8 CLX . 11462 |================================================ n2-standard-8 CLX . 12332 |==================================================== Blender 3.4 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better c3-highcpu-8 SPR .. 315.24 |=================================================== nginx 1.23.2 Connections: 100 Requests Per Second > Higher Is Better c3-highcpu-8 SPR .. 36310.35 |================================================= c2-standard-8 CLX . 25148.28 |================================== n2-standard-8 CLX . 22830.19 |=============================== nginx 1.23.2 Connections: 200 Requests Per Second > Higher Is Better c3-highcpu-8 SPR .. 35602.10 |================================================= c2-standard-8 CLX . 24695.91 |================================== n2-standard-8 CLX . 22570.18 |=============================== nginx 1.23.2 Connections: 500 Requests Per Second > Higher Is Better c3-highcpu-8 SPR .. 34672.65 |================================================= c2-standard-8 CLX . 21957.17 |=============================== n2-standard-8 CLX . 20146.10 |============================ nginx 1.23.2 Connections: 1000 Requests Per Second > Higher Is Better c3-highcpu-8 SPR .. 32118.58 |================================================= c2-standard-8 CLX . 21446.27 |================================= n2-standard-8 CLX . 19683.60 |============================== nginx 1.23.2 Connections: 4000 Requests Per Second > Higher Is Better c3-highcpu-8 SPR .. 32814.75 |================================================= c2-standard-8 CLX . 21594.94 |================================ n2-standard-8 CLX . 19947.56 |============================== BRL-CAD 7.34 VGR Performance Metric VGR Performance Metric > Higher Is Better c3-highcpu-8 SPR .. 71072 |==================================================== c2-standard-8 CLX . 50314 |===================================== n2-standard-8 CLX . 44563 |================================= OpenCV 4.7 Test: Core ms < Lower Is Better c3-highcpu-8 SPR .. 87372 |===================== c2-standard-8 CLX . 142770 |=================================== n2-standard-8 CLX . 209277 |=================================================== OpenCV 4.7 Test: Video ms < Lower Is Better c3-highcpu-8 SPR .. 31654 |==================================================== c2-standard-8 CLX . 11737 |=================== n2-standard-8 CLX . 13367 |====================== OpenCV 4.7 Test: Graph API ms < Lower Is Better c3-highcpu-8 SPR .. 219931 |========================================== c2-standard-8 CLX . 236186 |============================================= n2-standard-8 CLX . 267250 |=================================================== OpenCV 4.7 Test: Stitching ms < Lower Is Better c3-highcpu-8 SPR .. 214760 |======================================= c2-standard-8 CLX . 250833 |============================================== n2-standard-8 CLX . 278493 |=================================================== OpenCV 4.7 Test: Image Processing ms < Lower Is Better c3-highcpu-8 SPR .. 128163 |===================================== c2-standard-8 CLX . 147234 |========================================== n2-standard-8 CLX . 178704 |=================================================== OpenCV 4.7 Test: Object Detection ms < Lower Is Better c3-highcpu-8 SPR .. 38999 |================================ c2-standard-8 CLX . 58056 |=============================================== n2-standard-8 CLX . 64284 |====================================================