AMD EPYC 7763 1P spec_rstack_overflow Benchmarks by Michael Larabel for a future article looking at AMD Inception impact. off: Processor: AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores / 128 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 256GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710 OS: Ubuntu 22.04, Kernel: 6.5.0-rc5-phx-tues (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.3, Vulkan: 1.3.224, Compiler: GCC 11.3.0 + LLVM 14.0.0, File-System: ext4, Screen Resolution: 1920x1080 safe RET no microcode: Processor: AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores / 128 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 256GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710 OS: Ubuntu 22.04, Kernel: 6.5.0-rc5-phx-tues (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.3, Vulkan: 1.3.224, Compiler: GCC 11.3.0 + LLVM 14.0.0, File-System: ext4, Screen Resolution: 1920x1080 safe RET: Processor: AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores / 128 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 256GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710 OS: Ubuntu 22.04, Kernel: 6.5.0-rc5-phx-tues (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.3, Vulkan: 1.3.224, Compiler: GCC 11.3.0 + LLVM 14.0.0, File-System: ext4, Screen Resolution: 1920x1080 IBPB: Processor: AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores / 128 Threads), Motherboard: AMD DAYTONA_X (RYM1009B BIOS), Chipset: AMD Starship/Matisse, Memory: 256GB, Disk: 800GB INTEL SSDPF21Q800GB, Graphics: ASPEED, Monitor: VE228, Network: 2 x Mellanox MT27710 OS: Ubuntu 22.04, Kernel: 6.5.0-rc5-phx-tues (x86_64), Desktop: GNOME Shell 42.5, Display Server: X Server 1.21.1.3, Vulkan: 1.3.224, Compiler: GCC 11.3.0 + LLVM 14.0.0, File-System: ext4, Screen Resolution: 1920x1080 SQLite 3.41.2 Threads / Copies: 8 Seconds < Lower Is Better off ................... 3.755 |==================================== safe RET no microcode . 4.850 |=============================================== safe RET .............. 5.006 |================================================ IBPB .................. 4.793 |============================================== SQLite 3.41.2 Threads / Copies: 16 Seconds < Lower Is Better off ................... 6.273 |================================== safe RET no microcode . 8.834 |================================================ safe RET .............. 8.800 |================================================ IBPB .................. 7.934 |=========================================== NAMD 2.14 ATPase Simulation - 327,506 Atoms days/ns < Lower Is Better off ................... 0.38130 |============================================== safe RET no microcode . 0.38115 |============================================= safe RET .............. 0.38098 |============================================= IBPB .................. 0.38534 |============================================== Algebraic Multi-Grid Benchmark 1.2 Figure Of Merit > Higher Is Better off ................... 1011799000 |=========================================== safe RET no microcode . 999645400 |========================================== safe RET .............. 999102100 |========================================== IBPB .................. 1005138667 |=========================================== Timed MrBayes Analysis 3.2.7 Primate Phylogeny Analysis Seconds < Lower Is Better off ................... 136.69 |============================================ safe RET no microcode . 137.52 |============================================= safe RET .............. 138.85 |============================================= IBPB .................. 144.83 |=============================================== OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Seconds < Lower Is Better off ................... 140.62 |============================================= safe RET no microcode . 145.06 |============================================== safe RET .............. 144.02 |============================================== IBPB .................. 148.25 |=============================================== OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Seconds < Lower Is Better off ................... 633.52 |============================================== safe RET no microcode . 644.36 |=============================================== safe RET .............. 643.71 |=============================================== IBPB .................. 645.41 |=============================================== OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better off ................... 87.72 |==================================== safe RET no microcode . 93.68 |======================================= safe RET .............. 93.90 |======================================= IBPB .................. 113.68 |=============================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better off ................... 33.10 |======================================== safe RET no microcode . 36.37 |============================================ safe RET .............. 36.40 |============================================ IBPB .................. 40.11 |================================================ OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better off ................... 144.83 |========================================== safe RET no microcode . 152.91 |============================================= safe RET .............. 152.27 |============================================= IBPB .................. 160.70 |=============================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better off ................... 77.46 |====================================== safe RET no microcode . 85.04 |========================================= safe RET .............. 84.48 |========================================= IBPB .................. 99.04 |================================================ OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better off ................... 162.13 |============================================ safe RET no microcode . 163.02 |============================================= safe RET .............. 163.97 |============================================= IBPB .................. 171.75 |=============================================== Remhos 1.0 Test: Sample Remap Example Seconds < Lower Is Better off ................... 17.38 |============================================= safe RET no microcode . 17.79 |============================================== safe RET .............. 17.96 |============================================== IBPB .................. 18.66 |================================================ SPECFEM3D 4.0 Model: Mount St. Helens Seconds < Lower Is Better off ................... 11.80 |=============================================== safe RET no microcode . 11.98 |================================================ safe RET .............. 12.01 |================================================ IBPB .................. 11.95 |================================================ SPECFEM3D 4.0 Model: Layered Halfspace Seconds < Lower Is Better off ................... 31.85 |================================================ safe RET no microcode . 31.83 |================================================ safe RET .............. 31.66 |=============================================== IBPB .................. 32.01 |================================================ SPECFEM3D 4.0 Model: Tomographic Model Seconds < Lower Is Better off ................... 14.13 |=============================================== safe RET no microcode . 14.40 |================================================ safe RET .............. 14.19 |=============================================== IBPB .................. 14.23 |=============================================== SPECFEM3D 4.0 Model: Homogeneous Halfspace Seconds < Lower Is Better off ................... 17.42 |=============================================== safe RET no microcode . 17.64 |================================================ safe RET .............. 17.69 |================================================ IBPB .................. 17.70 |================================================ SPECFEM3D 4.0 Model: Water-layered Halfspace Seconds < Lower Is Better off ................... 29.77 |=============================================== safe RET no microcode . 30.43 |================================================ safe RET .............. 29.59 |=============================================== IBPB .................. 30.05 |=============================================== DaCapo Benchmark 9.12-MR1 Java Test: Jython msec < Lower Is Better off ................... 4193 |============================================== safe RET no microcode . 4191 |============================================== safe RET .............. 4241 |=============================================== IBPB .................. 4446 |================================================= DaCapo Benchmark 9.12-MR1 Java Test: Tradebeans msec < Lower Is Better off ................... 3993 |===================================== safe RET no microcode . 4096 |====================================== safe RET .............. 4143 |====================================== IBPB .................. 5305 |================================================= Embree 4.1 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better off ................... 57.42 |================================================ safe RET no microcode . 57.30 |================================================ safe RET .............. 57.31 |================================================ IBPB .................. 57.30 |================================================ Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better off ................... 64.60 |================================================ safe RET no microcode . 64.39 |================================================ safe RET .............. 64.67 |================================================ IBPB .................. 63.47 |=============================================== ACES DGEMM 1.0 Sustained Floating-Point Rate GFLOP/s > Higher Is Better off ................... 24.20 |=============================================== safe RET no microcode . 24.70 |================================================ safe RET .............. 23.70 |============================================== IBPB .................. 24.25 |=============================================== OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec > Higher Is Better off ................... 453 |================================================== safe RET no microcode . 452 |================================================== safe RET .............. 453 |================================================== IBPB .................. 450 |================================================== OSPRay 2.12 Benchmark: particle_volume/ao/real_time Items Per Second > Higher Is Better off ................... 18.02 |================================================ safe RET no microcode . 18.03 |================================================ safe RET .............. 17.98 |================================================ IBPB .................. 17.97 |================================================ OSPRay 2.12 Benchmark: particle_volume/scivis/real_time Items Per Second > Higher Is Better off ................... 17.75 |================================================ safe RET no microcode . 17.73 |================================================ safe RET .............. 17.73 |================================================ IBPB .................. 17.67 |================================================ OSPRay 2.12 Benchmark: particle_volume/pathtracer/real_time Items Per Second > Higher Is Better off ................... 157.83 |=============================================== safe RET no microcode . 155.17 |============================================== safe RET .............. 156.42 |=============================================== IBPB .................. 153.44 |============================================== OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Items Per Second > Higher Is Better off ................... 8.96051 |============================================== safe RET no microcode . 8.96941 |============================================== safe RET .............. 8.94049 |============================================== IBPB .................. 8.89239 |============================================== OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Items Per Second > Higher Is Better off ................... 8.33174 |============================================== safe RET no microcode . 8.32749 |============================================== safe RET .............. 8.33813 |============================================== IBPB .................. 8.26549 |============================================== OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Items Per Second > Higher Is Better off ................... 13.14 |================================================ safe RET no microcode . 13.26 |================================================ safe RET .............. 13.25 |================================================ IBPB .................. 13.17 |================================================ 7-Zip Compression 22.01 Test: Compression Rating MIPS > Higher Is Better off ................... 384374 |=============================================== safe RET no microcode . 334812 |========================================= safe RET .............. 335595 |========================================= IBPB .................. 371799 |============================================= 7-Zip Compression 22.01 Test: Decompression Rating MIPS > Higher Is Better off ................... 385585 |=============================================== safe RET no microcode . 383039 |=============================================== safe RET .............. 383515 |=============================================== IBPB .................. 385487 |=============================================== Timed Godot Game Engine Compilation 4.0 Time To Compile Seconds < Lower Is Better off ................... 121.95 |========================================== safe RET no microcode . 125.66 |=========================================== safe RET .............. 125.06 |=========================================== IBPB .................. 135.96 |=============================================== Timed Linux Kernel Compilation 6.1 Build: defconfig Seconds < Lower Is Better off ................... 31.19 |===================================== safe RET no microcode . 37.62 |============================================= safe RET .............. 37.24 |============================================= IBPB .................. 40.09 |================================================ Timed Linux Kernel Compilation 6.1 Build: allmodconfig Seconds < Lower Is Better off ................... 289.06 |======================================= safe RET no microcode . 344.24 |============================================== safe RET .............. 338.16 |============================================= IBPB .................. 352.18 |=============================================== Timed LLVM Compilation 16.0 Build System: Ninja Seconds < Lower Is Better off ................... 176.37 |========================================= safe RET no microcode . 182.17 |========================================== safe RET .............. 181.53 |========================================== IBPB .................. 204.08 |=============================================== Timed Node.js Compilation 19.8.1 Time To Compile Seconds < Lower Is Better off ................... 164.27 |======================================= safe RET no microcode . 172.75 |========================================== safe RET .............. 173.06 |========================================== IBPB .................. 195.49 |=============================================== Numpy Benchmark Score > Higher Is Better off ................... 457.23 |=============================================== safe RET no microcode . 418.95 |=========================================== safe RET .............. 422.58 |=========================================== IBPB .................. 389.92 |======================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better off ................... 349.43 |=============================================== safe RET no microcode . 323.42 |============================================ safe RET .............. 318.12 |=========================================== IBPB .................. 336.69 |============================================= ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better off ................... 361.81 |=============================================== safe RET no microcode . 337.01 |============================================ safe RET .............. 337.12 |============================================ IBPB .................. 347.92 |============================================= ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better off ................... 362.64 |=============================================== safe RET no microcode . 329.19 |=========================================== safe RET .............. 337.45 |============================================ IBPB .................. 349.50 |============================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - SHA-512 Benchmark Time Seconds < Lower Is Better off ................... 3.39 |============================================= safe RET no microcode . 3.42 |============================================= safe RET .............. 3.47 |============================================== IBPB .................. 3.71 |================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Seconds < Lower Is Better off ................... 31.84 |================================================ safe RET no microcode . 32.02 |================================================ safe RET .............. 31.43 |=============================================== IBPB .................. 31.49 |=============================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Group By Test Time Seconds < Lower Is Better off ................... 4.91 |========================================== safe RET no microcode . 5.17 |============================================ safe RET .............. 5.15 |============================================ IBPB .................. 5.74 |================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Repartition Test Time Seconds < Lower Is Better off ................... 2.09 |=========================================== safe RET no microcode . 2.38 |================================================= safe RET .............. 2.26 |=============================================== IBPB .................. 2.31 |================================================ Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Inner Join Test Time Seconds < Lower Is Better off ................... 1.88 |====================================== safe RET no microcode . 2.22 |============================================= safe RET .............. 2.14 |============================================ IBPB .................. 2.41 |================================================= Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Broadcast Inner Join Test Time Seconds < Lower Is Better off ................... 1.30 |======================================= safe RET no microcode . 1.39 |========================================== safe RET .............. 1.41 |========================================== IBPB .................. 1.64 |================================================= CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 128 ops/s > Higher Is Better off ................... 103635.0 |============================================= safe RET no microcode . 100851.4 |============================================ safe RET .............. 99601.6 |=========================================== IBPB .................. 95416.0 |========================================= CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 128 ops/s > Higher Is Better off ................... 135187.2 |============================================= safe RET no microcode . 131487.0 |============================================ safe RET .............. 132046.0 |============================================ IBPB .................. 119163.8 |======================================== Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200 point/sec > Higher Is Better off ................... 960525.66 |============================================ safe RET no microcode . 947741.34 |=========================================== safe RET .............. 918691.45 |========================================== IBPB .................. 921701.44 |========================================== Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200 Average Latency < Lower Is Better off ................... 13.83 |============================================= safe RET no microcode . 14.05 |============================================== safe RET .............. 14.73 |================================================ IBPB .................. 14.78 |================================================ Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500 point/sec > Higher Is Better off ................... 1271946.57 |========================================= safe RET no microcode . 1342031.11 |=========================================== safe RET .............. 1345598.59 |=========================================== IBPB .................. 1287324.35 |========================================= Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500 Average Latency < Lower Is Better off ................... 32.36 |================================================ safe RET no microcode . 30.29 |============================================= safe RET .............. 30.14 |============================================= IBPB .................. 31.74 |=============================================== Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 point/sec > Higher Is Better off ................... 1176385.35 |====================================== safe RET no microcode . 1202637.36 |====================================== safe RET .............. 1211172.13 |======================================= IBPB .................. 1344749.20 |=========================================== Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200 Average Latency < Lower Is Better off ................... 14.05 |================================================ safe RET no microcode . 13.61 |============================================== safe RET .............. 13.36 |============================================== IBPB .................. 11.93 |========================================= Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 point/sec > Higher Is Better off ................... 1415756.33 |====================================== safe RET no microcode . 1408658.83 |====================================== safe RET .............. 1583717.62 |=========================================== IBPB .................. 1441637.63 |======================================= Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500 Average Latency < Lower Is Better off ................... 31.49 |=============================================== safe RET no microcode . 31.93 |================================================ safe RET .............. 27.73 |========================================== IBPB .................. 31.11 |=============================================== Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 point/sec > Higher Is Better off ................... 43665846.28 |======================================= safe RET no microcode . 46538766.01 |========================================== safe RET .............. 44027904.89 |======================================== IBPB .................. 44816394.74 |======================================== Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200 Average Latency < Lower Is Better off ................... 37.70 |================================================ safe RET no microcode . 35.10 |============================================= safe RET .............. 37.53 |================================================ IBPB .................. 36.47 |============================================== Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 point/sec > Higher Is Better off ................... 39463981.42 |========================================== safe RET no microcode . 37720117.40 |======================================== safe RET .............. 38833415.97 |========================================= IBPB .................. 38572529.56 |========================================= Apache IoTDB 1.1.2 Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500 Average Latency < Lower Is Better off ................... 117.97 |============================================= safe RET no microcode . 123.61 |=============================================== safe RET .............. 120.06 |============================================== IBPB .................. 120.53 |============================================== Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 point/sec > Higher Is Better off ................... 49501499.13 |========================================= safe RET no microcode . 47445770.18 |======================================= safe RET .............. 50578426.54 |========================================== IBPB .................. 49316970.28 |========================================= Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200 Average Latency < Lower Is Better off ................... 36.58 |============================================== safe RET no microcode . 38.54 |================================================ safe RET .............. 35.82 |============================================= IBPB .................. 36.56 |============================================== Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 point/sec > Higher Is Better off ................... 58682618.18 |========================================== safe RET no microcode . 58073516.79 |========================================== safe RET .............. 57099408.15 |========================================= IBPB .................. 57529201.42 |========================================= Apache IoTDB 1.1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500 Average Latency < Lower Is Better off ................... 78.92 |============================================== safe RET no microcode . 79.19 |============================================== safe RET .............. 82.24 |================================================ IBPB .................. 80.78 |=============================================== GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better off ................... 5.680 |================================================ safe RET no microcode . 5.730 |================================================ safe RET .............. 5.706 |================================================ IBPB .................. 5.707 |================================================ MariaDB 11.0.1 Clients: 4096 Queries Per Second > Higher Is Better off ................... 590 |================================================== safe RET no microcode . 412 |=================================== safe RET .............. 418 |=================================== IBPB .................. 274 |======================= MariaDB 11.0.1 Clients: 8192 Queries Per Second > Higher Is Better off ................... 355 |================================================== safe RET no microcode . 301 |========================================== safe RET .............. 301 |========================================== IBPB .................. 276 |======================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only TPS > Higher Is Better off ................... 3128719 |============================================== safe RET no microcode . 2707280 |======================================== safe RET .............. 2768445 |========================================= IBPB .................. 1733827 |========================= PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency ms < Lower Is Better off ................... 0.256 |=========================== safe RET no microcode . 0.296 |=============================== safe RET .............. 0.289 |============================== IBPB .................. 0.461 |================================================ PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write TPS > Higher Is Better off ................... 61604 |================================================ safe RET no microcode . 55175 |=========================================== safe RET .............. 54837 |=========================================== IBPB .................. 50463 |======================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency ms < Lower Is Better off ................... 12.99 |======================================= safe RET no microcode . 14.50 |============================================ safe RET .............. 14.59 |============================================ IBPB .................. 15.85 |================================================ TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 images/sec > Higher Is Better off ................... 17.78 |================================================ safe RET no microcode . 15.56 |========================================== safe RET .............. 15.65 |========================================== IBPB .................. 17.45 |=============================================== Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 37.60 |================================================ safe RET no microcode . 37.70 |================================================ safe RET .............. 37.63 |================================================ IBPB .................. 37.68 |================================================ Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 839.72 |=============================================== safe RET no microcode . 840.77 |=============================================== safe RET .............. 840.42 |=============================================== IBPB .................. 840.89 |=============================================== Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 487.25 |=============================================== safe RET no microcode . 485.01 |=============================================== safe RET .............. 487.37 |=============================================== IBPB .................. 485.68 |=============================================== Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 65.59 |================================================ safe RET no microcode . 65.89 |================================================ safe RET .............. 65.57 |================================================ IBPB .................. 65.78 |================================================ Neural Magic DeepSparse 1.5 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 468.83 |=============================================== safe RET no microcode . 468.36 |=============================================== safe RET .............. 468.22 |=============================================== IBPB .................. 467.32 |=============================================== Neural Magic DeepSparse 1.5 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 68.15 |================================================ safe RET no microcode . 68.26 |================================================ safe RET .............. 68.23 |================================================ IBPB .................. 68.35 |================================================ Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 3840.63 |============================================== safe RET no microcode . 3816.77 |============================================== safe RET .............. 3834.24 |============================================== IBPB .................. 3824.84 |============================================== Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 8.3078 |=============================================== safe RET no microcode . 8.3612 |=============================================== safe RET .............. 8.3219 |=============================================== IBPB .................. 8.3411 |=============================================== Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 46.70 |================================================ safe RET no microcode . 46.72 |================================================ safe RET .............. 46.57 |================================================ IBPB .................. 46.61 |================================================ Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 678.93 |=============================================== safe RET no microcode . 679.58 |=============================================== safe RET .............. 682.21 |=============================================== IBPB .................. 681.40 |=============================================== Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 53.60 |================================================ safe RET no microcode . 53.60 |================================================ safe RET .............. 53.57 |================================================ IBPB .................. 53.58 |================================================ Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 596.59 |=============================================== safe RET no microcode . 596.56 |=============================================== safe RET .............. 596.78 |=============================================== IBPB .................. 596.79 |=============================================== Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better off ................... 576.97 |=============================================== safe RET no microcode . 577.06 |=============================================== safe RET .............. 576.82 |=============================================== IBPB .................. 575.73 |=============================================== Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better off ................... 55.39 |================================================ safe RET no microcode . 55.37 |================================================ safe RET .............. 55.40 |================================================ IBPB .................. 55.50 |================================================ Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better off ................... 2204628.92 |=========================================== safe RET no microcode . 2218601.79 |=========================================== safe RET .............. 2145436.26 |========================================== IBPB .................. 2092844.22 |========================================= Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better off ................... 2197287.30 |=========================================== safe RET no microcode . 2167181.09 |========================================== safe RET .............. 2145052.14 |========================================== IBPB .................. 2126493.29 |========================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10 Ops/sec > Higher Is Better off ................... 2177211.80 |=========================================== safe RET no microcode . 2173694.77 |=========================================== safe RET .............. 2172804.71 |=========================================== IBPB .................. 2137964.98 |========================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10 Ops/sec > Higher Is Better off ................... 2195705.51 |=========================================== safe RET no microcode . 2154339.26 |========================================== safe RET .............. 2157815.69 |========================================== IBPB .................. 2148876.03 |========================================== Blender 3.6 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better off ................... 27.34 |=============================================== safe RET no microcode . 27.58 |================================================ safe RET .............. 27.46 |================================================ IBPB .................. 27.73 |================================================ Blender 3.6 Blend File: Pabellon Barcelona - Compute: CPU-Only Seconds < Lower Is Better off ................... 84.50 |=============================================== safe RET no microcode . 84.69 |=============================================== safe RET .............. 84.49 |=============================================== IBPB .................. 85.63 |================================================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better off ................... 7.68 |================================================= safe RET no microcode . 7.58 |================================================ safe RET .............. 7.60 |================================================ IBPB .................. 7.46 |================================================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better off ................... 4092.91 |============================================= safe RET no microcode . 4124.74 |============================================= safe RET .............. 4114.58 |============================================= IBPB .................. 4204.34 |============================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better off ................... 27.83 |================================================ safe RET no microcode . 27.79 |================================================ safe RET .............. 27.82 |================================================ IBPB .................. 27.71 |================================================ OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better off ................... 1141.43 |============================================== safe RET no microcode . 1142.29 |============================================== safe RET .............. 1142.53 |============================================== IBPB .................. 1144.98 |============================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better off ................... 1126.03 |============================================== safe RET no microcode . 1126.64 |============================================== safe RET .............. 1126.14 |============================================== IBPB .................. 1116.89 |============================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better off ................... 28.40 |================================================ safe RET no microcode . 28.38 |================================================ safe RET .............. 28.39 |================================================ IBPB .................. 28.62 |================================================ Apache Cassandra 4.1.3 Test: Writes Op/s > Higher Is Better off ................... 238741 |=============================================== safe RET no microcode . 233069 |============================================== safe RET .............. 236241 |=============================================== IBPB .................. 220814 |=========================================== RocksDB 8.0 Test: Update Random Op/s > Higher Is Better off ................... 462287 |=============================================== safe RET no microcode . 428112 |============================================ safe RET .............. 426947 |=========================================== IBPB .................. 322231 |================================= RocksDB 8.0 Test: Read Random Write Random Op/s > Higher Is Better off ................... 2951684 |============================================== safe RET no microcode . 2872765 |============================================= safe RET .............. 2839085 |============================================ IBPB .................. 2130006 |================================= nginx 1.23.2 Connections: 500 Requests Per Second > Higher Is Better off ................... 169583.15 |============================================ safe RET no microcode . 144020.03 |===================================== safe RET .............. 142619.84 |===================================== IBPB .................. 137051.69 |==================================== nginx 1.23.2 Connections: 1000 Requests Per Second > Higher Is Better off ................... 166499.89 |============================================ safe RET no microcode . 140555.98 |===================================== safe RET .............. 143271.26 |====================================== IBPB .................. 135431.46 |==================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 - Calculate Pi Benchmark Using Dataframe Seconds < Lower Is Better IBPB . 2.60 |==================================================================