9654 new 2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite. a: Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200 b: Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200 c: Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200 no smt a: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768 no smt b: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768 smt a: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768 smt b: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768 smt c: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768 smt d: Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768 RocksDB 7.9.2 Test: Sequential Fill Op/s > Higher Is Better a ........ 542256 |============================================================ b ........ 545396 |============================================================ c ........ 544565 |============================================================ no smt a . 465700 |=================================================== no smt b . 464044 |=================================================== smt a .... 414168 |============================================== smt b .... 413708 |============================================== smt c .... 414282 |============================================== smt d .... 414047 |============================================== OpenVKL 1.3.1 Benchmark: vklBenchmark Scalar Items / Sec > Higher Is Better a ........ 556 |=========================================== b ........ 557 |=========================================== c ........ 549 |=========================================== no smt a . 647 |================================================== no smt b . 652 |=================================================== smt a .... 764 |=========================================================== smt b .... 810 |=============================================================== smt c .... 793 |============================================================== smt d .... 781 |============================================================= OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC Items / Sec > Higher Is Better a ........ 1089 |=================================================== b ........ 1075 |=================================================== c ........ 1066 |================================================== no smt a . 1098 |==================================================== no smt b . 1108 |==================================================== smt a .... 1318 |============================================================== smt b .... 1243 |========================================================== smt c .... 1235 |========================================================== smt d .... 1238 |========================================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better a ........ 625.16 |======================================================== b ........ 628.37 |========================================================= c ........ 636.18 |========================================================= no smt a . 665.00 |============================================================ no smt b . 662.01 |============================================================ smt a .... 534.82 |================================================ smt b .... 538.63 |================================================= smt c .... 530.47 |================================================ smt d .... 527.80 |================================================ ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better a ........ 625.91 |======================================================== b ........ 627.20 |======================================================== c ........ 621.88 |======================================================== no smt a . 666.43 |============================================================ no smt b . 649.52 |========================================================== smt a .... 524.04 |=============================================== smt b .... 527.88 |================================================ smt c .... 524.75 |=============================================== smt d .... 515.11 |============================================== ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better a ........ 600.70 |========================================================= b ........ 610.79 |========================================================== c ........ 614.24 |========================================================== no smt a . 635.48 |============================================================ no smt b . 622.73 |=========================================================== smt a .... 500.13 |=============================================== smt b .... 516.09 |================================================= smt c .... 495.85 |=============================================== smt d .... 500.12 |=============================================== Timed Linux Kernel Compilation 6.1 Build: allmodconfig Seconds < Lower Is Better VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ........ 7.68 |============================================================== b ........ 7.71 |============================================================== c ........ 7.70 |============================================================== no smt a . 7.04 |========================================================= no smt b . 7.16 |========================================================== smt a .... 7.24 |========================================================== smt b .... 6.97 |======================================================== smt c .... 6.92 |======================================================== smt d .... 7.15 |========================================================= oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 671.69 |============ b ........ 670.20 |============ c ........ 671.23 |============ no smt a . 913.20 |================ no smt b . 903.36 |================ smt a .... 3269.05 |=========================================================== smt b .... 3249.28 |=========================================================== smt c .... 3153.22 |========================================================= smt d .... 3171.15 |========================================================= oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 675.92 |============ b ........ 668.95 |============ c ........ 667.95 |============ no smt a . 973.32 |================== no smt b . 939.55 |================= smt a .... 3133.65 |========================================================= smt b .... 3222.93 |=========================================================== smt c .... 3185.64 |========================================================== smt d .... 3172.19 |========================================================== oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 674.09 |============ b ........ 671.65 |============ c ........ 669.15 |============ no smt a . 930.26 |================ no smt b . 901.04 |================ smt a .... 3187.00 |======================================================== smt b .... 3034.62 |===================================================== smt c .... 3011.21 |===================================================== smt d .... 3349.36 |=========================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 907.49 |=========================== b ........ 903.27 |=========================== c ........ 906.14 |=========================== no smt a . 1148.26 |=================================== no smt b . 1124.75 |================================== smt a .... 1912.16 |========================================================== smt b .... 1890.28 |========================================================= smt c .... 1888.21 |========================================================= smt d .... 1957.77 |=========================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 909.69 |============================ b ........ 917.08 |============================ c ........ 911.76 |============================ no smt a . 1147.34 |=================================== no smt b . 1139.63 |=================================== smt a .... 1888.10 |========================================================== smt b .... 1894.07 |========================================================== smt c .... 1925.68 |=========================================================== smt d .... 1912.74 |=========================================================== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 911.25 |============================ b ........ 912.11 |============================ c ........ 915.08 |============================ no smt a . 1151.25 |=================================== no smt b . 1119.17 |================================== smt a .... 1830.41 |======================================================== smt b .... 1937.65 |=========================================================== smt c .... 1926.15 |=========================================================== smt d .... 1883.76 |========================================================= Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better a ........ 1383.7 |=========================================================== b ........ 1378.2 |=========================================================== c ........ 1384.0 |=========================================================== no smt a . 1395.8 |============================================================ no smt b . 1397.6 |============================================================ smt a .... 1393.5 |============================================================ smt b .... 1392.4 |============================================================ smt c .... 1389.0 |============================================================ smt d .... 1391.7 |============================================================ Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better a ........ 9.22 |========================================================== b ........ 9.29 |========================================================== c ........ 9.30 |========================================================== no smt a . 9.39 |=========================================================== no smt b . 9.76 |============================================================= smt a .... 9.78 |============================================================= smt b .... 9.87 |============================================================== smt c .... 9.82 |============================================================== smt d .... 9.81 |============================================================== Memcached 1.6.18 Set To Get Ratio: 1:100 Ops/sec > Higher Is Better a ........ 4878860.00 |======================================================== b ........ 4876951.36 |======================================================== c ........ 4852421.67 |======================================================== no smt a . 3192061.68 |===================================== no smt b . 3216133.91 |===================================== smt a .... 4383314.65 |================================================== smt b .... 4357453.76 |================================================== smt c .... 4394194.49 |================================================== smt d .... 4403267.42 |=================================================== Memcached 1.6.18 Set To Get Ratio: 1:10 Ops/sec > Higher Is Better a ........ 6861088.89 |======================================================== b ........ 6792746.34 |======================================================= c ........ 6839975.87 |======================================================== no smt a . 4244908.83 |=================================== no smt b . 4220522.49 |================================== smt a .... 4530948.62 |===================================== smt b .... 4392934.75 |==================================== smt c .... 4549313.42 |===================================== smt d .... 4569476.86 |===================================== Memcached 1.6.18 Set To Get Ratio: 1:5 Ops/sec > Higher Is Better a ........ 4143044.21 |======================================================== b ........ 4162812.47 |======================================================== c ........ 4155273.46 |======================================================== no smt a . 2444886.82 |================================= no smt b . 2460416.33 |================================= smt a .... 2520253.00 |================================== smt b .... 2507331.29 |================================== smt c .... 2517750.47 |================================== smt d .... 2527084.87 |================================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a ........ 962.10 |============================================================ b ........ 962.63 |============================================================ c ........ 962.15 |============================================================ no smt a . 438.29 |=========================== no smt b . 438.99 |=========================== smt a .... 439.41 |=========================== smt b .... 439.50 |=========================== smt c .... 437.51 |=========================== smt d .... 437.68 |=========================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a ........ 49.72 |=========================== b ........ 49.72 |=========================== c ........ 49.77 |=========================== no smt a . 109.08 |============================================================ no smt b . 109.04 |============================================================ smt a .... 108.93 |============================================================ smt b .... 108.89 |============================================================ smt c .... 109.36 |============================================================ smt d .... 109.23 |============================================================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a ........ 1671.46 |=========================================================== b ........ 1675.96 |=========================================================== c ........ 1679.03 |=========================================================== no smt a . 828.67 |============================= no smt b . 830.04 |============================= smt a .... 827.07 |============================= smt b .... 827.03 |============================= smt c .... 821.93 |============================= smt d .... 822.50 |============================= OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a ........ 28.47 |============================== b ........ 28.42 |============================== c ........ 28.33 |============================== no smt a . 57.58 |============================================================= no smt b . 57.49 |============================================================ smt a .... 57.72 |============================================================= smt b .... 57.67 |============================================================= smt c .... 58.05 |============================================================= smt d .... 58.00 |============================================================= OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a ........ 499.32 |============================================================ b ........ 500.83 |============================================================ c ........ 500.30 |============================================================ no smt a . 229.46 |=========================== no smt b . 228.01 |=========================== smt a .... 230.21 |============================ smt b .... 230.06 |============================ smt c .... 227.93 |=========================== smt d .... 228.94 |=========================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a ........ 95.76 |=========================== b ........ 95.48 |=========================== c ........ 95.59 |=========================== no smt a . 208.82 |============================================================ no smt b . 210.14 |============================================================ smt a .... 208.13 |=========================================================== smt b .... 208.19 |=========================================================== smt c .... 210.19 |============================================================ smt d .... 209.24 |============================================================ OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a ........ 1701.70 |=========================================================== b ........ 1685.26 |========================================================== c ........ 1704.02 |=========================================================== no smt a . 833.99 |============================= no smt b . 834.17 |============================= smt a .... 833.15 |============================= smt b .... 832.70 |============================= smt c .... 826.67 |============================= smt d .... 828.01 |============================= OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a ........ 27.97 |============================== b ........ 28.23 |============================== c ........ 27.89 |============================= no smt a . 57.18 |============================================================ no smt b . 57.19 |============================================================ smt a .... 57.29 |============================================================= smt b .... 57.31 |============================================================= smt c .... 57.71 |============================================================= smt d .... 57.62 |============================================================= Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 319.98 |============================================================ b ........ 319.96 |============================================================ c ........ 320.05 |============================================================ no smt a . 304.21 |========================================================= no smt b . 303.74 |========================================================= smt a .... 303.33 |========================================================= smt b .... 304.08 |========================================================= smt c .... 303.25 |========================================================= smt d .... 301.92 |========================================================= Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 149.74 |============================ b ........ 149.82 |============================ c ........ 149.69 |============================ no smt a . 308.43 |=========================================================== no smt b . 308.30 |=========================================================== smt a .... 314.62 |============================================================ smt b .... 314.25 |============================================================ smt c .... 315.33 |============================================================ smt d .... 316.03 |============================================================ Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better a ........ 1472.6 |=========================================================== b ........ 1467.8 |=========================================================== c ........ 1470.5 |=========================================================== no smt a . 1483.1 |============================================================ no smt b . 1483.8 |============================================================ smt a .... 1495.2 |============================================================ smt b .... 1483.5 |============================================================ smt c .... 1475.2 |=========================================================== smt d .... 1479.1 |=========================================================== Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed MB/s > Higher Is Better a ........ 19.1 |============================================================ b ........ 19.1 |============================================================ c ........ 19.1 |============================================================ no smt a . 19.8 |============================================================== no smt b . 19.8 |============================================================== smt a .... 18.8 |=========================================================== smt b .... 19.5 |============================================================= smt c .... 19.2 |============================================================ smt d .... 19.6 |============================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 1115.76 |=========================================================== b ........ 1118.44 |=========================================================== c ........ 1122.06 |=========================================================== no smt a . 955.16 |================================================== no smt b . 955.24 |================================================== smt a .... 972.52 |=================================================== smt b .... 975.50 |=================================================== smt c .... 971.90 |=================================================== smt d .... 974.99 |=================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 42.99 |=========================== b ........ 42.90 |=========================== c ........ 42.74 |=========================== no smt a . 97.44 |============================================================= no smt b . 97.38 |============================================================= smt a .... 97.02 |============================================================= smt b .... 96.91 |============================================================= smt c .... 97.00 |============================================================= smt d .... 96.72 |============================================================= OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a ........ 8.34 |============================================================== b ........ 8.38 |============================================================== c ........ 8.37 |============================================================== no smt a . 4.90 |==================================== no smt b . 4.91 |==================================== smt a .... 4.92 |==================================== smt b .... 4.95 |===================================== smt c .... 4.90 |==================================== smt d .... 4.91 |==================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a ........ 5750.74 |=================================== b ........ 5720.90 |================================== c ........ 5724.81 |=================================== no smt a . 9784.09 |=========================================================== no smt b . 9758.74 |=========================================================== smt a .... 9746.08 |=========================================================== smt b .... 9680.44 |========================================================== smt c .... 9773.26 |=========================================================== smt d .... 9767.99 |=========================================================== Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Decompression Speed MB/s > Higher Is Better a ........ 1677.9 |============================================================ b ........ 1673.7 |============================================================ c ........ 1675.4 |============================================================ no smt a . 1684.8 |============================================================ no smt b . 1682.8 |============================================================ smt a .... 1682.5 |============================================================ smt b .... 1676.5 |============================================================ smt c .... 1683.7 |============================================================ smt d .... 1677.6 |============================================================ Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Compression Speed MB/s > Higher Is Better a ........ 938.5 |============================================================= b ........ 910.8 |=========================================================== c ........ 926.9 |============================================================ no smt a . 859.9 |======================================================== no smt b . 892.0 |========================================================== smt a .... 853.8 |======================================================= smt b .... 852.7 |======================================================= smt c .... 860.8 |======================================================== smt d .... 879.6 |========================================================= Zstd Compression 1.5.4 Compression Level: 12 - Decompression Speed MB/s > Higher Is Better a ........ 1704.8 |=========================================================== b ........ 1716.7 |=========================================================== c ........ 1715.6 |=========================================================== no smt a . 1728.0 |============================================================ no smt b . 1727.8 |============================================================ smt a .... 1723.7 |============================================================ smt b .... 1726.3 |============================================================ smt c .... 1732.3 |============================================================ smt d .... 1731.2 |============================================================ Zstd Compression 1.5.4 Compression Level: 12 - Compression Speed MB/s > Higher Is Better a ........ 330.8 |============================================================= b ........ 332.0 |============================================================= c ........ 330.1 |============================================================= no smt a . 279.9 |=================================================== no smt b . 278.2 |=================================================== smt a .... 254.1 |=============================================== smt b .... 259.1 |================================================ smt c .... 249.8 |============================================== smt d .... 256.2 |=============================================== Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Decompression Speed MB/s > Higher Is Better a ........ 1536.6 |============================================================ b ........ 1537.5 |============================================================ c ........ 1540.9 |============================================================ no smt a . 1542.5 |============================================================ no smt b . 1538.8 |============================================================ smt a .... 1539.5 |============================================================ smt b .... 1540.4 |============================================================ smt c .... 1540.9 |============================================================ smt d .... 1543.6 |============================================================ Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Compression Speed MB/s > Higher Is Better a ........ 892.7 |=================================================== b ........ 909.4 |==================================================== c ........ 916.9 |==================================================== no smt a . 955.6 |====================================================== no smt b . 1032.3 |========================================================== smt a .... 1051.4 |============================================================ smt b .... 1038.9 |=========================================================== smt c .... 1046.6 |=========================================================== smt d .... 1059.0 |============================================================ Zstd Compression 1.5.4 Compression Level: 8 - Decompression Speed MB/s > Higher Is Better a ........ 1669.3 |============================================================ b ........ 1651.0 |=========================================================== c ........ 1661.9 |============================================================ no smt a . 1669.7 |============================================================ no smt b . 1667.6 |============================================================ smt a .... 1664.3 |============================================================ smt b .... 1671.0 |============================================================ smt c .... 1664.0 |============================================================ smt d .... 1664.2 |============================================================ Zstd Compression 1.5.4 Compression Level: 8 - Compression Speed MB/s > Higher Is Better a ........ 1233.8 |============================================================ b ........ 1239.3 |============================================================ c ........ 1241.1 |============================================================ no smt a . 1227.5 |=========================================================== no smt b . 1234.2 |============================================================ smt a .... 1023.9 |================================================= smt b .... 1122.4 |====================================================== smt c .... 1005.8 |================================================= smt d .... 1024.8 |================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a ........ 88.71 |============================================================ b ........ 88.61 |============================================================ c ........ 89.46 |============================================================= no smt a . 45.86 |=============================== no smt b . 45.73 |=============================== smt a .... 45.71 |=============================== smt b .... 45.66 |=============================== smt c .... 45.31 |=============================== smt d .... 45.34 |=============================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a ........ 540.41 |============================== b ........ 541.03 |============================== c ........ 535.78 |============================== no smt a . 1045.81 |========================================================== no smt b . 1048.74 |========================================================== smt a .... 1049.16 |========================================================== smt b .... 1050.37 |=========================================================== smt c .... 1058.57 |=========================================================== smt d .... 1057.74 |=========================================================== Zstd Compression 1.5.4 Compression Level: 3 - Decompression Speed MB/s > Higher Is Better a ........ 1514.8 |============================================================ b ........ 1516.6 |============================================================ c ........ 1517.4 |============================================================ no smt a . 1500.4 |=========================================================== no smt b . 1511.5 |============================================================ smt a .... 1515.6 |============================================================ smt b .... 1519.1 |============================================================ smt c .... 1516.2 |============================================================ smt d .... 1513.5 |============================================================ Zstd Compression 1.5.4 Compression Level: 3 - Compression Speed MB/s > Higher Is Better a ........ 3033.9 |=========================================================== b ........ 3095.0 |============================================================ c ........ 3049.4 |=========================================================== no smt a . 2804.2 |====================================================== no smt b . 2865.9 |======================================================== smt a .... 2795.1 |====================================================== smt b .... 2513.4 |================================================= smt c .... 2604.6 |================================================== smt d .... 2528.7 |================================================= OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a ........ 10.10 |============================================================= b ........ 10.10 |============================================================= c ........ 10.11 |============================================================= no smt a . 9.18 |======================================================= no smt b . 9.18 |======================================================= smt a .... 9.28 |======================================================== smt b .... 9.28 |======================================================== smt c .... 9.25 |======================================================== smt d .... 9.26 |======================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a ........ 9494.22 |========================== b ........ 9496.95 |========================== c ........ 9485.65 |========================== no smt a . 20836.10 |========================================================== no smt b . 20849.75 |========================================================== smt a .... 20610.23 |========================================================= smt b .... 20610.62 |========================================================= smt c .... 20684.29 |========================================================== smt d .... 20679.68 |========================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a ........ 0.65 |============================================================= b ........ 0.66 |============================================================== c ........ 0.66 |============================================================== no smt a . 0.57 |====================================================== no smt b . 0.58 |====================================================== smt a .... 0.53 |================================================== smt b .... 0.53 |================================================== smt c .... 0.53 |================================================== smt d .... 0.53 |================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a ........ 112346.36 |==================================== b ........ 111378.39 |==================================== c ........ 112186.25 |==================================== no smt a . 160545.41 |==================================================== no smt b . 162294.47 |===================================================== smt a .... 173926.92 |======================================================== smt b .... 175754.35 |========================================================= smt c .... 173620.31 |======================================================== smt d .... 172228.34 |======================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a ........ 1.09 |============================================================== b ........ 1.09 |============================================================== c ........ 1.09 |============================================================== no smt a . 1.01 |========================================================= no smt b . 1.01 |========================================================= smt a .... 0.97 |======================================================= smt b .... 0.97 |======================================================= smt c .... 0.96 |======================================================= smt d .... 0.97 |======================================================= OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a ........ 74495.17 |============================ b ........ 74353.41 |============================ c ........ 74486.08 |============================ no smt a . 127833.52 |================================================= no smt b . 127770.39 |================================================= smt a .... 148316.88 |======================================================== smt b .... 147582.87 |======================================================== smt c .... 148047.13 |======================================================== smt d .... 149647.68 |========================================================= OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a ........ 8.11 |============================================================== b ........ 8.13 |============================================================== c ........ 8.13 |============================================================== no smt a . 3.95 |============================== no smt b . 3.95 |============================== smt a .... 3.95 |============================== smt b .... 3.96 |============================== smt c .... 3.93 |============================== smt d .... 3.93 |============================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a ........ 5908.89 |============================ b ........ 5894.27 |============================ c ........ 5898.79 |============================ no smt a . 12119.66 |========================================================== no smt b . 12128.38 |========================================================== smt a .... 12117.16 |========================================================== smt b .... 12109.64 |========================================================== smt c .... 12168.05 |========================================================== smt d .... 12172.92 |========================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a ........ 16.30 |============================================================= b ........ 15.54 |========================================================== c ........ 15.10 |========================================================= no smt a . 6.01 |====================== no smt b . 6.01 |====================== smt a .... 6.02 |======================= smt b .... 6.03 |======================= smt c .... 5.99 |====================== smt d .... 6.00 |====================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a ........ 2941.47 |====================== b ........ 3085.53 |======================= c ........ 3174.04 |======================= no smt a . 7979.05 |=========================================================== no smt b . 7979.82 |=========================================================== smt a .... 7953.21 |=========================================================== smt b .... 7949.05 |=========================================================== smt c .... 7993.18 |=========================================================== smt d .... 7990.47 |=========================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a ........ 9.76 |============================================================== b ........ 9.75 |============================================================== c ........ 9.76 |============================================================== no smt a . 4.54 |============================= no smt b . 4.54 |============================= smt a .... 4.54 |============================= smt b .... 4.54 |============================= smt c .... 4.52 |============================= smt d .... 4.52 |============================= OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a ........ 4914.17 |=========================== b ........ 4915.42 |=========================== c ........ 4910.13 |=========================== no smt a . 10556.93 |========================================================== no smt b . 10549.24 |========================================================== smt a .... 10544.03 |========================================================== smt b .... 10549.15 |========================================================== smt c .... 10603.84 |========================================================== smt d .... 10587.30 |========================================================== RocksDB 7.9.2 Test: Random Fill Op/s > Higher Is Better a ........ 533927 |============================================================ b ........ 534681 |============================================================ c ........ 536551 |============================================================ no smt a . 478629 |====================================================== no smt b . 468210 |==================================================== smt a .... 423027 |=============================================== smt b .... 417882 |=============================================== smt c .... 416006 |=============================================== smt d .... 415428 |============================================== RocksDB 7.9.2 Test: Update Random Op/s > Higher Is Better a ........ 544384 |============================================================ b ........ 545556 |============================================================ c ........ 543572 |============================================================ no smt a . 462018 |=================================================== no smt b . 452228 |================================================== smt a .... 413199 |============================================= smt b .... 411513 |============================================= smt c .... 419985 |============================================== smt d .... 420514 |============================================== RocksDB 7.9.2 Test: Random Fill Sync Op/s > Higher Is Better a ........ 376601 |======================================================== b ........ 373002 |======================================================= c ........ 356922 |===================================================== no smt a . 350673 |==================================================== no smt b . 344040 |=================================================== smt a .... 388052 |========================================================== smt b .... 401295 |============================================================ smt c .... 394852 |=========================================================== smt d .... 404463 |============================================================ RocksDB 7.9.2 Test: Read Random Write Random Op/s > Higher Is Better a ........ 2926458 |=========================================================== b ........ 2891962 |========================================================== c ........ 2910023 |=========================================================== no smt a . 2079804 |========================================== no smt b . 2063831 |========================================== smt a .... 1787682 |==================================== smt b .... 1761416 |==================================== smt c .... 1613913 |================================= smt d .... 1752904 |=================================== RocksDB 7.9.2 Test: Read While Writing Op/s > Higher Is Better a ........ 9296185 |=================================== b ........ 8620352 |================================= c ........ 8316379 |=============================== no smt a . 7643831 |============================= no smt b . 7913568 |============================== smt a .... 15317250 |========================================================== smt b .... 13830689 |==================================================== smt c .... 13948914 |===================================================== smt d .... 13098097 |================================================== RocksDB 7.9.2 Test: Random Read Op/s > Higher Is Better a ........ 468231434 |===================== b ........ 466888888 |===================== c ........ 468069792 |===================== no smt a . 1209611055 |======================================================= no smt b . 1213540299 |======================================================= smt a .... 1225662852 |======================================================== smt b .... 1231168093 |======================================================== smt c .... 1234570512 |======================================================== smt d .... 1231916197 |======================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 1116.43 |=========================================================== b ........ 1116.29 |=========================================================== c ........ 1117.73 |=========================================================== no smt a . 956.01 |================================================== no smt b . 955.34 |================================================== smt a .... 970.22 |=================================================== smt b .... 969.21 |=================================================== smt c .... 971.67 |=================================================== smt d .... 966.76 |=================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 42.96 |=========================== b ........ 42.83 |=========================== c ........ 42.92 |=========================== no smt a . 97.40 |============================================================= no smt b . 97.34 |============================================================= smt a .... 97.29 |============================================================= smt b .... 97.35 |============================================================= smt c .... 96.91 |============================================================ smt d .... 97.89 |============================================================= VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better a ........ 5.820 |============================================================ b ........ 5.809 |============================================================ c ........ 5.808 |============================================================ no smt a . 5.890 |============================================================= no smt b . 5.895 |============================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 152.14 |============================================================ b ........ 151.60 |============================================================ c ........ 151.39 |============================================================ no smt a . 145.35 |========================================================= no smt b . 145.36 |========================================================= smt a .... 145.40 |========================================================= smt b .... 145.27 |========================================================= smt c .... 144.47 |========================================================= smt d .... 144.91 |========================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 314.84 |============================= b ........ 316.29 |============================= c ........ 316.63 |============================= no smt a . 649.30 |=========================================================== no smt b . 647.76 |=========================================================== smt a .... 658.21 |============================================================ smt b .... 658.34 |============================================================ smt c .... 662.26 |============================================================ smt d .... 660.21 |============================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 30.59 |============================================================= b ........ 30.46 |============================================================ c ........ 30.49 |============================================================ no smt a . 30.42 |============================================================ no smt b . 30.64 |============================================================= smt a .... 30.75 |============================================================= smt b .... 30.75 |============================================================= smt c .... 30.58 |============================================================= smt d .... 30.72 |============================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 1566.56 |============================== b ........ 1573.75 |============================== c ........ 1571.83 |============================== no smt a . 3107.30 |=========================================================== no smt b . 3086.36 |========================================================== smt a .... 3114.68 |=========================================================== smt b .... 3114.43 |=========================================================== smt c .... 3132.38 |=========================================================== smt d .... 3116.09 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 119.21 |============================================================ b ........ 119.38 |============================================================ c ........ 119.70 |============================================================ no smt a . 116.15 |========================================================== no smt b . 115.64 |========================================================== smt a .... 117.12 |=========================================================== smt b .... 116.48 |========================================================== smt c .... 116.97 |=========================================================== smt d .... 117.22 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 401.78 |============================= b ........ 401.21 |============================= c ........ 400.04 |============================= no smt a . 813.98 |=========================================================== no smt b . 817.63 |============================================================ smt a .... 817.75 |============================================================ smt b .... 822.16 |============================================================ smt c .... 818.60 |============================================================ smt d .... 816.76 |============================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 11.36 |============================================== b ........ 11.19 |============================================= c ........ 11.16 |============================================= no smt a . 14.46 |========================================================== no smt b . 14.42 |========================================================== smt a .... 13.64 |======================================================= smt b .... 14.64 |=========================================================== smt c .... 14.20 |========================================================= smt d .... 15.13 |============================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 87.96 |============================================================ b ........ 89.34 |============================================================= c ........ 89.55 |============================================================= no smt a . 69.11 |=============================================== no smt b . 69.33 |=============================================== smt a .... 73.29 |================================================== smt b .... 68.29 |=============================================== smt c .... 70.38 |================================================ smt d .... 66.08 |============================================= Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 5.0715 |===================================================== b ........ 5.0859 |====================================================== c ........ 5.0573 |===================================================== no smt a . 5.2262 |======================================================= no smt b . 5.7015 |============================================================ smt a .... 5.3004 |======================================================== smt b .... 5.3053 |======================================================== smt c .... 5.2773 |======================================================== smt d .... 5.4341 |========================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 197.10 |============================================================ b ........ 196.54 |============================================================ c ........ 197.66 |============================================================ no smt a . 191.26 |========================================================== no smt b . 175.32 |===================================================== smt a .... 188.58 |========================================================= smt b .... 188.41 |========================================================= smt c .... 189.41 |========================================================= smt d .... 183.95 |======================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 28.71 |==================================================== b ........ 28.49 |==================================================== c ........ 28.47 |==================================================== no smt a . 31.33 |========================================================= no smt b . 33.60 |============================================================= smt a .... 31.48 |========================================================= smt b .... 31.46 |========================================================= smt c .... 31.31 |========================================================= smt d .... 33.05 |============================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 34.83 |============================================================ b ........ 35.10 |============================================================= c ........ 35.12 |============================================================= no smt a . 31.91 |======================================================= no smt b . 29.75 |==================================================== smt a .... 31.76 |======================================================= smt b .... 31.78 |======================================================= smt c .... 31.93 |======================================================= smt d .... 30.25 |===================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 77.34 |============================================================= b ........ 77.31 |============================================================= c ........ 76.62 |============================================================ no smt a . 73.20 |========================================================== no smt b . 73.21 |========================================================== smt a .... 73.31 |========================================================== smt b .... 73.35 |========================================================== smt c .... 73.34 |========================================================== smt d .... 73.62 |========================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 619.75 |============================ b ........ 619.94 |============================ c ........ 625.55 |============================ no smt a . 1291.97 |========================================================== no smt b . 1292.80 |========================================================== smt a .... 1306.67 |=========================================================== smt b .... 1306.58 |=========================================================== smt c .... 1305.71 |=========================================================== smt d .... 1301.18 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 28.62 |=================================================== b ........ 28.71 |==================================================== c ........ 28.57 |=================================================== no smt a . 31.92 |========================================================= no smt b . 32.18 |========================================================== smt a .... 32.30 |========================================================== smt b .... 32.24 |========================================================== smt c .... 33.99 |============================================================= smt d .... 32.18 |========================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 34.93 |============================================================= b ........ 34.82 |============================================================= c ........ 34.99 |============================================================= no smt a . 31.32 |======================================================= no smt b . 31.07 |====================================================== smt a .... 30.96 |====================================================== smt b .... 31.01 |====================================================== smt c .... 29.42 |=================================================== smt d .... 31.07 |====================================================== VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ........ 14.69 |============================================================= b ........ 14.67 |============================================================= c ........ 14.76 |============================================================= no smt a . 14.28 |=========================================================== no smt b . 13.72 |========================================================= smt a .... 14.08 |========================================================== smt b .... 13.57 |======================================================== smt c .... 13.97 |========================================================== smt d .... 13.68 |========================================================= Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 16.58 |=============================================== b ........ 16.67 |=============================================== c ........ 16.52 |============================================== no smt a . 20.74 |========================================================== no smt b . 20.42 |========================================================= smt a .... 21.03 |=========================================================== smt b .... 21.74 |============================================================= smt c .... 20.49 |========================================================= smt d .... 21.36 |============================================================ Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 60.25 |============================================================= b ........ 59.92 |============================================================ c ........ 60.49 |============================================================= no smt a . 48.18 |================================================= no smt b . 48.93 |================================================= smt a .... 47.51 |================================================ smt b .... 45.96 |============================================== smt c .... 48.77 |================================================= smt d .... 46.78 |=============================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 47.46 |============================================================= b ........ 47.35 |============================================================= c ........ 47.29 |============================================================= no smt a . 42.81 |======================================================= no smt b . 42.84 |======================================================= smt a .... 42.95 |======================================================= smt b .... 42.65 |======================================================= smt c .... 42.55 |======================================================= smt d .... 42.48 |======================================================= Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 1009.85 |========================== b ........ 1012.35 |========================== c ........ 1013.74 |=========================== no smt a . 2204.75 |========================================================== no smt b . 2203.16 |========================================================== smt a .... 2230.31 |========================================================== smt b .... 2245.80 |=========================================================== smt c .... 2253.14 |=========================================================== smt d .... 2255.42 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ........ 108.68 |============================================================ b ........ 109.11 |============================================================ c ........ 109.25 |============================================================ no smt a . 100.24 |======================================================= no smt b . 100.42 |======================================================= smt a .... 103.09 |========================================================= smt b .... 103.19 |========================================================= smt c .... 102.10 |======================================================== smt d .... 102.76 |======================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ........ 440.85 |============================ b ........ 439.04 |============================ c ........ 438.44 |============================ no smt a . 941.24 |============================================================ no smt b . 938.91 |============================================================ smt a .... 929.02 |=========================================================== smt b .... 927.68 |=========================================================== smt c .... 937.99 |============================================================ smt d .... 931.82 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 10.08 |=========================================== b ........ 10.14 |=========================================== c ........ 10.14 |=========================================== no smt a . 13.86 |=========================================================== no smt b . 13.90 |============================================================ smt a .... 12.83 |======================================================= smt b .... 12.91 |======================================================= smt c .... 14.25 |============================================================= smt d .... 13.23 |========================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 99.15 |============================================================= b ........ 98.62 |============================================================= c ........ 98.59 |============================================================= no smt a . 72.13 |============================================ no smt b . 71.89 |============================================ smt a .... 77.88 |================================================ smt b .... 77.41 |================================================ smt c .... 70.14 |=========================================== smt d .... 75.52 |============================================== VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ........ 17.36 |============================================================= b ........ 17.37 |============================================================= c ........ 17.46 |============================================================= no smt a . 14.48 |=================================================== no smt b . 14.50 |=================================================== smt a .... 13.90 |================================================= smt b .... 14.27 |================================================== smt c .... 15.38 |====================================================== smt d .... 15.11 |===================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 5.1812 |========================================= b ........ 5.1633 |========================================= c ........ 5.1696 |========================================= no smt a . 7.5856 |============================================================ no smt b . 6.4174 |=================================================== smt a .... 7.5225 |============================================================ smt b .... 6.8844 |====================================================== smt c .... 7.3550 |========================================================== smt d .... 7.0640 |======================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 192.88 |============================================================ b ........ 193.53 |============================================================ c ........ 193.31 |============================================================ no smt a . 131.76 |========================================= no smt b . 155.74 |================================================ smt a .... 132.87 |========================================= smt b .... 145.17 |============================================= smt c .... 135.89 |========================================== smt d .... 141.47 |============================================ Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 9.5962 |======================================================= b ........ 9.5793 |====================================================== c ........ 8.8004 |================================================== no smt a . 9.8899 |======================================================== no smt b . 9.9395 |======================================================== smt a .... 8.1914 |=============================================== smt b .... 8.3506 |=============================================== smt c .... 10.3852 |=========================================================== smt d .... 9.3656 |===================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 104.12 |=================================================== b ........ 104.29 |=================================================== c ........ 113.51 |======================================================== no smt a . 101.01 |================================================== no smt b . 100.51 |================================================= smt a .... 121.92 |============================================================ smt b .... 119.60 |=========================================================== smt c .... 96.17 |=============================================== smt d .... 106.65 |==================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ........ 5.3018 |============================================ b ........ 5.4980 |============================================= c ........ 5.5007 |============================================= no smt a . 6.0118 |================================================= no smt b . 6.0650 |================================================== smt a .... 7.1865 |=========================================================== smt b .... 7.3054 |============================================================ smt c .... 6.1057 |================================================== smt d .... 7.1490 |=========================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ........ 188.54 |============================================================ b ........ 181.81 |========================================================== c ........ 181.72 |========================================================== no smt a . 166.27 |===================================================== no smt b . 164.81 |==================================================== smt a .... 139.10 |============================================ smt b .... 136.83 |============================================ smt c .... 163.71 |==================================================== smt d .... 139.82 |============================================ Stress-NG 0.15.04 Test: Pthread Bogo Ops/s > Higher Is Better a ........ 109397.78 |=================================== b ........ 109356.78 |=================================== c ........ 109609.15 |=================================== no smt a . 68076.03 |====================== no smt b . 67451.30 |===================== smt a .... 74978.51 |======================== smt b .... 180407.59 |========================================================= smt c .... 77834.39 |========================= smt d .... 91735.75 |============================= Stress-NG 0.15.04 Test: Atomic Bogo Ops/s > Higher Is Better a ........ 174.72 |========================== b ........ 223.29 |================================= c ........ 183.33 |=========================== no smt a . 400.03 |============================================================ no smt b . 395.95 |=========================================================== smt a .... 184.34 |============================ smt b .... 186.64 |============================ smt c .... 184.24 |============================ smt d .... 182.80 |=========================== Stress-NG 0.15.04 Test: NUMA Bogo Ops/s > Higher Is Better a ........ 483.90 |========================================================== b ........ 498.67 |============================================================ c ........ 478.05 |========================================================== no smt a . 20.51 |== no smt b . 19.78 |== smt a .... 24.82 |=== smt b .... 24.77 |=== smt c .... 24.79 |=== smt d .... 24.71 |=== Stress-NG 0.15.04 Test: Context Switching Bogo Ops/s > Higher Is Better a ........ 18941003.97 |====================== b ........ 16313126.86 |=================== c ........ 16862185.54 |==================== no smt a . 47222624.49 |======================================================= no smt b . 44683906.68 |==================================================== smt a .... 12895047.73 |=============== smt b .... 12221058.34 |============== smt c .... 12328933.65 |============== smt d .... 12728401.45 |=============== Stress-NG 0.15.04 Test: Forking Bogo Ops/s > Higher Is Better a ........ 58156.36 |==================================================== b ........ 58664.97 |===================================================== c ........ 64299.62 |========================================================== no smt a . 43094.96 |======================================= no smt b . 45685.28 |========================================= smt a .... 36266.02 |================================= smt b .... 36020.16 |================================ smt c .... 34917.39 |=============================== smt d .... 34685.85 |=============================== Stress-NG 0.15.04 Test: Semaphores Bogo Ops/s > Higher Is Better a ........ 18128283.29 |================================================== b ........ 18100474.36 |================================================== c ........ 18088584.67 |================================================== no smt a . 13141129.68 |==================================== no smt b . 13192391.85 |==================================== smt a .... 20047519.05 |======================================================= smt b .... 19927313.52 |======================================================= smt c .... 19866440.86 |======================================================= smt d .... 19842969.28 |====================================================== Stress-NG 0.15.04 Test: Crypto Bogo Ops/s > Higher Is Better a ........ 203073.15 |========================= b ........ 203147.15 |========================= c ........ 203095.44 |========================= no smt a . 435615.35 |===================================================== no smt b . 437065.75 |===================================================== smt a .... 466292.12 |========================================================= smt b .... 466609.22 |========================================================= smt c .... 468159.21 |========================================================= smt d .... 468006.00 |========================================================= Stress-NG 0.15.04 Test: Poll Bogo Ops/s > Higher Is Better a ........ 12653709.64 |============================================= b ........ 12661687.46 |============================================= c ........ 12676101.41 |============================================= no smt a . 10458275.24 |===================================== no smt b . 10393402.01 |===================================== smt a .... 15359471.73 |======================================================= smt b .... 15341564.16 |======================================================= smt c .... 15228320.07 |====================================================== smt d .... 15403597.24 |======================================================= Stress-NG 0.15.04 Test: CPU Cache Bogo Ops/s > Higher Is Better a ........ 77.51 |================================================= b ........ 67.21 |========================================== c ........ 97.04 |============================================================= no smt a . 40.94 |========================== no smt b . 55.84 |=================================== smt a .... 47.58 |============================== smt b .... 44.38 |============================ smt c .... 42.55 |=========================== smt d .... 40.56 |========================= Stress-NG 0.15.04 Test: Memory Copying Bogo Ops/s > Higher Is Better a ........ 20106.51 |========================================================= b ........ 20340.40 |========================================================== c ........ 20297.91 |========================================================== no smt a . 11342.69 |================================ no smt b . 10949.90 |=============================== smt a .... 15914.10 |============================================= smt b .... 15430.18 |============================================ smt c .... 15077.69 |=========================================== smt d .... 13370.33 |====================================== Stress-NG 0.15.04 Test: Socket Activity Bogo Ops/s > Higher Is Better a ........ 8873.58 |========================================================== b ........ 8851.65 |========================================================== c ........ 8876.10 |========================================================== no smt a . 8968.28 |=========================================================== no smt b . 8924.10 |=========================================================== smt a .... 8748.99 |========================================================== smt b .... 8750.61 |========================================================== smt c .... 8747.83 |========================================================== smt d .... 8864.78 |========================================================== Stress-NG 0.15.04 Test: Malloc Bogo Ops/s > Higher Is Better a ........ 312709034.05 |========================== b ........ 314418461.02 |========================== c ........ 313768771.26 |========================== no smt a . 456657338.84 |====================================== no smt b . 456651508.04 |====================================== smt a .... 634718750.41 |===================================================== smt b .... 634995429.66 |====================================================== smt c .... 639757070.52 |====================================================== smt d .... 640853365.54 |====================================================== Stress-NG 0.15.04 Test: MEMFD Bogo Ops/s > Higher Is Better a ........ 518.46 |======================================================= b ........ 507.74 |====================================================== c ........ 507.97 |====================================================== no smt a . 303.56 |================================ no smt b . 308.67 |================================= smt a .... 464.70 |================================================= smt b .... 564.05 |============================================================ smt c .... 413.34 |============================================ smt d .... 394.49 |========================================== Stress-NG 0.15.04 Test: Futex Bogo Ops/s > Higher Is Better a ........ 2794694.37 |========================================= b ........ 2805836.52 |========================================= c ........ 2794473.75 |========================================= no smt a . 3746361.52 |======================================================= no smt b . 3802292.60 |======================================================== smt a .... 2333781.39 |================================== smt b .... 2396325.93 |=================================== smt c .... 2067499.58 |============================== smt d .... 2077119.76 |=============================== Stress-NG 0.15.04 Test: Hash Bogo Ops/s > Higher Is Better a ........ 18954936.00 |========================= b ........ 18955118.10 |========================= c ........ 18961773.18 |========================= no smt a . 27408413.10 |==================================== no smt b . 27422305.53 |==================================== smt a .... 41966139.67 |======================================================= smt b .... 41989522.68 |======================================================= smt c .... 41972765.93 |======================================================= smt d .... 41965286.06 |======================================================= Stress-NG 0.15.04 Test: Matrix Math Bogo Ops/s > Higher Is Better a ........ 382305.69 |======================= b ........ 382304.04 |======================= c ........ 382328.50 |======================= no smt a . 932248.18 |======================================================== no smt b . 925984.24 |======================================================= smt a .... 946032.88 |========================================================= smt b .... 946660.88 |========================================================= smt c .... 952461.48 |========================================================= smt d .... 951700.17 |========================================================= Stress-NG 0.15.04 Test: CPU Stress Bogo Ops/s > Higher Is Better a ........ 205134.87 |======================== b ........ 217072.27 |========================= c ........ 217304.19 |========================= no smt a . 328297.04 |====================================== no smt b . 326819.72 |====================================== smt a .... 487359.39 |========================================================= smt b .... 487987.32 |========================================================= smt c .... 490300.48 |========================================================= smt d .... 489998.75 |========================================================= Stress-NG 0.15.04 Test: MMAP Bogo Ops/s > Higher Is Better a ........ 1663.08 |=========== b ........ 1664.75 |=========== c ........ 1668.92 |=========== no smt a . 4520.48 |============================== no smt b . 3591.71 |======================== smt a .... 8360.76 |======================================================= smt b .... 9017.12 |=========================================================== smt c .... 7633.16 |================================================== smt d .... 7273.19 |================================================ Stress-NG 0.15.04 Test: System V Message Passing Bogo Ops/s > Higher Is Better a ........ 10473084.09 |============================================== b ........ 10471889.97 |============================================== c ........ 10475486.39 |============================================== no smt a . 7402514.74 |================================= no smt b . 7372780.72 |================================= smt a .... 10103952.13 |============================================= smt b .... 8586858.51 |====================================== smt c .... 8609357.68 |====================================== smt d .... 12418451.71 |======================================================= Stress-NG 0.15.04 Test: Vector Math Bogo Ops/s > Higher Is Better a ........ 556875.59 |======================== b ........ 556797.27 |======================== c ........ 556833.50 |======================== no smt a . 920216.27 |======================================== no smt b . 920642.34 |======================================== smt a .... 1291689.33 |======================================================== smt b .... 1291704.57 |======================================================== smt c .... 1295970.28 |======================================================== smt d .... 1300693.93 |======================================================== Stress-NG 0.15.04 Test: SENDFILE Bogo Ops/s > Higher Is Better a ........ 1950323.96 |========================= b ........ 1913590.77 |========================= c ........ 1891202.37 |======================== no smt a . 3284433.20 |========================================== no smt b . 3282827.50 |========================================== smt a .... 4329963.26 |======================================================== smt b .... 4329824.38 |======================================================== smt c .... 4351871.12 |======================================================== smt d .... 4351920.42 |======================================================== Stress-NG 0.15.04 Test: Function Call Bogo Ops/s > Higher Is Better a ........ 621015.34 |======================== b ........ 621003.92 |======================== c ........ 621041.93 |======================== no smt a . 829106.63 |================================= no smt b . 829445.38 |================================= smt a .... 1414423.65 |======================================================== smt b .... 1413555.44 |======================================================== smt c .... 1422505.51 |======================================================== smt d .... 1425621.44 |======================================================== Stress-NG 0.15.04 Test: Glibc C String Functions Bogo Ops/s > Higher Is Better a ........ 16257100.25 |========================= b ........ 16168655.17 |========================= c ........ 16537965.14 |========================= no smt a . 26755146.69 |========================================= no smt b . 28009942.56 |=========================================== smt a .... 35687958.37 |====================================================== smt b .... 35996976.13 |======================================================= smt c .... 34602827.77 |===================================================== smt d .... 36111781.82 |======================================================= Stress-NG 0.15.04 Test: Glibc Qsort Data Sorting Bogo Ops/s > Higher Is Better a ........ 1122.39 |========================== b ........ 1132.35 |========================== c ........ 1125.86 |========================== no smt a . 1978.80 |============================================== no smt b . 1963.75 |============================================= smt a .... 2564.48 |=========================================================== smt b .... 2520.38 |========================================================== smt c .... 2517.26 |========================================================== smt d .... 2516.09 |========================================================== Stress-NG 0.15.04 Test: Mutex Bogo Ops/s > Higher Is Better a ........ 59479783.64 |======================= b ........ 60031543.97 |======================= c ........ 59929401.40 |======================= no smt a . 63581395.67 |========================= no smt b . 65500297.73 |========================= smt a .... 136339636.91 |===================================================== smt b .... 135855921.28 |===================================================== smt c .... 138939958.50 |====================================================== smt d .... 137579874.56 |===================================================== VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better a ........ 12.34 |============================================================ b ........ 12.39 |============================================================= c ........ 12.40 |============================================================= no smt a . 12.48 |============================================================= no smt b . 12.31 |============================================================ VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better a ........ 12.44 |============================================================= b ........ 12.40 |============================================================= c ........ 12.44 |============================================================= no smt a . 12.36 |============================================================= no smt b . 12.37 |============================================================= GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better a ........ 10.57 |================================== b ........ 10.61 |================================== c ........ 10.59 |================================== no smt a . 19.18 |============================================================= no smt b . 18.84 |============================================================ smt a .... 18.82 |============================================================ smt b .... 19.02 |============================================================ smt c .... 19.05 |============================================================= smt d .... 19.08 |============================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 7.35746 |==================== b ........ 7.28243 |==================== c ........ 7.38116 |==================== no smt a . 9.25292 |========================== no smt b . 9.31751 |========================== smt a .... 20.26950 |======================================================== smt b .... 20.57200 |========================================================= smt c .... 21.03010 |========================================================== smt d .... 20.97260 |========================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 1.83147 |======================================= b ........ 1.84172 |======================================= c ........ 1.82264 |======================================= no smt a . 1.65041 |=================================== no smt b . 1.70057 |==================================== smt a .... 2.70807 |========================================================== smt b .... 2.76140 |=========================================================== smt c .... 2.70235 |========================================================== smt d .... 2.67303 |========================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 0.555277 |========================== b ........ 0.551966 |========================== c ........ 0.556851 |========================== no smt a . 0.664359 |=============================== no smt b . 0.670574 |================================ smt a .... 1.200490 |======================================================== smt b .... 1.181350 |======================================================== smt c .... 1.201460 |======================================================== smt d .... 1.233400 |========================================================== VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ........ 29.37 |============================================================ b ........ 29.50 |============================================================= c ........ 29.46 |============================================================ no smt a . 29.62 |============================================================= no smt b . 29.71 |============================================================= smt a .... 29.54 |============================================================= smt b .... 29.60 |============================================================= smt c .... 29.54 |============================================================= smt d .... 29.66 |============================================================= Timed Linux Kernel Compilation 6.1 Build: defconfig Seconds < Lower Is Better a ........ 25.77 |============================================================= b ........ 25.75 |============================================================= c ........ 25.68 |============================================================= no smt a . 17.61 |========================================== no smt b . 17.59 |========================================== smt a .... 17.38 |========================================= smt b .... 17.02 |======================================== smt c .... 17.05 |======================================== smt d .... 17.08 |======================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a ........ 29.37 |======================================= b ........ 29.29 |======================================= c ........ 29.41 |======================================= no smt a . 34.59 |============================================== no smt b . 34.68 |============================================== smt a .... 45.56 |============================================================ smt b .... 46.25 |============================================================= smt c .... 46.34 |============================================================= smt d .... 46.25 |============================================================= uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a ........ 33.03 |========================================== b ........ 33.13 |========================================== c ........ 33.10 |========================================== no smt a . 38.38 |================================================= no smt b . 38.65 |================================================== smt a .... 47.56 |============================================================= smt b .... 46.62 |============================================================ smt c .... 46.57 |============================================================ smt d .... 46.21 |=========================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 2.01581 |============= b ........ 1.92340 |============ c ........ 1.88686 |============ no smt a . 2.04003 |============= no smt b . 1.93126 |============ smt a .... 7.60566 |================================================ smt b .... 7.42270 |=============================================== smt c .... 9.34981 |=========================================================== smt d .... 8.26078 |==================================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 8.74576 |========================== b ........ 9.19570 |=========================== c ........ 3.83017 |=========== no smt a . 6.19257 |================== no smt b . 7.98861 |======================== smt a .... 15.42100 |============================================== smt b .... 19.54900 |========================================================== smt c .... 18.65940 |======================================================= smt d .... 11.75730 |=================================== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 3.11497 |=============== b ........ 4.27858 |==================== c ........ 4.39720 |===================== no smt a . 4.87883 |======================= no smt b . 4.79302 |======================= smt a .... 11.43260 |======================================================= smt b .... 7.30147 |=================================== smt c .... 12.01300 |========================================================= smt d .... 12.15710 |========================================================== VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better a ........ 30.04 |============================================================= b ........ 29.85 |============================================================= c ........ 30.08 |============================================================= no smt a . 28.69 |========================================================== no smt b . 28.52 |========================================================== oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 0.290200 |=========================== b ........ 0.291387 |=========================== c ........ 0.285432 |========================== no smt a . 0.316779 |============================= no smt b . 0.340498 |=============================== smt a .... 0.621776 |========================================================= smt b .... 0.620907 |========================================================= smt c .... 0.634992 |========================================================== smt d .... 0.627133 |========================================================= oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 0.357017 |=============================== b ........ 0.356875 |=============================== c ........ 0.353175 |============================== no smt a . 0.342836 |============================= no smt b . 0.347231 |============================== smt a .... 0.674455 |========================================================== smt b .... 0.675664 |========================================================== smt c .... 0.676124 |========================================================== smt d .... 0.672115 |========================================================== oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 0.263997 |========================= b ........ 0.263373 |========================= c ........ 0.262920 |========================= no smt a . 0.316665 |============================== no smt b . 0.293564 |============================ smt a .... 0.591738 |========================================================= smt b .... 0.600199 |========================================================== smt c .... 0.593299 |========================================================= smt d .... 0.602831 |========================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Frames Per Second > Higher Is Better a ........ 40.63 |===================================== b ........ 40.86 |====================================== c ........ 40.76 |====================================== no smt a . 47.13 |=========================================== no smt b . 47.43 |============================================ smt a .... 64.63 |============================================================ smt b .... 66.22 |============================================================= smt c .... 65.49 |============================================================ smt d .... 66.08 |============================================================= Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Frames Per Second > Higher Is Better a ........ 41.40 |====================================== b ........ 41.39 |====================================== c ........ 41.47 |======================================= no smt a . 47.97 |============================================= no smt b . 47.93 |============================================= smt a .... 65.56 |============================================================= smt b .... 65.69 |============================================================= smt c .... 65.59 |============================================================= smt d .... 65.49 |============================================================= Timed FFmpeg Compilation 6.0 Time To Compile Seconds < Lower Is Better a ........ 12.57 |============================================================= b ........ 12.43 |============================================================ c ........ 12.47 |============================================================= no smt a . 10.60 |=================================================== no smt b . 10.66 |==================================================== smt a .... 10.38 |================================================== smt b .... 10.26 |================================================== smt c .... 10.41 |=================================================== smt d .... 10.37 |================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a ........ 68.82 |============================================================= b ........ 68.79 |============================================================= c ........ 69.04 |============================================================= no smt a . 57.13 |================================================== no smt b . 58.09 |=================================================== smt a .... 59.30 |==================================================== smt b .... 57.86 |=================================================== smt c .... 57.44 |=================================================== smt d .... 57.52 |=================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a ........ 70.56 |============================================================= b ........ 70.68 |============================================================= c ........ 71.13 |============================================================= no smt a . 57.78 |================================================== no smt b . 57.23 |================================================= smt a .... 57.96 |================================================== smt b .... 57.51 |================================================= smt c .... 57.33 |================================================= smt d .... 58.76 |================================================== uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a ........ 69.33 |============================================================ b ........ 69.00 |============================================================ c ........ 69.92 |============================================================= no smt a . 59.83 |==================================================== no smt b . 58.33 |=================================================== smt a .... 59.06 |==================================================== smt b .... 59.20 |==================================================== smt c .... 58.34 |=================================================== smt d .... 58.66 |=================================================== oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 1.56461 |========================== b ........ 1.56257 |========================== c ........ 1.56742 |========================== no smt a . 2.19645 |==================================== no smt b . 2.12379 |=================================== smt a .... 3.39151 |======================================================== smt b .... 3.49453 |========================================================= smt c .... 3.60194 |=========================================================== smt d .... 3.50563 |========================================================= oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 1.87777 |=============================== b ........ 1.72975 |============================ c ........ 1.63860 |=========================== no smt a . 2.02286 |================================= no smt b . 2.02833 |================================= smt a .... 3.38833 |======================================================== smt b .... 3.59643 |=========================================================== smt c .... 3.36535 |======================================================= smt d .... 2.97427 |================================================= oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 0.534450 |=============================== b ........ 0.513068 |============================== c ........ 0.546991 |================================ no smt a . 0.556069 |================================ no smt b . 0.629026 |===================================== smt a .... 0.975357 |========================================================= smt b .... 0.971704 |========================================================= smt c .... 0.995710 |========================================================== smt d .... 0.975091 |========================================================= Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better a ........ 80.90 |============================================================ b ........ 81.61 |============================================================= c ........ 80.31 |============================================================ no smt a . 70.02 |==================================================== no smt b . 69.94 |==================================================== smt a .... 75.91 |========================================================= smt b .... 74.11 |======================================================= smt c .... 73.57 |======================================================= smt d .... 73.24 |======================================================= Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Frames Per Second > Higher Is Better a ........ 81.90 |=========================================================== b ........ 80.68 |========================================================== c ........ 84.55 |============================================================= no smt a . 75.50 |====================================================== no smt b . 74.03 |===================================================== smt a .... 76.64 |======================================================= smt b .... 76.70 |======================================================= smt c .... 78.72 |========================================================= smt d .... 75.50 |====================================================== Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a ........ 83.45 |============================================================ b ........ 84.77 |============================================================= c ........ 82.70 |============================================================ no smt a . 76.05 |======================================================= no smt b . 74.37 |====================================================== smt a .... 77.96 |======================================================== smt b .... 77.00 |======================================================= smt c .... 76.14 |======================================================= smt d .... 78.85 |========================================================= uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a ........ 81.16 |======================================================== b ........ 81.41 |======================================================== c ........ 81.10 |======================================================== no smt a . 87.15 |============================================================ no smt b . 88.13 |============================================================= smt a .... 80.17 |======================================================= smt b .... 79.95 |======================================================= smt c .... 79.63 |======================================================= smt d .... 80.00 |======================================================= uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a ........ 91.37 |========================================================= b ........ 91.47 |========================================================= c ........ 91.29 |========================================================= no smt a . 98.21 |============================================================= no smt b . 96.67 |============================================================ smt a .... 89.40 |======================================================== smt b .... 89.70 |======================================================== smt c .... 89.16 |======================================================= smt d .... 88.91 |======================================================= oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 0.311405 |============================================ b ........ 0.312721 |============================================ c ........ 0.312289 |============================================ no smt a . 0.254845 |==================================== no smt b . 0.255796 |==================================== smt a .... 0.407430 |========================================================== smt b .... 0.408074 |========================================================== smt c .... 0.394377 |======================================================== smt d .... 0.389223 |======================================================= oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 0.693367 |========================================================== b ........ 0.689064 |========================================================== c ........ 0.692667 |========================================================== no smt a . 0.403590 |================================== no smt b . 0.400325 |================================= smt a .... 0.538539 |============================================= smt b .... 0.551783 |============================================== smt c .... 0.545118 |============================================== smt d .... 0.630630 |===================================================== oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 0.415446 |========================================== b ........ 0.578466 |========================================================== c ........ 0.417188 |========================================== no smt a . 0.291687 |============================= no smt b . 0.291229 |============================= smt a .... 0.451472 |============================================= smt b .... 0.450261 |============================================= smt c .... 0.447820 |============================================= smt d .... 0.457554 |============================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow Frames Per Second > Higher Is Better a ........ 139.92 |===================================================== b ........ 139.07 |==================================================== c ........ 140.10 |===================================================== no smt a . 155.56 |========================================================== no smt b . 159.79 |============================================================ smt a .... 132.67 |================================================== smt b .... 136.33 |=================================================== smt c .... 135.80 |=================================================== smt d .... 135.56 |=================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium Frames Per Second > Higher Is Better a ........ 143.31 |===================================================== b ........ 144.21 |====================================================== c ........ 143.81 |===================================================== no smt a . 159.63 |=========================================================== no smt b . 161.40 |============================================================ smt a .... 140.78 |==================================================== smt b .... 138.33 |=================================================== smt c .... 140.89 |==================================================== smt d .... 136.42 |=================================================== oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better a ........ 1.170040 |========================================================== b ........ 1.166960 |========================================================== c ........ 1.169190 |========================================================== no smt a . 0.664295 |================================= no smt b . 0.651301 |================================ smt a .... 0.978590 |================================================= smt b .... 0.973555 |================================================ smt c .... 0.972863 |================================================ smt d .... 0.973984 |================================================ oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better a ........ 0.711588 |========================================================== b ........ 0.712495 |========================================================== c ........ 0.708563 |========================================================== no smt a . 0.462386 |====================================== no smt b . 0.461174 |====================================== smt a .... 0.672585 |======================================================= smt b .... 0.672768 |======================================================= smt c .... 0.676798 |======================================================= smt d .... 0.680395 |======================================================= oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better a ........ 0.304972 |========================================================== b ........ 0.305731 |========================================================== c ........ 0.305599 |========================================================== no smt a . 0.160361 |============================== no smt b . 0.164845 |=============================== smt a .... 0.279638 |===================================================== smt b .... 0.291087 |======================================================= smt c .... 0.275917 |==================================================== smt d .... 0.247825 |=============================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a ........ 234.95 |=========================================================== b ........ 234.68 |=========================================================== c ........ 237.44 |============================================================ no smt a . 196.25 |================================================== no smt b . 183.75 |============================================== smt a .... 183.99 |============================================== smt b .... 209.55 |===================================================== smt c .... 192.25 |================================================= smt d .... 181.83 |============================================== uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a ........ 238.68 |============================================================ b ........ 239.92 |============================================================ c ........ 237.96 |============================================================ no smt a . 181.67 |============================================= no smt b . 216.15 |====================================================== smt a .... 178.49 |============================================= smt b .... 220.79 |======================================================= smt c .... 178.78 |============================================= smt d .... 218.91 |======================================================= uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a ........ 240.98 |============================================================ b ........ 240.91 |============================================================ c ........ 238.77 |=========================================================== no smt a . 186.24 |============================================== no smt b . 209.85 |==================================================== smt a .... 216.15 |====================================================== smt b .... 179.56 |============================================= smt c .... 218.28 |====================================================== smt d .... 224.31 |======================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better a ........ 296.93 |============================================================ b ........ 290.59 |=========================================================== c ........ 291.03 |=========================================================== no smt a . 269.62 |====================================================== no smt b . 268.77 |====================================================== smt a .... 250.71 |=================================================== smt b .... 274.63 |======================================================= smt c .... 243.36 |================================================= smt d .... 270.76 |======================================================= Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Super Fast Frames Per Second > Higher Is Better a ........ 307.49 |============================================================ b ........ 303.99 |=========================================================== c ........ 301.40 |=========================================================== no smt a . 288.41 |======================================================== no smt b . 280.18 |======================================================= smt a .... 296.72 |========================================================== smt b .... 267.04 |==================================================== smt c .... 288.09 |======================================================== smt d .... 256.45 |================================================== Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better a ........ 310.73 |============================================================ b ........ 305.52 |=========================================================== c ........ 309.64 |============================================================ no smt a . 278.62 |====================================================== no smt b . 271.45 |==================================================== smt a .... 302.55 |========================================================== smt b .... 295.18 |========================================================= smt c .... 303.43 |=========================================================== smt d .... 303.63 |=========================================================== Stress-NG 0.15.04 Test: IO_uring Stress-NG 0.15.04 Test: Zlib Stress-NG 0.15.04 Test: x86_64 RdRand Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Frames Per Second > Higher Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Frames Per Second > Higher Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Obj Frames Per Second > Higher Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Frames Per Second > Higher Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown Frames Per Second > Higher Is Better Embree 4.0 Binary: Pathtracer - Model: Crown Frames Per Second > Higher Is Better