2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2303114-NE-9654NEW5019
9654 new
2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.
a:
Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200
b:
Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200
c:
Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200
no smt a:
Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
no smt b:
Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
smt a:
Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
smt b:
Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
smt c:
Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
smt d:
Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
ClickHouse 22.12.3.5
100M Rows Hits Dataset, First Run / Cold Cache
Queries Per Minute, Geo Mean > Higher Is Better
a ........ 600.70 |=========================================================
b ........ 610.79 |==========================================================
c ........ 614.24 |==========================================================
no smt a . 635.48 |============================================================
no smt b . 622.73 |===========================================================
smt a .... 500.13 |===============================================
smt b .... 516.09 |=================================================
smt c .... 495.85 |===============================================
smt d .... 500.12 |===============================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, Second Run
Queries Per Minute, Geo Mean > Higher Is Better
a ........ 625.91 |========================================================
b ........ 627.20 |========================================================
c ........ 621.88 |========================================================
no smt a . 666.43 |============================================================
no smt b . 649.52 |==========================================================
smt a .... 524.04 |===============================================
smt b .... 527.88 |================================================
smt c .... 524.75 |===============================================
smt d .... 515.11 |==============================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, Third Run
Queries Per Minute, Geo Mean > Higher Is Better
a ........ 625.16 |========================================================
b ........ 628.37 |=========================================================
c ........ 636.18 |=========================================================
no smt a . 665.00 |============================================================
no smt b . 662.01 |============================================================
smt a .... 534.82 |================================================
smt b .... 538.63 |=================================================
smt c .... 530.47 |================================================
smt d .... 527.80 |================================================
Embree 4.0
Binary: Pathtracer - Model: Crown
Frames Per Second > Higher Is Better
Embree 4.0
Binary: Pathtracer ISPC - Model: Crown
Frames Per Second > Higher Is Better
Embree 4.0
Binary: Pathtracer - Model: Asian Dragon
Frames Per Second > Higher Is Better
Embree 4.0
Binary: Pathtracer - Model: Asian Dragon Obj
Frames Per Second > Higher Is Better
Embree 4.0
Binary: Pathtracer ISPC - Model: Asian Dragon
Frames Per Second > Higher Is Better
Embree 4.0
Binary: Pathtracer ISPC - Model: Asian Dragon Obj
Frames Per Second > Higher Is Better
GROMACS 2023
Implementation: MPI CPU - Input: water_GMX50_bare
Ns Per Day > Higher Is Better
a ........ 10.57 |==================================
b ........ 10.61 |==================================
c ........ 10.59 |==================================
no smt a . 19.18 |=============================================================
no smt b . 18.84 |============================================================
smt a .... 18.82 |============================================================
smt b .... 19.02 |============================================================
smt c .... 19.05 |=============================================================
smt d .... 19.08 |=============================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Slow
Frames Per Second > Higher Is Better
a ........ 40.63 |=====================================
b ........ 40.86 |======================================
c ........ 40.76 |======================================
no smt a . 47.13 |===========================================
no smt b . 47.43 |============================================
smt a .... 64.63 |============================================================
smt b .... 66.22 |=============================================================
smt c .... 65.49 |============================================================
smt d .... 66.08 |=============================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Medium
Frames Per Second > Higher Is Better
a ........ 41.40 |======================================
b ........ 41.39 |======================================
c ........ 41.47 |=======================================
no smt a . 47.97 |=============================================
no smt b . 47.93 |=============================================
smt a .... 65.56 |=============================================================
smt b .... 65.69 |=============================================================
smt c .... 65.59 |=============================================================
smt d .... 65.49 |=============================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Slow
Frames Per Second > Higher Is Better
a ........ 139.92 |=====================================================
b ........ 139.07 |====================================================
c ........ 140.10 |=====================================================
no smt a . 155.56 |==========================================================
no smt b . 159.79 |============================================================
smt a .... 132.67 |==================================================
smt b .... 136.33 |===================================================
smt c .... 135.80 |===================================================
smt d .... 135.56 |===================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Medium
Frames Per Second > Higher Is Better
a ........ 143.31 |=====================================================
b ........ 144.21 |======================================================
c ........ 143.81 |=====================================================
no smt a . 159.63 |===========================================================
no smt b . 161.40 |============================================================
smt a .... 140.78 |====================================================
smt b .... 138.33 |===================================================
smt c .... 140.89 |====================================================
smt d .... 136.42 |===================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a ........ 80.90 |============================================================
b ........ 81.61 |=============================================================
c ........ 80.31 |============================================================
no smt a . 70.02 |====================================================
no smt b . 69.94 |====================================================
smt a .... 75.91 |=========================================================
smt b .... 74.11 |=======================================================
smt c .... 73.57 |=======================================================
smt d .... 73.24 |=======================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a ........ 81.90 |===========================================================
b ........ 80.68 |==========================================================
c ........ 84.55 |=============================================================
no smt a . 75.50 |======================================================
no smt b . 74.03 |=====================================================
smt a .... 76.64 |=======================================================
smt b .... 76.70 |=======================================================
smt c .... 78.72 |=========================================================
smt d .... 75.50 |======================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a ........ 83.45 |============================================================
b ........ 84.77 |=============================================================
c ........ 82.70 |============================================================
no smt a . 76.05 |=======================================================
no smt b . 74.37 |======================================================
smt a .... 77.96 |========================================================
smt b .... 77.00 |=======================================================
smt c .... 76.14 |=======================================================
smt d .... 78.85 |=========================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a ........ 296.93 |============================================================
b ........ 290.59 |===========================================================
c ........ 291.03 |===========================================================
no smt a . 269.62 |======================================================
no smt b . 268.77 |======================================================
smt a .... 250.71 |===================================================
smt b .... 274.63 |=======================================================
smt c .... 243.36 |=================================================
smt d .... 270.76 |=======================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a ........ 307.49 |============================================================
b ........ 303.99 |===========================================================
c ........ 301.40 |===========================================================
no smt a . 288.41 |========================================================
no smt b . 280.18 |=======================================================
smt a .... 296.72 |==========================================================
smt b .... 267.04 |====================================================
smt c .... 288.09 |========================================================
smt d .... 256.45 |==================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a ........ 310.73 |============================================================
b ........ 305.52 |===========================================================
c ........ 309.64 |============================================================
no smt a . 278.62 |======================================================
no smt b . 271.45 |====================================================
smt a .... 302.55 |==========================================================
smt b .... 295.18 |=========================================================
smt c .... 303.43 |===========================================================
smt d .... 303.63 |===========================================================
Memcached 1.6.18
Set To Get Ratio: 1:5
Ops/sec > Higher Is Better
a ........ 4143044.21 |========================================================
b ........ 4162812.47 |========================================================
c ........ 4155273.46 |========================================================
no smt a . 2444886.82 |=================================
no smt b . 2460416.33 |=================================
smt a .... 2520253.00 |==================================
smt b .... 2507331.29 |==================================
smt c .... 2517750.47 |==================================
smt d .... 2527084.87 |==================================
Memcached 1.6.18
Set To Get Ratio: 1:10
Ops/sec > Higher Is Better
a ........ 6861088.89 |========================================================
b ........ 6792746.34 |=======================================================
c ........ 6839975.87 |========================================================
no smt a . 4244908.83 |===================================
no smt b . 4220522.49 |==================================
smt a .... 4530948.62 |=====================================
smt b .... 4392934.75 |====================================
smt c .... 4549313.42 |=====================================
smt d .... 4569476.86 |=====================================
Memcached 1.6.18
Set To Get Ratio: 1:100
Ops/sec > Higher Is Better
a ........ 4878860.00 |========================================================
b ........ 4876951.36 |========================================================
c ........ 4852421.67 |========================================================
no smt a . 3192061.68 |=====================================
no smt b . 3216133.91 |=====================================
smt a .... 4383314.65 |==================================================
smt b .... 4357453.76 |==================================================
smt c .... 4394194.49 |==================================================
smt d .... 4403267.42 |===================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 42.99 |===========================
b ........ 42.90 |===========================
c ........ 42.74 |===========================
no smt a . 97.44 |=============================================================
no smt b . 97.38 |=============================================================
smt a .... 97.02 |=============================================================
smt b .... 96.91 |=============================================================
smt c .... 97.00 |=============================================================
smt d .... 96.72 |=============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 1115.76 |===========================================================
b ........ 1118.44 |===========================================================
c ........ 1122.06 |===========================================================
no smt a . 955.16 |==================================================
no smt b . 955.24 |==================================================
smt a .... 972.52 |===================================================
smt b .... 975.50 |===================================================
smt c .... 971.90 |===================================================
smt d .... 974.99 |===================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 34.83 |============================================================
b ........ 35.10 |=============================================================
c ........ 35.12 |=============================================================
no smt a . 31.91 |=======================================================
no smt b . 29.75 |====================================================
smt a .... 31.76 |=======================================================
smt b .... 31.78 |=======================================================
smt c .... 31.93 |=======================================================
smt d .... 30.25 |=====================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 28.71 |====================================================
b ........ 28.49 |====================================================
c ........ 28.47 |====================================================
no smt a . 31.33 |=========================================================
no smt b . 33.60 |=============================================================
smt a .... 31.48 |=========================================================
smt b .... 31.46 |=========================================================
smt c .... 31.31 |=========================================================
smt d .... 33.05 |============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 1566.56 |==============================
b ........ 1573.75 |==============================
c ........ 1571.83 |==============================
no smt a . 3107.30 |===========================================================
no smt b . 3086.36 |==========================================================
smt a .... 3114.68 |===========================================================
smt b .... 3114.43 |===========================================================
smt c .... 3132.38 |===========================================================
smt d .... 3116.09 |===========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 30.59 |=============================================================
b ........ 30.46 |============================================================
c ........ 30.49 |============================================================
no smt a . 30.42 |============================================================
no smt b . 30.64 |=============================================================
smt a .... 30.75 |=============================================================
smt b .... 30.75 |=============================================================
smt c .... 30.58 |=============================================================
smt d .... 30.72 |=============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 197.10 |============================================================
b ........ 196.54 |============================================================
c ........ 197.66 |============================================================
no smt a . 191.26 |==========================================================
no smt b . 175.32 |=====================================================
smt a .... 188.58 |=========================================================
smt b .... 188.41 |=========================================================
smt c .... 189.41 |=========================================================
smt d .... 183.95 |========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 5.0715 |=====================================================
b ........ 5.0859 |======================================================
c ........ 5.0573 |=====================================================
no smt a . 5.2262 |=======================================================
no smt b . 5.7015 |============================================================
smt a .... 5.3004 |========================================================
smt b .... 5.3053 |========================================================
smt c .... 5.2773 |========================================================
smt d .... 5.4341 |=========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 401.78 |=============================
b ........ 401.21 |=============================
c ........ 400.04 |=============================
no smt a . 813.98 |===========================================================
no smt b . 817.63 |============================================================
smt a .... 817.75 |============================================================
smt b .... 822.16 |============================================================
smt c .... 818.60 |============================================================
smt d .... 816.76 |============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 119.21 |============================================================
b ........ 119.38 |============================================================
c ........ 119.70 |============================================================
no smt a . 116.15 |==========================================================
no smt b . 115.64 |==========================================================
smt a .... 117.12 |===========================================================
smt b .... 116.48 |==========================================================
smt c .... 116.97 |===========================================================
smt d .... 117.22 |===========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 99.15 |=============================================================
b ........ 98.62 |=============================================================
c ........ 98.59 |=============================================================
no smt a . 72.13 |============================================
no smt b . 71.89 |============================================
smt a .... 77.88 |================================================
smt b .... 77.41 |================================================
smt c .... 70.14 |===========================================
smt d .... 75.52 |==============================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 10.08 |===========================================
b ........ 10.14 |===========================================
c ........ 10.14 |===========================================
no smt a . 13.86 |===========================================================
no smt b . 13.90 |============================================================
smt a .... 12.83 |=======================================================
smt b .... 12.91 |=======================================================
smt c .... 14.25 |=============================================================
smt d .... 13.23 |=========================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 440.85 |============================
b ........ 439.04 |============================
c ........ 438.44 |============================
no smt a . 941.24 |============================================================
no smt b . 938.91 |============================================================
smt a .... 929.02 |===========================================================
smt b .... 927.68 |===========================================================
smt c .... 937.99 |============================================================
smt d .... 931.82 |===========================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 108.68 |============================================================
b ........ 109.11 |============================================================
c ........ 109.25 |============================================================
no smt a . 100.24 |=======================================================
no smt b . 100.42 |=======================================================
smt a .... 103.09 |=========================================================
smt b .... 103.19 |=========================================================
smt c .... 102.10 |========================================================
smt d .... 102.76 |========================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 104.12 |===================================================
b ........ 104.29 |===================================================
c ........ 113.51 |========================================================
no smt a . 101.01 |==================================================
no smt b . 100.51 |=================================================
smt a .... 121.92 |============================================================
smt b .... 119.60 |===========================================================
smt c .... 96.17 |===============================================
smt d .... 106.65 |====================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 9.5962 |=======================================================
b ........ 9.5793 |======================================================
c ........ 8.8004 |==================================================
no smt a . 9.8899 |========================================================
no smt b . 9.9395 |========================================================
smt a .... 8.1914 |===============================================
smt b .... 8.3506 |===============================================
smt c .... 10.3852 |===========================================================
smt d .... 9.3656 |=====================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 1009.85 |==========================
b ........ 1012.35 |==========================
c ........ 1013.74 |===========================
no smt a . 2204.75 |==========================================================
no smt b . 2203.16 |==========================================================
smt a .... 2230.31 |==========================================================
smt b .... 2245.80 |===========================================================
smt c .... 2253.14 |===========================================================
smt d .... 2255.42 |===========================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 47.46 |=============================================================
b ........ 47.35 |=============================================================
c ........ 47.29 |=============================================================
no smt a . 42.81 |=======================================================
no smt b . 42.84 |=======================================================
smt a .... 42.95 |=======================================================
smt b .... 42.65 |=======================================================
smt c .... 42.55 |=======================================================
smt d .... 42.48 |=======================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 188.54 |============================================================
b ........ 181.81 |==========================================================
c ........ 181.72 |==========================================================
no smt a . 166.27 |=====================================================
no smt b . 164.81 |====================================================
smt a .... 139.10 |============================================
smt b .... 136.83 |============================================
smt c .... 163.71 |====================================================
smt d .... 139.82 |============================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 5.3018 |============================================
b ........ 5.4980 |=============================================
c ........ 5.5007 |=============================================
no smt a . 6.0118 |=================================================
no smt b . 6.0650 |==================================================
smt a .... 7.1865 |===========================================================
smt b .... 7.3054 |============================================================
smt c .... 6.1057 |==================================================
smt d .... 7.1490 |===========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 619.75 |============================
b ........ 619.94 |============================
c ........ 625.55 |============================
no smt a . 1291.97 |==========================================================
no smt b . 1292.80 |==========================================================
smt a .... 1306.67 |===========================================================
smt b .... 1306.58 |===========================================================
smt c .... 1305.71 |===========================================================
smt d .... 1301.18 |===========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 77.34 |=============================================================
b ........ 77.31 |=============================================================
c ........ 76.62 |============================================================
no smt a . 73.20 |==========================================================
no smt b . 73.21 |==========================================================
smt a .... 73.31 |==========================================================
smt b .... 73.35 |==========================================================
smt c .... 73.34 |==========================================================
smt d .... 73.62 |==========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 192.88 |============================================================
b ........ 193.53 |============================================================
c ........ 193.31 |============================================================
no smt a . 131.76 |=========================================
no smt b . 155.74 |================================================
smt a .... 132.87 |=========================================
smt b .... 145.17 |=============================================
smt c .... 135.89 |==========================================
smt d .... 141.47 |============================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 5.1812 |=========================================
b ........ 5.1633 |=========================================
c ........ 5.1696 |=========================================
no smt a . 7.5856 |============================================================
no smt b . 6.4174 |===================================================
smt a .... 7.5225 |============================================================
smt b .... 6.8844 |======================================================
smt c .... 7.3550 |==========================================================
smt d .... 7.0640 |========================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 149.74 |============================
b ........ 149.82 |============================
c ........ 149.69 |============================
no smt a . 308.43 |===========================================================
no smt b . 308.30 |===========================================================
smt a .... 314.62 |============================================================
smt b .... 314.25 |============================================================
smt c .... 315.33 |============================================================
smt d .... 316.03 |============================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 319.98 |============================================================
b ........ 319.96 |============================================================
c ........ 320.05 |============================================================
no smt a . 304.21 |=========================================================
no smt b . 303.74 |=========================================================
smt a .... 303.33 |=========================================================
smt b .... 304.08 |=========================================================
smt c .... 303.25 |=========================================================
smt d .... 301.92 |=========================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 60.25 |=============================================================
b ........ 59.92 |============================================================
c ........ 60.49 |=============================================================
no smt a . 48.18 |=================================================
no smt b . 48.93 |=================================================
smt a .... 47.51 |================================================
smt b .... 45.96 |==============================================
smt c .... 48.77 |=================================================
smt d .... 46.78 |===============================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 16.58 |===============================================
b ........ 16.67 |===============================================
c ........ 16.52 |==============================================
no smt a . 20.74 |==========================================================
no smt b . 20.42 |=========================================================
smt a .... 21.03 |===========================================================
smt b .... 21.74 |=============================================================
smt c .... 20.49 |=========================================================
smt d .... 21.36 |============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 314.84 |=============================
b ........ 316.29 |=============================
c ........ 316.63 |=============================
no smt a . 649.30 |===========================================================
no smt b . 647.76 |===========================================================
smt a .... 658.21 |============================================================
smt b .... 658.34 |============================================================
smt c .... 662.26 |============================================================
smt d .... 660.21 |============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 152.14 |============================================================
b ........ 151.60 |============================================================
c ........ 151.39 |============================================================
no smt a . 145.35 |=========================================================
no smt b . 145.36 |=========================================================
smt a .... 145.40 |=========================================================
smt b .... 145.27 |=========================================================
smt c .... 144.47 |=========================================================
smt d .... 144.91 |=========================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 87.96 |============================================================
b ........ 89.34 |=============================================================
c ........ 89.55 |=============================================================
no smt a . 69.11 |===============================================
no smt b . 69.33 |===============================================
smt a .... 73.29 |==================================================
smt b .... 68.29 |===============================================
smt c .... 70.38 |================================================
smt d .... 66.08 |=============================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 11.36 |==============================================
b ........ 11.19 |=============================================
c ........ 11.16 |=============================================
no smt a . 14.46 |==========================================================
no smt b . 14.42 |==========================================================
smt a .... 13.64 |=======================================================
smt b .... 14.64 |===========================================================
smt c .... 14.20 |=========================================================
smt d .... 15.13 |=============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a ........ 42.96 |===========================
b ........ 42.83 |===========================
c ........ 42.92 |===========================
no smt a . 97.40 |=============================================================
no smt b . 97.34 |=============================================================
smt a .... 97.29 |=============================================================
smt b .... 97.35 |=============================================================
smt c .... 96.91 |============================================================
smt d .... 97.89 |=============================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a ........ 1116.43 |===========================================================
b ........ 1116.29 |===========================================================
c ........ 1117.73 |===========================================================
no smt a . 956.01 |==================================================
no smt b . 955.34 |==================================================
smt a .... 970.22 |===================================================
smt b .... 969.21 |===================================================
smt c .... 971.67 |===================================================
smt d .... 966.76 |===================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a ........ 34.93 |=============================================================
b ........ 34.82 |=============================================================
c ........ 34.99 |=============================================================
no smt a . 31.32 |=======================================================
no smt b . 31.07 |======================================================
smt a .... 30.96 |======================================================
smt b .... 31.01 |======================================================
smt c .... 29.42 |===================================================
smt d .... 31.07 |======================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a ........ 28.62 |===================================================
b ........ 28.71 |====================================================
c ........ 28.57 |===================================================
no smt a . 31.92 |=========================================================
no smt b . 32.18 |==========================================================
smt a .... 32.30 |==========================================================
smt b .... 32.24 |==========================================================
smt c .... 33.99 |=============================================================
smt d .... 32.18 |==========================================================
oneDNN 3.0
Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 2.01581 |=============
b ........ 1.92340 |============
c ........ 1.88686 |============
no smt a . 2.04003 |=============
no smt b . 1.93126 |============
smt a .... 7.60566 |================================================
smt b .... 7.42270 |===============================================
smt c .... 9.34981 |===========================================================
smt d .... 8.26078 |====================================================
oneDNN 3.0
Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 1.56461 |==========================
b ........ 1.56257 |==========================
c ........ 1.56742 |==========================
no smt a . 2.19645 |====================================
no smt b . 2.12379 |===================================
smt a .... 3.39151 |========================================================
smt b .... 3.49453 |=========================================================
smt c .... 3.60194 |===========================================================
smt d .... 3.50563 |=========================================================
oneDNN 3.0
Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 3.11497 |===============
b ........ 4.27858 |====================
c ........ 4.39720 |=====================
no smt a . 4.87883 |=======================
no smt b . 4.79302 |=======================
smt a .... 11.43260 |=======================================================
smt b .... 7.30147 |===================================
smt c .... 12.01300 |=========================================================
smt d .... 12.15710 |==========================================================
oneDNN 3.0
Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.534450 |===============================
b ........ 0.513068 |==============================
c ........ 0.546991 |================================
no smt a . 0.556069 |================================
no smt b . 0.629026 |=====================================
smt a .... 0.975357 |=========================================================
smt b .... 0.971704 |=========================================================
smt c .... 0.995710 |==========================================================
smt d .... 0.975091 |=========================================================
oneDNN 3.0
Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 8.74576 |==========================
b ........ 9.19570 |===========================
c ........ 3.83017 |===========
no smt a . 6.19257 |==================
no smt b . 7.98861 |========================
smt a .... 15.42100 |==============================================
smt b .... 19.54900 |==========================================================
smt c .... 18.65940 |=======================================================
smt d .... 11.75730 |===================================
oneDNN 3.0
Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 1.87777 |===============================
b ........ 1.72975 |============================
c ........ 1.63860 |===========================
no smt a . 2.02286 |=================================
no smt b . 2.02833 |=================================
smt a .... 3.38833 |========================================================
smt b .... 3.59643 |===========================================================
smt c .... 3.36535 |=======================================================
smt d .... 2.97427 |=================================================
oneDNN 3.0
Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.693367 |==========================================================
b ........ 0.689064 |==========================================================
c ........ 0.692667 |==========================================================
no smt a . 0.403590 |==================================
no smt b . 0.400325 |=================================
smt a .... 0.538539 |=============================================
smt b .... 0.551783 |==============================================
smt c .... 0.545118 |==============================================
smt d .... 0.630630 |=====================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 7.35746 |====================
b ........ 7.28243 |====================
c ........ 7.38116 |====================
no smt a . 9.25292 |==========================
no smt b . 9.31751 |==========================
smt a .... 20.26950 |========================================================
smt b .... 20.57200 |=========================================================
smt c .... 21.03010 |==========================================================
smt d .... 20.97260 |==========================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 1.170040 |==========================================================
b ........ 1.166960 |==========================================================
c ........ 1.169190 |==========================================================
no smt a . 0.664295 |=================================
no smt b . 0.651301 |================================
smt a .... 0.978590 |=================================================
smt b .... 0.973555 |================================================
smt c .... 0.972863 |================================================
smt d .... 0.973984 |================================================
oneDNN 3.0
Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.311405 |============================================
b ........ 0.312721 |============================================
c ........ 0.312289 |============================================
no smt a . 0.254845 |====================================
no smt b . 0.255796 |====================================
smt a .... 0.407430 |==========================================================
smt b .... 0.408074 |==========================================================
smt c .... 0.394377 |========================================================
smt d .... 0.389223 |=======================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.555277 |==========================
b ........ 0.551966 |==========================
c ........ 0.556851 |==========================
no smt a . 0.664359 |===============================
no smt b . 0.670574 |================================
smt a .... 1.200490 |========================================================
smt b .... 1.181350 |========================================================
smt c .... 1.201460 |========================================================
smt d .... 1.233400 |==========================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.304972 |==========================================================
b ........ 0.305731 |==========================================================
c ........ 0.305599 |==========================================================
no smt a . 0.160361 |==============================
no smt b . 0.164845 |===============================
smt a .... 0.279638 |=====================================================
smt b .... 0.291087 |=======================================================
smt c .... 0.275917 |====================================================
smt d .... 0.247825 |===============================================
oneDNN 3.0
Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 907.49 |===========================
b ........ 903.27 |===========================
c ........ 906.14 |===========================
no smt a . 1148.26 |===================================
no smt b . 1124.75 |==================================
smt a .... 1912.16 |==========================================================
smt b .... 1890.28 |=========================================================
smt c .... 1888.21 |=========================================================
smt d .... 1957.77 |===========================================================
oneDNN 3.0
Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 674.09 |============
b ........ 671.65 |============
c ........ 669.15 |============
no smt a . 930.26 |================
no smt b . 901.04 |================
smt a .... 3187.00 |========================================================
smt b .... 3034.62 |=====================================================
smt c .... 3011.21 |=====================================================
smt d .... 3349.36 |===========================================================
oneDNN 3.0
Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 911.25 |============================
b ........ 912.11 |============================
c ........ 915.08 |============================
no smt a . 1151.25 |===================================
no smt b . 1119.17 |==================================
smt a .... 1830.41 |========================================================
smt b .... 1937.65 |===========================================================
smt c .... 1926.15 |===========================================================
smt d .... 1883.76 |=========================================================
oneDNN 3.0
Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 0.415446 |==========================================
b ........ 0.578466 |==========================================================
c ........ 0.417188 |==========================================
no smt a . 0.291687 |=============================
no smt b . 0.291229 |=============================
smt a .... 0.451472 |=============================================
smt b .... 0.450261 |=============================================
smt c .... 0.447820 |=============================================
smt d .... 0.457554 |==============================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 1.83147 |=======================================
b ........ 1.84172 |=======================================
c ........ 1.82264 |=======================================
no smt a . 1.65041 |===================================
no smt b . 1.70057 |====================================
smt a .... 2.70807 |==========================================================
smt b .... 2.76140 |===========================================================
smt c .... 2.70235 |==========================================================
smt d .... 2.67303 |=========================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 0.711588 |==========================================================
b ........ 0.712495 |==========================================================
c ........ 0.708563 |==========================================================
no smt a . 0.462386 |======================================
no smt b . 0.461174 |======================================
smt a .... 0.672585 |=======================================================
smt b .... 0.672768 |=======================================================
smt c .... 0.676798 |=======================================================
smt d .... 0.680395 |=======================================================
oneDNN 3.0
Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 671.69 |============
b ........ 670.20 |============
c ........ 671.23 |============
no smt a . 913.20 |================
no smt b . 903.36 |================
smt a .... 3269.05 |===========================================================
smt b .... 3249.28 |===========================================================
smt c .... 3153.22 |=========================================================
smt d .... 3171.15 |=========================================================
oneDNN 3.0
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.357017 |===============================
b ........ 0.356875 |===============================
c ........ 0.353175 |==============================
no smt a . 0.342836 |=============================
no smt b . 0.347231 |==============================
smt a .... 0.674455 |==========================================================
smt b .... 0.675664 |==========================================================
smt c .... 0.676124 |==========================================================
smt d .... 0.672115 |==========================================================
oneDNN 3.0
Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 909.69 |============================
b ........ 917.08 |============================
c ........ 911.76 |============================
no smt a . 1147.34 |===================================
no smt b . 1139.63 |===================================
smt a .... 1888.10 |==========================================================
smt b .... 1894.07 |==========================================================
smt c .... 1925.68 |===========================================================
smt d .... 1912.74 |===========================================================
oneDNN 3.0
Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 675.92 |============
b ........ 668.95 |============
c ........ 667.95 |============
no smt a . 973.32 |==================
no smt b . 939.55 |=================
smt a .... 3133.65 |=========================================================
smt b .... 3222.93 |===========================================================
smt c .... 3185.64 |==========================================================
smt d .... 3172.19 |==========================================================
oneDNN 3.0
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a ........ 0.263997 |=========================
b ........ 0.263373 |=========================
c ........ 0.262920 |=========================
no smt a . 0.316665 |==============================
no smt b . 0.293564 |============================
smt a .... 0.591738 |=========================================================
smt b .... 0.600199 |==========================================================
smt c .... 0.593299 |=========================================================
smt d .... 0.602831 |==========================================================
oneDNN 3.0
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a ........ 0.290200 |===========================
b ........ 0.291387 |===========================
c ........ 0.285432 |==========================
no smt a . 0.316779 |=============================
no smt b . 0.340498 |===============================
smt a .... 0.621776 |=========================================================
smt b .... 0.620907 |=========================================================
smt c .... 0.634992 |==========================================================
smt d .... 0.627133 |=========================================================
OpenVINO 2022.3
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
a ........ 49.72 |===========================
b ........ 49.72 |===========================
c ........ 49.77 |===========================
no smt a . 109.08 |============================================================
no smt b . 109.04 |============================================================
smt a .... 108.93 |============================================================
smt b .... 108.89 |============================================================
smt c .... 109.36 |============================================================
smt d .... 109.23 |============================================================
OpenVINO 2022.3
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
a ........ 962.10 |============================================================
b ........ 962.63 |============================================================
c ........ 962.15 |============================================================
no smt a . 438.29 |===========================
no smt b . 438.99 |===========================
smt a .... 439.41 |===========================
smt b .... 439.50 |===========================
smt c .... 437.51 |===========================
smt d .... 437.68 |===========================
OpenVINO 2022.3
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
a ........ 28.47 |==============================
b ........ 28.42 |==============================
c ........ 28.33 |==============================
no smt a . 57.58 |=============================================================
no smt b . 57.49 |============================================================
smt a .... 57.72 |=============================================================
smt b .... 57.67 |=============================================================
smt c .... 58.05 |=============================================================
smt d .... 58.00 |=============================================================
OpenVINO 2022.3
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
a ........ 1671.46 |===========================================================
b ........ 1675.96 |===========================================================
c ........ 1679.03 |===========================================================
no smt a . 828.67 |=============================
no smt b . 830.04 |=============================
smt a .... 827.07 |=============================
smt b .... 827.03 |=============================
smt c .... 821.93 |=============================
smt d .... 822.50 |=============================
OpenVINO 2022.3
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
a ........ 27.97 |==============================
b ........ 28.23 |==============================
c ........ 27.89 |=============================
no smt a . 57.18 |============================================================
no smt b . 57.19 |============================================================
smt a .... 57.29 |=============================================================
smt b .... 57.31 |=============================================================
smt c .... 57.71 |=============================================================
smt d .... 57.62 |=============================================================
OpenVINO 2022.3
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
a ........ 1701.70 |===========================================================
b ........ 1685.26 |==========================================================
c ........ 1704.02 |===========================================================
no smt a . 833.99 |=============================
no smt b . 834.17 |=============================
smt a .... 833.15 |=============================
smt b .... 832.70 |=============================
smt c .... 826.67 |=============================
smt d .... 828.01 |=============================
OpenVINO 2022.3
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
a ........ 2941.47 |======================
b ........ 3085.53 |=======================
c ........ 3174.04 |=======================
no smt a . 7979.05 |===========================================================
no smt b . 7979.82 |===========================================================
smt a .... 7953.21 |===========================================================
smt b .... 7949.05 |===========================================================
smt c .... 7993.18 |===========================================================
smt d .... 7990.47 |===========================================================
OpenVINO 2022.3
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
a ........ 16.30 |=============================================================
b ........ 15.54 |==========================================================
c ........ 15.10 |=========================================================
no smt a . 6.01 |======================
no smt b . 6.01 |======================
smt a .... 6.02 |=======================
smt b .... 6.03 |=======================
smt c .... 5.99 |======================
smt d .... 6.00 |======================
OpenVINO 2022.3
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
a ........ 95.76 |===========================
b ........ 95.48 |===========================
c ........ 95.59 |===========================
no smt a . 208.82 |============================================================
no smt b . 210.14 |============================================================
smt a .... 208.13 |===========================================================
smt b .... 208.19 |===========================================================
smt c .... 210.19 |============================================================
smt d .... 209.24 |============================================================
OpenVINO 2022.3
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
a ........ 499.32 |============================================================
b ........ 500.83 |============================================================
c ........ 500.30 |============================================================
no smt a . 229.46 |===========================
no smt b . 228.01 |===========================
smt a .... 230.21 |============================
smt b .... 230.06 |============================
smt c .... 227.93 |===========================
smt d .... 228.94 |===========================
OpenVINO 2022.3
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
a ........ 5908.89 |============================
b ........ 5894.27 |============================
c ........ 5898.79 |============================
no smt a . 12119.66 |==========================================================
no smt b . 12128.38 |==========================================================
smt a .... 12117.16 |==========================================================
smt b .... 12109.64 |==========================================================
smt c .... 12168.05 |==========================================================
smt d .... 12172.92 |==========================================================
OpenVINO 2022.3
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
a ........ 8.11 |==============================================================
b ........ 8.13 |==============================================================
c ........ 8.13 |==============================================================
no smt a . 3.95 |==============================
no smt b . 3.95 |==============================
smt a .... 3.95 |==============================
smt b .... 3.96 |==============================
smt c .... 3.93 |==============================
smt d .... 3.93 |==============================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
a ........ 4914.17 |===========================
b ........ 4915.42 |===========================
c ........ 4910.13 |===========================
no smt a . 10556.93 |==========================================================
no smt b . 10549.24 |==========================================================
smt a .... 10544.03 |==========================================================
smt b .... 10549.15 |==========================================================
smt c .... 10603.84 |==========================================================
smt d .... 10587.30 |==========================================================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
a ........ 9.76 |==============================================================
b ........ 9.75 |==============================================================
c ........ 9.76 |==============================================================
no smt a . 4.54 |=============================
no smt b . 4.54 |=============================
smt a .... 4.54 |=============================
smt b .... 4.54 |=============================
smt c .... 4.52 |=============================
smt d .... 4.52 |=============================
OpenVINO 2022.3
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
a ........ 540.41 |==============================
b ........ 541.03 |==============================
c ........ 535.78 |==============================
no smt a . 1045.81 |==========================================================
no smt b . 1048.74 |==========================================================
smt a .... 1049.16 |==========================================================
smt b .... 1050.37 |===========================================================
smt c .... 1058.57 |===========================================================
smt d .... 1057.74 |===========================================================
OpenVINO 2022.3
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
a ........ 88.71 |============================================================
b ........ 88.61 |============================================================
c ........ 89.46 |=============================================================
no smt a . 45.86 |===============================
no smt b . 45.73 |===============================
smt a .... 45.71 |===============================
smt b .... 45.66 |===============================
smt c .... 45.31 |===============================
smt d .... 45.34 |===============================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
a ........ 9494.22 |==========================
b ........ 9496.95 |==========================
c ........ 9485.65 |==========================
no smt a . 20836.10 |==========================================================
no smt b . 20849.75 |==========================================================
smt a .... 20610.23 |=========================================================
smt b .... 20610.62 |=========================================================
smt c .... 20684.29 |==========================================================
smt d .... 20679.68 |==========================================================
OpenVINO 2022.3
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
a ........ 10.10 |=============================================================
b ........ 10.10 |=============================================================
c ........ 10.11 |=============================================================
no smt a . 9.18 |=======================================================
no smt b . 9.18 |=======================================================
smt a .... 9.28 |========================================================
smt b .... 9.28 |========================================================
smt c .... 9.25 |========================================================
smt d .... 9.26 |========================================================
OpenVINO 2022.3
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
a ........ 5750.74 |===================================
b ........ 5720.90 |==================================
c ........ 5724.81 |===================================
no smt a . 9784.09 |===========================================================
no smt b . 9758.74 |===========================================================
smt a .... 9746.08 |===========================================================
smt b .... 9680.44 |==========================================================
smt c .... 9773.26 |===========================================================
smt d .... 9767.99 |===========================================================
OpenVINO 2022.3
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
a ........ 8.34 |==============================================================
b ........ 8.38 |==============================================================
c ........ 8.37 |==============================================================
no smt a . 4.90 |====================================
no smt b . 4.91 |====================================
smt a .... 4.92 |====================================
smt b .... 4.95 |=====================================
smt c .... 4.90 |====================================
smt d .... 4.91 |====================================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
a ........ 112346.36 |====================================
b ........ 111378.39 |====================================
c ........ 112186.25 |====================================
no smt a . 160545.41 |====================================================
no smt b . 162294.47 |=====================================================
smt a .... 173926.92 |========================================================
smt b .... 175754.35 |=========================================================
smt c .... 173620.31 |========================================================
smt d .... 172228.34 |========================================================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
a ........ 0.65 |=============================================================
b ........ 0.66 |==============================================================
c ........ 0.66 |==============================================================
no smt a . 0.57 |======================================================
no smt b . 0.58 |======================================================
smt a .... 0.53 |==================================================
smt b .... 0.53 |==================================================
smt c .... 0.53 |==================================================
smt d .... 0.53 |==================================================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
a ........ 74495.17 |============================
b ........ 74353.41 |============================
c ........ 74486.08 |============================
no smt a . 127833.52 |=================================================
no smt b . 127770.39 |=================================================
smt a .... 148316.88 |========================================================
smt b .... 147582.87 |========================================================
smt c .... 148047.13 |========================================================
smt d .... 149647.68 |=========================================================
OpenVINO 2022.3
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
a ........ 1.09 |==============================================================
b ........ 1.09 |==============================================================
c ........ 1.09 |==============================================================
no smt a . 1.01 |=========================================================
no smt b . 1.01 |=========================================================
smt a .... 0.97 |=======================================================
smt b .... 0.97 |=======================================================
smt c .... 0.96 |=======================================================
smt d .... 0.97 |=======================================================
OpenVKL 1.3.1
Benchmark: vklBenchmark ISPC
Items / Sec > Higher Is Better
a ........ 1089 |===================================================
b ........ 1075 |===================================================
c ........ 1066 |==================================================
no smt a . 1098 |====================================================
no smt b . 1108 |====================================================
smt a .... 1318 |==============================================================
smt b .... 1243 |==========================================================
smt c .... 1235 |==========================================================
smt d .... 1238 |==========================================================
OpenVKL 1.3.1
Benchmark: vklBenchmark Scalar
Items / Sec > Higher Is Better
a ........ 556 |===========================================
b ........ 557 |===========================================
c ........ 549 |===========================================
no smt a . 647 |==================================================
no smt b . 652 |===================================================
smt a .... 764 |===========================================================
smt b .... 810 |===============================================================
smt c .... 793 |==============================================================
smt d .... 781 |=============================================================
RocksDB 7.9.2
Test: Random Fill
Op/s > Higher Is Better
a ........ 533927 |============================================================
b ........ 534681 |============================================================
c ........ 536551 |============================================================
no smt a . 478629 |======================================================
no smt b . 468210 |====================================================
smt a .... 423027 |===============================================
smt b .... 417882 |===============================================
smt c .... 416006 |===============================================
smt d .... 415428 |==============================================
RocksDB 7.9.2
Test: Random Read
Op/s > Higher Is Better
a ........ 468231434 |=====================
b ........ 466888888 |=====================
c ........ 468069792 |=====================
no smt a . 1209611055 |=======================================================
no smt b . 1213540299 |=======================================================
smt a .... 1225662852 |========================================================
smt b .... 1231168093 |========================================================
smt c .... 1234570512 |========================================================
smt d .... 1231916197 |========================================================
RocksDB 7.9.2
Test: Update Random
Op/s > Higher Is Better
a ........ 544384 |============================================================
b ........ 545556 |============================================================
c ........ 543572 |============================================================
no smt a . 462018 |===================================================
no smt b . 452228 |==================================================
smt a .... 413199 |=============================================
smt b .... 411513 |=============================================
smt c .... 419985 |==============================================
smt d .... 420514 |==============================================
RocksDB 7.9.2
Test: Sequential Fill
Op/s > Higher Is Better
a ........ 542256 |============================================================
b ........ 545396 |============================================================
c ........ 544565 |============================================================
no smt a . 465700 |===================================================
no smt b . 464044 |===================================================
smt a .... 414168 |==============================================
smt b .... 413708 |==============================================
smt c .... 414282 |==============================================
smt d .... 414047 |==============================================
RocksDB 7.9.2
Test: Random Fill Sync
Op/s > Higher Is Better
a ........ 376601 |========================================================
b ........ 373002 |=======================================================
c ........ 356922 |=====================================================
no smt a . 350673 |====================================================
no smt b . 344040 |===================================================
smt a .... 388052 |==========================================================
smt b .... 401295 |============================================================
smt c .... 394852 |===========================================================
smt d .... 404463 |============================================================
RocksDB 7.9.2
Test: Read While Writing
Op/s > Higher Is Better
a ........ 9296185 |===================================
b ........ 8620352 |=================================
c ........ 8316379 |===============================
no smt a . 7643831 |=============================
no smt b . 7913568 |==============================
smt a .... 15317250 |==========================================================
smt b .... 13830689 |====================================================
smt c .... 13948914 |=====================================================
smt d .... 13098097 |==================================================
RocksDB 7.9.2
Test: Read Random Write Random
Op/s > Higher Is Better
a ........ 2926458 |===========================================================
b ........ 2891962 |==========================================================
c ........ 2910023 |===========================================================
no smt a . 2079804 |==========================================
no smt b . 2063831 |==========================================
smt a .... 1787682 |====================================
smt b .... 1761416 |====================================
smt c .... 1613913 |=================================
smt d .... 1752904 |===================================
Stress-NG 0.15.04
Test: Hash
Bogo Ops/s > Higher Is Better
a ........ 18954936.00 |=========================
b ........ 18955118.10 |=========================
c ........ 18961773.18 |=========================
no smt a . 27408413.10 |====================================
no smt b . 27422305.53 |====================================
smt a .... 41966139.67 |=======================================================
smt b .... 41989522.68 |=======================================================
smt c .... 41972765.93 |=======================================================
smt d .... 41965286.06 |=======================================================
Stress-NG 0.15.04
Test: MMAP
Bogo Ops/s > Higher Is Better
a ........ 1663.08 |===========
b ........ 1664.75 |===========
c ........ 1668.92 |===========
no smt a . 4520.48 |==============================
no smt b . 3591.71 |========================
smt a .... 8360.76 |=======================================================
smt b .... 9017.12 |===========================================================
smt c .... 7633.16 |==================================================
smt d .... 7273.19 |================================================
Stress-NG 0.15.04
Test: NUMA
Bogo Ops/s > Higher Is Better
a ........ 483.90 |==========================================================
b ........ 498.67 |============================================================
c ........ 478.05 |==========================================================
no smt a . 20.51 |==
no smt b . 19.78 |==
smt a .... 24.82 |===
smt b .... 24.77 |===
smt c .... 24.79 |===
smt d .... 24.71 |===
Stress-NG 0.15.04
Test: Poll
Bogo Ops/s > Higher Is Better
a ........ 12653709.64 |=============================================
b ........ 12661687.46 |=============================================
c ........ 12676101.41 |=============================================
no smt a . 10458275.24 |=====================================
no smt b . 10393402.01 |=====================================
smt a .... 15359471.73 |=======================================================
smt b .... 15341564.16 |=======================================================
smt c .... 15228320.07 |======================================================
smt d .... 15403597.24 |=======================================================
Stress-NG 0.15.04
Test: Zlib
Stress-NG 0.15.04
Test: Futex
Bogo Ops/s > Higher Is Better
a ........ 2794694.37 |=========================================
b ........ 2805836.52 |=========================================
c ........ 2794473.75 |=========================================
no smt a . 3746361.52 |=======================================================
no smt b . 3802292.60 |========================================================
smt a .... 2333781.39 |==================================
smt b .... 2396325.93 |===================================
smt c .... 2067499.58 |==============================
smt d .... 2077119.76 |===============================
Stress-NG 0.15.04
Test: MEMFD
Bogo Ops/s > Higher Is Better
a ........ 518.46 |=======================================================
b ........ 507.74 |======================================================
c ........ 507.97 |======================================================
no smt a . 303.56 |================================
no smt b . 308.67 |=================================
smt a .... 464.70 |=================================================
smt b .... 564.05 |============================================================
smt c .... 413.34 |============================================
smt d .... 394.49 |==========================================
Stress-NG 0.15.04
Test: Mutex
Bogo Ops/s > Higher Is Better
a ........ 59479783.64 |=======================
b ........ 60031543.97 |=======================
c ........ 59929401.40 |=======================
no smt a . 63581395.67 |=========================
no smt b . 65500297.73 |=========================
smt a .... 136339636.91 |=====================================================
smt b .... 135855921.28 |=====================================================
smt c .... 138939958.50 |======================================================
smt d .... 137579874.56 |=====================================================
Stress-NG 0.15.04
Test: Atomic
Bogo Ops/s > Higher Is Better
a ........ 174.72 |==========================
b ........ 223.29 |=================================
c ........ 183.33 |===========================
no smt a . 400.03 |============================================================
no smt b . 395.95 |===========================================================
smt a .... 184.34 |============================
smt b .... 186.64 |============================
smt c .... 184.24 |============================
smt d .... 182.80 |===========================
Stress-NG 0.15.04
Test: Crypto
Bogo Ops/s > Higher Is Better
a ........ 203073.15 |=========================
b ........ 203147.15 |=========================
c ........ 203095.44 |=========================
no smt a . 435615.35 |=====================================================
no smt b . 437065.75 |=====================================================
smt a .... 466292.12 |=========================================================
smt b .... 466609.22 |=========================================================
smt c .... 468159.21 |=========================================================
smt d .... 468006.00 |=========================================================
Stress-NG 0.15.04
Test: Malloc
Bogo Ops/s > Higher Is Better
a ........ 312709034.05 |==========================
b ........ 314418461.02 |==========================
c ........ 313768771.26 |==========================
no smt a . 456657338.84 |======================================
no smt b . 456651508.04 |======================================
smt a .... 634718750.41 |=====================================================
smt b .... 634995429.66 |======================================================
smt c .... 639757070.52 |======================================================
smt d .... 640853365.54 |======================================================
Stress-NG 0.15.04
Test: Forking
Bogo Ops/s > Higher Is Better
a ........ 58156.36 |====================================================
b ........ 58664.97 |=====================================================
c ........ 64299.62 |==========================================================
no smt a . 43094.96 |=======================================
no smt b . 45685.28 |=========================================
smt a .... 36266.02 |=================================
smt b .... 36020.16 |================================
smt c .... 34917.39 |===============================
smt d .... 34685.85 |===============================
Stress-NG 0.15.04
Test: Pthread
Bogo Ops/s > Higher Is Better
a ........ 109397.78 |===================================
b ........ 109356.78 |===================================
c ........ 109609.15 |===================================
no smt a . 68076.03 |======================
no smt b . 67451.30 |=====================
smt a .... 74978.51 |========================
smt b .... 180407.59 |=========================================================
smt c .... 77834.39 |=========================
smt d .... 91735.75 |=============================
Stress-NG 0.15.04
Test: IO_uring
Stress-NG 0.15.04
Test: SENDFILE
Bogo Ops/s > Higher Is Better
a ........ 1950323.96 |=========================
b ........ 1913590.77 |=========================
c ........ 1891202.37 |========================
no smt a . 3284433.20 |==========================================
no smt b . 3282827.50 |==========================================
smt a .... 4329963.26 |========================================================
smt b .... 4329824.38 |========================================================
smt c .... 4351871.12 |========================================================
smt d .... 4351920.42 |========================================================
Stress-NG 0.15.04
Test: CPU Cache
Bogo Ops/s > Higher Is Better
a ........ 77.51 |=================================================
b ........ 67.21 |==========================================
c ........ 97.04 |=============================================================
no smt a . 40.94 |==========================
no smt b . 55.84 |===================================
smt a .... 47.58 |==============================
smt b .... 44.38 |============================
smt c .... 42.55 |===========================
smt d .... 40.56 |=========================
Stress-NG 0.15.04
Test: CPU Stress
Bogo Ops/s > Higher Is Better
a ........ 205134.87 |========================
b ........ 217072.27 |=========================
c ........ 217304.19 |=========================
no smt a . 328297.04 |======================================
no smt b . 326819.72 |======================================
smt a .... 487359.39 |=========================================================
smt b .... 487987.32 |=========================================================
smt c .... 490300.48 |=========================================================
smt d .... 489998.75 |=========================================================
Stress-NG 0.15.04
Test: Semaphores
Bogo Ops/s > Higher Is Better
a ........ 18128283.29 |==================================================
b ........ 18100474.36 |==================================================
c ........ 18088584.67 |==================================================
no smt a . 13141129.68 |====================================
no smt b . 13192391.85 |====================================
smt a .... 20047519.05 |=======================================================
smt b .... 19927313.52 |=======================================================
smt c .... 19866440.86 |=======================================================
smt d .... 19842969.28 |======================================================
Stress-NG 0.15.04
Test: Matrix Math
Bogo Ops/s > Higher Is Better
a ........ 382305.69 |=======================
b ........ 382304.04 |=======================
c ........ 382328.50 |=======================
no smt a . 932248.18 |========================================================
no smt b . 925984.24 |=======================================================
smt a .... 946032.88 |=========================================================
smt b .... 946660.88 |=========================================================
smt c .... 952461.48 |=========================================================
smt d .... 951700.17 |=========================================================
Stress-NG 0.15.04
Test: Vector Math
Bogo Ops/s > Higher Is Better
a ........ 556875.59 |========================
b ........ 556797.27 |========================
c ........ 556833.50 |========================
no smt a . 920216.27 |========================================
no smt b . 920642.34 |========================================
smt a .... 1291689.33 |========================================================
smt b .... 1291704.57 |========================================================
smt c .... 1295970.28 |========================================================
smt d .... 1300693.93 |========================================================
Stress-NG 0.15.04
Test: Function Call
Bogo Ops/s > Higher Is Better
a ........ 621015.34 |========================
b ........ 621003.92 |========================
c ........ 621041.93 |========================
no smt a . 829106.63 |=================================
no smt b . 829445.38 |=================================
smt a .... 1414423.65 |========================================================
smt b .... 1413555.44 |========================================================
smt c .... 1422505.51 |========================================================
smt d .... 1425621.44 |========================================================
Stress-NG 0.15.04
Test: x86_64 RdRand
Stress-NG 0.15.04
Test: Memory Copying
Bogo Ops/s > Higher Is Better
a ........ 20106.51 |=========================================================
b ........ 20340.40 |==========================================================
c ........ 20297.91 |==========================================================
no smt a . 11342.69 |================================
no smt b . 10949.90 |===============================
smt a .... 15914.10 |=============================================
smt b .... 15430.18 |============================================
smt c .... 15077.69 |===========================================
smt d .... 13370.33 |======================================
Stress-NG 0.15.04
Test: Socket Activity
Bogo Ops/s > Higher Is Better
a ........ 8873.58 |==========================================================
b ........ 8851.65 |==========================================================
c ........ 8876.10 |==========================================================
no smt a . 8968.28 |===========================================================
no smt b . 8924.10 |===========================================================
smt a .... 8748.99 |==========================================================
smt b .... 8750.61 |==========================================================
smt c .... 8747.83 |==========================================================
smt d .... 8864.78 |==========================================================
Stress-NG 0.15.04
Test: Context Switching
Bogo Ops/s > Higher Is Better
a ........ 18941003.97 |======================
b ........ 16313126.86 |===================
c ........ 16862185.54 |====================
no smt a . 47222624.49 |=======================================================
no smt b . 44683906.68 |====================================================
smt a .... 12895047.73 |===============
smt b .... 12221058.34 |==============
smt c .... 12328933.65 |==============
smt d .... 12728401.45 |===============
Stress-NG 0.15.04
Test: Glibc C String Functions
Bogo Ops/s > Higher Is Better
a ........ 16257100.25 |=========================
b ........ 16168655.17 |=========================
c ........ 16537965.14 |=========================
no smt a . 26755146.69 |=========================================
no smt b . 28009942.56 |===========================================
smt a .... 35687958.37 |======================================================
smt b .... 35996976.13 |=======================================================
smt c .... 34602827.77 |=====================================================
smt d .... 36111781.82 |=======================================================
Stress-NG 0.15.04
Test: Glibc Qsort Data Sorting
Bogo Ops/s > Higher Is Better
a ........ 1122.39 |==========================
b ........ 1132.35 |==========================
c ........ 1125.86 |==========================
no smt a . 1978.80 |==============================================
no smt b . 1963.75 |=============================================
smt a .... 2564.48 |===========================================================
smt b .... 2520.38 |==========================================================
smt c .... 2517.26 |==========================================================
smt d .... 2516.09 |==========================================================
Stress-NG 0.15.04
Test: System V Message Passing
Bogo Ops/s > Higher Is Better
a ........ 10473084.09 |==============================================
b ........ 10471889.97 |==============================================
c ........ 10475486.39 |==============================================
no smt a . 7402514.74 |=================================
no smt b . 7372780.72 |=================================
smt a .... 10103952.13 |=============================================
smt b .... 8586858.51 |======================================
smt c .... 8609357.68 |======================================
smt d .... 12418451.71 |=======================================================
Timed FFmpeg Compilation 6.0
Time To Compile
Seconds < Lower Is Better
a ........ 12.57 |=============================================================
b ........ 12.43 |============================================================
c ........ 12.47 |=============================================================
no smt a . 10.60 |===================================================
no smt b . 10.66 |====================================================
smt a .... 10.38 |==================================================
smt b .... 10.26 |==================================================
smt c .... 10.41 |===================================================
smt d .... 10.37 |==================================================
Timed Linux Kernel Compilation 6.1
Build: defconfig
Seconds < Lower Is Better
a ........ 25.77 |=============================================================
b ........ 25.75 |=============================================================
c ........ 25.68 |=============================================================
no smt a . 17.61 |==========================================
no smt b . 17.59 |==========================================
smt a .... 17.38 |=========================================
smt b .... 17.02 |========================================
smt c .... 17.05 |========================================
smt d .... 17.08 |========================================
Timed Linux Kernel Compilation 6.1
Build: allmodconfig
Seconds < Lower Is Better
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Slow
Frames Per Second > Higher Is Better
a ........ 29.37 |=======================================
b ........ 29.29 |=======================================
c ........ 29.41 |=======================================
no smt a . 34.59 |==============================================
no smt b . 34.68 |==============================================
smt a .... 45.56 |============================================================
smt b .... 46.25 |=============================================================
smt c .... 46.34 |=============================================================
smt d .... 46.25 |=============================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Medium
Frames Per Second > Higher Is Better
a ........ 33.03 |==========================================
b ........ 33.13 |==========================================
c ........ 33.10 |==========================================
no smt a . 38.38 |=================================================
no smt b . 38.65 |==================================================
smt a .... 47.56 |=============================================================
smt b .... 46.62 |============================================================
smt c .... 46.57 |============================================================
smt d .... 46.21 |===========================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Slow
Frames Per Second > Higher Is Better
a ........ 81.16 |========================================================
b ........ 81.41 |========================================================
c ........ 81.10 |========================================================
no smt a . 87.15 |============================================================
no smt b . 88.13 |=============================================================
smt a .... 80.17 |=======================================================
smt b .... 79.95 |=======================================================
smt c .... 79.63 |=======================================================
smt d .... 80.00 |=======================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Medium
Frames Per Second > Higher Is Better
a ........ 91.37 |=========================================================
b ........ 91.47 |=========================================================
c ........ 91.29 |=========================================================
no smt a . 98.21 |=============================================================
no smt b . 96.67 |============================================================
smt a .... 89.40 |========================================================
smt b .... 89.70 |========================================================
smt c .... 89.16 |=======================================================
smt d .... 88.91 |=======================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a ........ 68.82 |=============================================================
b ........ 68.79 |=============================================================
c ........ 69.04 |=============================================================
no smt a . 57.13 |==================================================
no smt b . 58.09 |===================================================
smt a .... 59.30 |====================================================
smt b .... 57.86 |===================================================
smt c .... 57.44 |===================================================
smt d .... 57.52 |===================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a ........ 69.33 |============================================================
b ........ 69.00 |============================================================
c ........ 69.92 |=============================================================
no smt a . 59.83 |====================================================
no smt b . 58.33 |===================================================
smt a .... 59.06 |====================================================
smt b .... 59.20 |====================================================
smt c .... 58.34 |===================================================
smt d .... 58.66 |===================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a ........ 70.56 |=============================================================
b ........ 70.68 |=============================================================
c ........ 71.13 |=============================================================
no smt a . 57.78 |==================================================
no smt b . 57.23 |=================================================
smt a .... 57.96 |==================================================
smt b .... 57.51 |=================================================
smt c .... 57.33 |=================================================
smt d .... 58.76 |==================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a ........ 234.95 |===========================================================
b ........ 234.68 |===========================================================
c ........ 237.44 |============================================================
no smt a . 196.25 |==================================================
no smt b . 183.75 |==============================================
smt a .... 183.99 |==============================================
smt b .... 209.55 |=====================================================
smt c .... 192.25 |=================================================
smt d .... 181.83 |==============================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a ........ 238.68 |============================================================
b ........ 239.92 |============================================================
c ........ 237.96 |============================================================
no smt a . 181.67 |=============================================
no smt b . 216.15 |======================================================
smt a .... 178.49 |=============================================
smt b .... 220.79 |=======================================================
smt c .... 178.78 |=============================================
smt d .... 218.91 |=======================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a ........ 240.98 |============================================================
b ........ 240.91 |============================================================
c ........ 238.77 |===========================================================
no smt a . 186.24 |==============================================
no smt b . 209.85 |====================================================
smt a .... 216.15 |======================================================
smt b .... 179.56 |=============================================
smt c .... 218.28 |======================================================
smt d .... 224.31 |========================================================
VP9 libvpx Encoding 1.13
Speed: Speed 0 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a ........ 7.68 |==============================================================
b ........ 7.71 |==============================================================
c ........ 7.70 |==============================================================
no smt a . 7.04 |=========================================================
no smt b . 7.16 |==========================================================
smt a .... 7.24 |==========================================================
smt b .... 6.97 |========================================================
smt c .... 6.92 |========================================================
smt d .... 7.15 |=========================================================
VP9 libvpx Encoding 1.13
Speed: Speed 5 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a ........ 17.36 |=============================================================
b ........ 17.37 |=============================================================
c ........ 17.46 |=============================================================
no smt a . 14.48 |===================================================
no smt b . 14.50 |===================================================
smt a .... 13.90 |=================================================
smt b .... 14.27 |==================================================
smt c .... 15.38 |======================================================
smt d .... 15.11 |=====================================================
VP9 libvpx Encoding 1.13
Speed: Speed 0 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a ........ 14.69 |=============================================================
b ........ 14.67 |=============================================================
c ........ 14.76 |=============================================================
no smt a . 14.28 |===========================================================
no smt b . 13.72 |=========================================================
smt a .... 14.08 |==========================================================
smt b .... 13.57 |========================================================
smt c .... 13.97 |==========================================================
smt d .... 13.68 |=========================================================
VP9 libvpx Encoding 1.13
Speed: Speed 5 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a ........ 29.37 |============================================================
b ........ 29.50 |=============================================================
c ........ 29.46 |============================================================
no smt a . 29.62 |=============================================================
no smt b . 29.71 |=============================================================
smt a .... 29.54 |=============================================================
smt b .... 29.60 |=============================================================
smt c .... 29.54 |=============================================================
smt d .... 29.66 |=============================================================
VVenC 1.7
Video Input: Bosphorus 4K - Video Preset: Fast
Frames Per Second > Higher Is Better
a ........ 5.820 |============================================================
b ........ 5.809 |============================================================
c ........ 5.808 |============================================================
no smt a . 5.890 |=============================================================
no smt b . 5.895 |=============================================================
VVenC 1.7
Video Input: Bosphorus 4K - Video Preset: Faster
Frames Per Second > Higher Is Better
a ........ 12.34 |============================================================
b ........ 12.39 |=============================================================
c ........ 12.40 |=============================================================
no smt a . 12.48 |=============================================================
no smt b . 12.31 |============================================================
VVenC 1.7
Video Input: Bosphorus 1080p - Video Preset: Fast
Frames Per Second > Higher Is Better
a ........ 12.44 |=============================================================
b ........ 12.40 |=============================================================
c ........ 12.44 |=============================================================
no smt a . 12.36 |=============================================================
no smt b . 12.37 |=============================================================
VVenC 1.7
Video Input: Bosphorus 1080p - Video Preset: Faster
Frames Per Second > Higher Is Better
a ........ 30.04 |=============================================================
b ........ 29.85 |=============================================================
c ........ 30.08 |=============================================================
no smt a . 28.69 |==========================================================
no smt b . 28.52 |==========================================================
Zstd Compression 1.5.4
Compression Level: 3 - Compression Speed
MB/s > Higher Is Better
a ........ 3033.9 |===========================================================
b ........ 3095.0 |============================================================
c ........ 3049.4 |===========================================================
no smt a . 2804.2 |======================================================
no smt b . 2865.9 |========================================================
smt a .... 2795.1 |======================================================
smt b .... 2513.4 |=================================================
smt c .... 2604.6 |==================================================
smt d .... 2528.7 |=================================================
Zstd Compression 1.5.4
Compression Level: 3 - Decompression Speed
MB/s > Higher Is Better
a ........ 1514.8 |============================================================
b ........ 1516.6 |============================================================
c ........ 1517.4 |============================================================
no smt a . 1500.4 |===========================================================
no smt b . 1511.5 |============================================================
smt a .... 1515.6 |============================================================
smt b .... 1519.1 |============================================================
smt c .... 1516.2 |============================================================
smt d .... 1513.5 |============================================================
Zstd Compression 1.5.4
Compression Level: 8 - Compression Speed
MB/s > Higher Is Better
a ........ 1233.8 |============================================================
b ........ 1239.3 |============================================================
c ........ 1241.1 |============================================================
no smt a . 1227.5 |===========================================================
no smt b . 1234.2 |============================================================
smt a .... 1023.9 |=================================================
smt b .... 1122.4 |======================================================
smt c .... 1005.8 |=================================================
smt d .... 1024.8 |==================================================
Zstd Compression 1.5.4
Compression Level: 8 - Decompression Speed
MB/s > Higher Is Better
a ........ 1669.3 |============================================================
b ........ 1651.0 |===========================================================
c ........ 1661.9 |============================================================
no smt a . 1669.7 |============================================================
no smt b . 1667.6 |============================================================
smt a .... 1664.3 |============================================================
smt b .... 1671.0 |============================================================
smt c .... 1664.0 |============================================================
smt d .... 1664.2 |============================================================
Zstd Compression 1.5.4
Compression Level: 12 - Compression Speed
MB/s > Higher Is Better
a ........ 330.8 |=============================================================
b ........ 332.0 |=============================================================
c ........ 330.1 |=============================================================
no smt a . 279.9 |===================================================
no smt b . 278.2 |===================================================
smt a .... 254.1 |===============================================
smt b .... 259.1 |================================================
smt c .... 249.8 |==============================================
smt d .... 256.2 |===============================================
Zstd Compression 1.5.4
Compression Level: 12 - Decompression Speed
MB/s > Higher Is Better
a ........ 1704.8 |===========================================================
b ........ 1716.7 |===========================================================
c ........ 1715.6 |===========================================================
no smt a . 1728.0 |============================================================
no smt b . 1727.8 |============================================================
smt a .... 1723.7 |============================================================
smt b .... 1726.3 |============================================================
smt c .... 1732.3 |============================================================
smt d .... 1731.2 |============================================================
Zstd Compression 1.5.4
Compression Level: 19 - Compression Speed
MB/s > Higher Is Better
a ........ 19.1 |============================================================
b ........ 19.1 |============================================================
c ........ 19.1 |============================================================
no smt a . 19.8 |==============================================================
no smt b . 19.8 |==============================================================
smt a .... 18.8 |===========================================================
smt b .... 19.5 |=============================================================
smt c .... 19.2 |============================================================
smt d .... 19.6 |=============================================================
Zstd Compression 1.5.4
Compression Level: 19 - Decompression Speed
MB/s > Higher Is Better
a ........ 1472.6 |===========================================================
b ........ 1467.8 |===========================================================
c ........ 1470.5 |===========================================================
no smt a . 1483.1 |============================================================
no smt b . 1483.8 |============================================================
smt a .... 1495.2 |============================================================
smt b .... 1483.5 |============================================================
smt c .... 1475.2 |===========================================================
smt d .... 1479.1 |===========================================================
Zstd Compression 1.5.4
Compression Level: 3, Long Mode - Compression Speed
MB/s > Higher Is Better
a ........ 892.7 |===================================================
b ........ 909.4 |====================================================
c ........ 916.9 |====================================================
no smt a . 955.6 |======================================================
no smt b . 1032.3 |==========================================================
smt a .... 1051.4 |============================================================
smt b .... 1038.9 |===========================================================
smt c .... 1046.6 |===========================================================
smt d .... 1059.0 |============================================================
Zstd Compression 1.5.4
Compression Level: 3, Long Mode - Decompression Speed
MB/s > Higher Is Better
a ........ 1536.6 |============================================================
b ........ 1537.5 |============================================================
c ........ 1540.9 |============================================================
no smt a . 1542.5 |============================================================
no smt b . 1538.8 |============================================================
smt a .... 1539.5 |============================================================
smt b .... 1540.4 |============================================================
smt c .... 1540.9 |============================================================
smt d .... 1543.6 |============================================================
Zstd Compression 1.5.4
Compression Level: 8, Long Mode - Compression Speed
MB/s > Higher Is Better
a ........ 938.5 |=============================================================
b ........ 910.8 |===========================================================
c ........ 926.9 |============================================================
no smt a . 859.9 |========================================================
no smt b . 892.0 |==========================================================
smt a .... 853.8 |=======================================================
smt b .... 852.7 |=======================================================
smt c .... 860.8 |========================================================
smt d .... 879.6 |=========================================================
Zstd Compression 1.5.4
Compression Level: 8, Long Mode - Decompression Speed
MB/s > Higher Is Better
a ........ 1677.9 |============================================================
b ........ 1673.7 |============================================================
c ........ 1675.4 |============================================================
no smt a . 1684.8 |============================================================
no smt b . 1682.8 |============================================================
smt a .... 1682.5 |============================================================
smt b .... 1676.5 |============================================================
smt c .... 1683.7 |============================================================
smt d .... 1677.6 |============================================================
Zstd Compression 1.5.4
Compression Level: 19, Long Mode - Compression Speed
MB/s > Higher Is Better
a ........ 9.22 |==========================================================
b ........ 9.29 |==========================================================
c ........ 9.30 |==========================================================
no smt a . 9.39 |===========================================================
no smt b . 9.76 |=============================================================
smt a .... 9.78 |=============================================================
smt b .... 9.87 |==============================================================
smt c .... 9.82 |==============================================================
smt d .... 9.81 |==============================================================
Zstd Compression 1.5.4
Compression Level: 19, Long Mode - Decompression Speed
MB/s > Higher Is Better
a ........ 1383.7 |===========================================================
b ........ 1378.2 |===========================================================
c ........ 1384.0 |===========================================================
no smt a . 1395.8 |============================================================
no smt b . 1397.6 |============================================================
smt a .... 1393.5 |============================================================
smt b .... 1392.4 |============================================================
smt c .... 1389.0 |============================================================
smt d .... 1391.7 |============================================================