AM5 Noctua Cooling

Benchmarks for a future article by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301314-NE-AM5NOCTUA33
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Web Browsers 1 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 3 Tests
Creator Workloads 6 Tests
Database Test Suite 3 Tests
Encoding 2 Tests
HPC - High Performance Computing 3 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 3 Tests
Multi-Core 5 Tests
Intel oneAPI 2 Tests
Python Tests 4 Tests
Server 3 Tests
Video Encoding 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Wraith
January 29 2023
  9 Hours, 21 Minutes
Noctua NH-L9a-AM5
January 30 2023
  8 Hours, 34 Minutes
Invert Hiding All Results Option
  8 Hours, 58 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AM5 Noctua CoolingOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7900 12-Core @ 3.70GHz (12 Cores / 24 Threads)Gigabyte B650M DS3H (F4h BIOS)AMD Device 14d832GB1000GB Sabrent Rocket 4.0 PlusGigabyte AMD Raphael 512MB (2200/2400MHz)AMD Rembrandt Radeon HD AudioASUS VP28URealtek RTL8125 2.5GbEUbuntu 22.106.2.0-060200rc5daily20230129-generic (x86_64)GNOME Shell 43.0X Server 1.21.1.4 + Wayland4.6 Mesa 23.0.0-devel (git-e20564c 2022-12-12 kinetic-oibaf-ppa) (LLVM 15.0.5 DRM 3.49)1.3.235GCC 12.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAM5 Noctua Cooling BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Python 3.10.7- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Wraith vs. Noctua NH-L9a-AM5 ComparisonPhoronix Test SuiteBaseline+0.8%+0.8%+1.6%+1.6%+2.4%+2.4%3.1%3.1%2.9%2.7%2.4%2%2%N.T.C.D.m - S.S.SN.T.C.D.m - S.S.S100 - 800 - Read Only - Average Latency100 - 800 - Read Only100 - 100 - Read Only - Average Latency2.6%100 - 100 - Read Only2.6%A.G.R.R.0.F - CPU100 - 250 - Read Only2.4%1.R.H.D.F.R.C.C2.3%100 - 500 - Read Only - Average Latency2.3%100 - 500 - Read Only2.3%100 - 250 - Read Only - Average Latency2.1%N.T.C.D.m - A.M.SN.T.C.D.m - A.M.SNeural Magic DeepSparseNeural Magic DeepSparsePostgreSQLPostgreSQLPostgreSQLPostgreSQLOpenVINOPostgreSQLClickHousePostgreSQLPostgreSQLPostgreSQLNeural Magic DeepSparseNeural Magic DeepSparseWraithNoctua NH-L9a-AM5

AM5 Noctua Coolingdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamrocksdb: Seq Fillrocksdb: Rand Fillrocksdb: Rand Fill Syncrocksdb: Rand Readrocksdb: Read While Writingrocksdb: Read Rand Write Randrocksdb: Update Randselenium: Maze Solver - Google Chromeselenium: WASM collisionDetection - Google Chromeselenium: WASM imageConvolute - Google Chromeselenium: Kraken - Google Chromeopenems: pyEMS Coupleropenems: openEMS MSL_NotchFilterclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runpgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 100 - Read Onlypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 250 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 500 - Read Writepgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Onlypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 800 - Read Onlypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Only - Average Latencyuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 1080p - Ultra Fastkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastbrl-cad: VGR Performance Metricopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUWraithNoctua NH-L9a-AM543.976922.737264.949392.369986.001311.6240128.066746.8367127.15387.8579202.321029.64128.0975123.49108.7362684.281951.741719.320477.956476.939064.222315.550181.425973.62228.0881123.63418.7343684.9321138.84557.1968298.633420.075424.606640.624327.8248215.60651226077116661315722105090210314471525199547686556.3230.8118.24376.743.8363.76205.19228.14235.24155196.46013049280.0771674814.92812954030.1931643730.42312683750.3941552051.55212356640.6481548564.73412529460.79845.4950.68120.57133.17157.729.5410.6730.4632.5838.5160.8763.59117.17177.25239.0614.7715.0836.2845.7559.632851949.45631.5118.61321.9828590.250.4216963.590.75.101172.395.061177.311886.016.36944.866.351195.045.02605.529.91101.335.4493.6864.022.235705.430172.063951.108861.761780.3018261632.36834.03044.137022.654765.316991.846388.695411.2704130.621345.9209126.53797.8962204.133229.37858.1273123.03748.7275685.074651.951019.242078.192176.712564.098115.580080.774674.21718.1135123.24748.7367684.5231138.70577.2039298.989620.051524.653440.547327.9707214.48491214111116296615953105081082311416825035677734616.2230.8218.03377.644.2963.29200.54232.45235.09156816.37812719180.0791683114.85412651260.1971647830.37212403650.4031560551.27212693510.6301543564.79312457500.80345.3850.58120.31133.13157.919.5310.6930.4432.6238.4961.3163.92115.14177.09238.5314.7815.1136.4445.7859.492817959.48629.7918.64321.3628734.230.4117032.320.75.121164.825.001193.031892.326.34948.996.321201.744.99609.339.841110.015.4093.8263.912.212475.392962.054851.101901.764050.3013461626.60829.470OpenBenchmarking.org

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.34, N = 3SE +/- 0.35, N = 344.1443.98

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith510152025SE +/- 0.17, N = 3SE +/- 0.18, N = 322.6522.74

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith1530456075SE +/- 0.06, N = 3SE +/- 0.39, N = 365.3264.95

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.09, N = 3SE +/- 0.55, N = 391.8592.37

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.45, N = 3SE +/- 0.54, N = 388.7086.00

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith3691215SE +/- 0.06, N = 3SE +/- 0.07, N = 311.2711.62

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.44, N = 3SE +/- 0.37, N = 3130.62128.07

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith1122334455SE +/- 0.15, N = 3SE +/- 0.13, N = 345.9246.84

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.10, N = 3SE +/- 0.23, N = 3126.54127.15

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0066, N = 3SE +/- 0.0144, N = 37.89627.8579

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith4080120160200SE +/- 0.25, N = 3SE +/- 0.27, N = 3204.13202.32

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith714212835SE +/- 0.04, N = 3SE +/- 0.04, N = 329.3829.64

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0053, N = 3SE +/- 0.0151, N = 38.12738.0975

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.08, N = 3SE +/- 0.23, N = 3123.04123.49

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0051, N = 3SE +/- 0.0094, N = 38.72758.7362

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith150300450600750SE +/- 0.17, N = 3SE +/- 0.62, N = 3685.07684.28

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith1224364860SE +/- 0.06, N = 3SE +/- 0.13, N = 351.9551.74

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith510152025SE +/- 0.02, N = 3SE +/- 0.05, N = 319.2419.32

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.49, N = 3SE +/- 0.06, N = 378.1977.96

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.48, N = 3SE +/- 0.06, N = 376.7176.94

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.11, N = 3SE +/- 0.06, N = 364.1064.22

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith48121620SE +/- 0.03, N = 3SE +/- 0.02, N = 315.5815.55

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.47, N = 3SE +/- 0.27, N = 380.7781.43

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith1632486480SE +/- 0.44, N = 3SE +/- 0.23, N = 374.2273.62

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0095, N = 3SE +/- 0.0049, N = 38.11358.0881

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.14, N = 3SE +/- 0.08, N = 3123.25123.63

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0069, N = 3SE +/- 0.0075, N = 38.73678.7343

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith150300450600750SE +/- 0.58, N = 3SE +/- 0.53, N = 3684.52684.93

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.06, N = 3SE +/- 0.40, N = 3138.71138.85

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0033, N = 3SE +/- 0.0206, N = 37.20397.1968

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith70140210280350SE +/- 0.36, N = 3SE +/- 0.37, N = 3298.99298.63

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith510152025SE +/- 0.02, N = 3SE +/- 0.03, N = 320.0520.08

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 324.6524.61

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith918273645SE +/- 0.02, N = 3SE +/- 0.03, N = 340.5540.62

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith714212835SE +/- 0.03, N = 3SE +/- 0.10, N = 327.9727.82

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith50100150200250SE +/- 0.21, N = 3SE +/- 0.76, N = 3214.48215.61

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential FillNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 642.22, N = 3SE +/- 3237.54, N = 3121411112260771. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random FillNoctua NH-L9a-AM5Wraith200K400K600K800K1000KSE +/- 3379.18, N = 3SE +/- 1263.47, N = 3116296611666131. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill SyncNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 67.67, N = 3SE +/- 147.40, N = 315953157221. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random ReadNoctua NH-L9a-AM5Wraith20M40M60M80M100MSE +/- 438183.14, N = 3SE +/- 622147.23, N = 31050810821050902101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While WritingNoctua NH-L9a-AM5Wraith700K1400K2100K2800K3500KSE +/- 7283.63, N = 3SE +/- 43430.73, N = 3311416831447151. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomNoctua NH-L9a-AM5Wraith500K1000K1500K2000K2500KSE +/- 12706.45, N = 3SE +/- 10913.09, N = 3250356725199541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomNoctua NH-L9a-AM5Wraith170K340K510K680K850KSE +/- 1466.13, N = 3SE +/- 904.07, N = 37734617686551. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSeleniumBenchmark: Maze Solver - Browser: Google ChromeNoctua NH-L9a-AM5Wraith246810SE +/- 0.03, N = 4SE +/- 0.08, N = 156.26.31. chrome 109.0.5414.119

Benchmark: PSPDFKit WASM - Browser: Google Chrome

Wraith: The test quit with a non-zero exit status. E: NameError: name 'StaleElementReferenceException' is not defined

Noctua NH-L9a-AM5: The test quit with a non-zero exit status. E: NameError: name 'StaleElementReferenceException' is not defined

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google ChromeNoctua NH-L9a-AM5Wraith50100150200250SE +/- 0.03, N = 5SE +/- 0.02, N = 5230.82230.811. chrome 109.0.5414.119

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Google ChromeNoctua NH-L9a-AM5Wraith48121620SE +/- 0.16, N = 6SE +/- 0.31, N = 1518.0318.241. chrome 109.0.5414.119

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeNoctua NH-L9a-AM5Wraith80160240320400SE +/- 2.52, N = 3SE +/- 3.32, N = 3377.6376.71. chrome 109.0.5414.119

OpenEMS

OpenEMS is a free and open electromagnetic field solver using the FDTD method. This test profile runs OpenEMS and pyEMS benchmark demos. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMCells/s, More Is BetterOpenEMS 0.0.35-86Test: pyEMS CouplerNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.55, N = 9SE +/- 1.40, N = 644.2943.831. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat

OpenBenchmarking.orgMCells/s, More Is BetterOpenEMS 0.0.35-86Test: openEMS MSL_NotchFilterNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.25, N = 3SE +/- 0.59, N = 363.2963.761. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheNoctua NH-L9a-AM5Wraith50100150200250SE +/- 1.23, N = 3SE +/- 2.04, N = 5200.54205.19MIN: 14 / MAX: 8571.43MIN: 13.88 / MAX: 8571.43

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunNoctua NH-L9a-AM5Wraith50100150200250SE +/- 1.43, N = 3SE +/- 1.81, N = 5232.45228.14MIN: 14.21 / MAX: 10000MIN: 14.25 / MAX: 10000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunNoctua NH-L9a-AM5Wraith50100150200250SE +/- 3.31, N = 3SE +/- 1.63, N = 5235.09235.24MIN: 14.22 / MAX: 10000MIN: 14.23 / MAX: 8571.43

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 116.23, N = 3SE +/- 234.08, N = 1215681155191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith246810SE +/- 0.047, N = 3SE +/- 0.099, N = 126.3786.4601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 1401.49, N = 3SE +/- 10312.47, N = 3127191813049281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.01780.03560.05340.07120.089SE +/- 0.000, N = 3SE +/- 0.001, N = 30.0790.0771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteNoctua NH-L9a-AM5Wraith4K8K12K16K20KSE +/- 96.50, N = 3SE +/- 91.73, N = 316831167481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith48121620SE +/- 0.08, N = 3SE +/- 0.08, N = 314.8514.931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 14728.11, N = 3SE +/- 2942.90, N = 3126512612954031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.04430.08860.13290.17720.2215SE +/- 0.002, N = 3SE +/- 0.001, N = 30.1970.1931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteNoctua NH-L9a-AM5Wraith4K8K12K16K20KSE +/- 149.35, N = 12SE +/- 120.21, N = 316478164371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith714212835SE +/- 0.29, N = 12SE +/- 0.22, N = 330.3730.421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 12175.03, N = 3SE +/- 11732.69, N = 3124036512683751. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.09070.18140.27210.36280.4535SE +/- 0.004, N = 3SE +/- 0.003, N = 30.4030.3941. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read WriteNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 111.95, N = 3SE +/- 118.84, N = 315605155201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith1224364860SE +/- 0.37, N = 3SE +/- 0.40, N = 351.2751.551. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 5877.09, N = 3SE +/- 2024.35, N = 3126935112356641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.14580.29160.43740.58320.729SE +/- 0.003, N = 3SE +/- 0.001, N = 30.6300.6481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 92.72, N = 3SE +/- 217.62, N = 1215435154851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.39, N = 3SE +/- 1.02, N = 1264.7964.731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 8627.67, N = 3SE +/- 8347.19, N = 3124575012529461. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.18070.36140.54210.72280.9035SE +/- 0.005, N = 3SE +/- 0.005, N = 30.8030.7981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Scaling Factor: 100 - Clients: 5000 - Mode: Read Write

Wraith: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Noctua NH-L9a-AM5: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Scaling Factor: 100 - Clients: 5000 - Mode: Read Only

Wraith: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Noctua NH-L9a-AM5: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.13, N = 4SE +/- 0.14, N = 445.3845.49

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumNoctua NH-L9a-AM5Wraith1122334455SE +/- 0.07, N = 4SE +/- 0.12, N = 450.5850.68

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.10, N = 7SE +/- 0.07, N = 7120.31120.57

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.13, N = 8SE +/- 0.11, N = 8133.13133.17

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.11, N = 8SE +/- 0.15, N = 8157.91157.72

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowNoctua NH-L9a-AM5Wraith3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 39.539.54

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumNoctua NH-L9a-AM5Wraith3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6910.67

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastNoctua NH-L9a-AM5Wraith714212835SE +/- 0.02, N = 3SE +/- 0.05, N = 330.4430.46

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastNoctua NH-L9a-AM5Wraith816243240SE +/- 0.08, N = 3SE +/- 0.06, N = 332.6232.58

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith918273645SE +/- 0.05, N = 4SE +/- 0.03, N = 438.4938.51

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.38, N = 5SE +/- 0.32, N = 561.3160.871. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.35, N = 5SE +/- 0.47, N = 563.9263.591. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 2.13, N = 15SE +/- 2.03, N = 15115.14117.171. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastNoctua NH-L9a-AM5Wraith4080120160200SE +/- 0.22, N = 9SE +/- 0.12, N = 9177.09177.251. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith50100150200250SE +/- 0.60, N = 10SE +/- 0.56, N = 10238.53239.061. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowNoctua NH-L9a-AM5Wraith48121620SE +/- 0.05, N = 3SE +/- 0.04, N = 314.7814.771. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumNoctua NH-L9a-AM5Wraith48121620SE +/- 0.02, N = 3SE +/- 0.03, N = 315.1115.081. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastNoctua NH-L9a-AM5Wraith816243240SE +/- 0.01, N = 4SE +/- 0.02, N = 436.4436.281. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.05, N = 4SE +/- 0.07, N = 445.7845.751. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith1326395265SE +/- 0.10, N = 5SE +/- 0.09, N = 559.4959.631. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance MetricNoctua NH-L9a-AM5Wraith60K120K180K240K300K2817952851941. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 39.489.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith140280420560700SE +/- 0.23, N = 3SE +/- 0.55, N = 3629.79631.51MIN: 553.7 / MAX: 655.39MIN: 552.36 / MAX: 655.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith510152025SE +/- 0.03, N = 3SE +/- 0.06, N = 318.6418.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith70140210280350SE +/- 0.37, N = 3SE +/- 0.89, N = 3321.36321.98MIN: 285.91 / MAX: 334.03MIN: 227.32 / MAX: 342.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUNoctua NH-L9a-AM5Wraith6K12K18K24K30KSE +/- 41.32, N = 3SE +/- 57.74, N = 328734.2328590.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUNoctua NH-L9a-AM5Wraith0.09450.1890.28350.3780.4725SE +/- 0.00, N = 3SE +/- 0.00, N = 30.410.42MIN: 0.23 / MAX: 8.84MIN: 0.24 / MAX: 8.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith4K8K12K16K20KSE +/- 28.68, N = 3SE +/- 22.38, N = 317032.3216963.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith0.15750.3150.47250.630.7875SE +/- 0.00, N = 3SE +/- 0.00, N = 30.70.7MIN: 0.39 / MAX: 8.93MIN: 0.35 / MAX: 9.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith1.1522.3043.4564.6085.76SE +/- 0.02, N = 3SE +/- 0.00, N = 35.125.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith30060090012001500SE +/- 4.76, N = 3SE +/- 1.18, N = 31164.821172.39MIN: 731.65 / MAX: 1351.6MIN: 669.11 / MAX: 1373.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUNoctua NH-L9a-AM5Wraith1.13852.2773.41554.5545.6925SE +/- 0.04, N = 3SE +/- 0.02, N = 35.005.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUNoctua NH-L9a-AM5Wraith30060090012001500SE +/- 10.05, N = 3SE +/- 4.20, N = 31193.031177.31MIN: 1010.43 / MAX: 1377.34MIN: 677.05 / MAX: 1380.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith400800120016002000SE +/- 2.47, N = 3SE +/- 3.15, N = 31892.321886.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.346.36MIN: 3.48 / MAX: 13.92MIN: 3.54 / MAX: 14.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith2004006008001000SE +/- 1.43, N = 3SE +/- 1.62, N = 3948.99944.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.326.35MIN: 3.23 / MAX: 14.44MIN: 3.25 / MAX: 14.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith30060090012001500SE +/- 2.53, N = 3SE +/- 2.68, N = 31201.741195.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith1.12952.2593.38854.5185.6475SE +/- 0.01, N = 3SE +/- 0.01, N = 34.995.02MIN: 3.62 / MAX: 13.47MIN: 3.04 / MAX: 14.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith130260390520650SE +/- 4.07, N = 3SE +/- 3.68, N = 3609.33605.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith3691215SE +/- 0.07, N = 3SE +/- 0.06, N = 39.849.90MIN: 4.88 / MAX: 21.38MIN: 4.2 / MAX: 21.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith2004006008001000SE +/- 1.08, N = 3SE +/- 1.48, N = 31110.011101.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith1.2242.4483.6724.8966.12SE +/- 0.01, N = 3SE +/- 0.01, N = 35.405.44MIN: 3.98 / MAX: 14.51MIN: 4 / MAX: 15.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.09, N = 3SE +/- 0.23, N = 393.8293.681. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.06, N = 3SE +/- 0.15, N = 363.9164.02MIN: 41.47 / MAX: 78.26MIN: 52.86 / MAX: 75.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.5031.0061.5092.0122.515SE +/- 0.00682, N = 7SE +/- 0.01794, N = 92.212472.23570MIN: 2.13MIN: 2.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith1.22182.44363.66544.88726.109SE +/- 0.00123, N = 3SE +/- 0.02649, N = 35.392965.43017MIN: 4.91MIN: 4.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.46440.92881.39321.85762.322SE +/- 0.00572, N = 9SE +/- 0.00663, N = 92.054852.06395MIN: 1.91MIN: 1.921. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.24950.4990.74850.9981.2475SE +/- 0.00191, N = 4SE +/- 0.00091, N = 41.101901.10886MIN: 0.99MIN: 11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.39690.79381.19071.58761.9845SE +/- 0.00606, N = 5SE +/- 0.00435, N = 51.764051.76178MIN: 1.66MIN: 1.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.06790.13580.20370.27160.3395SE +/- 0.000096, N = 4SE +/- 0.000157, N = 40.3013460.301826MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith400800120016002000SE +/- 1.28, N = 3SE +/- 3.38, N = 31626.601632.36MIN: 1621.03MIN: 1623.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith2004006008001000SE +/- 1.64, N = 3SE +/- 1.85, N = 3829.47834.03MIN: 822.38MIN: 826.351. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringNoctua NH-L9a-AM5Wraith9001800270036004500Min: 2990 / Avg: 4541.6 / Max: 5440Min: 2971 / Avg: 4519.91 / Max: 5443

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringNoctua NH-L9a-AM5Wraith20406080100Min: 5.72 / Avg: 68.56 / Max: 118.2Min: 5.96 / Avg: 65.84 / Max: 116.13

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringNoctua NH-L9a-AM5Wraith20406080100Min: 37.13 / Avg: 73.09 / Max: 90.13Min: 36.63 / Avg: 73.44 / Max: 92.5

128 Results Shown

Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream:
    items/sec
    ms/batch
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    items/sec
    ms/batch
RocksDB:
  Seq Fill
  Rand Fill
  Rand Fill Sync
  Rand Read
  Read While Writing
  Read Rand Write Rand
  Update Rand
Selenium:
  Maze Solver - Google Chrome
  WASM collisionDetection - Google Chrome
  WASM imageConvolute - Google Chrome
  Kraken - Google Chrome
OpenEMS:
  pyEMS Coupler
  openEMS MSL_NotchFilter
ClickHouse:
  100M Rows Hits Dataset, First Run / Cold Cache
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, Third Run
PostgreSQL:
  100 - 100 - Read Write
  100 - 100 - Read Write - Average Latency
  100 - 100 - Read Only
  100 - 100 - Read Only - Average Latency
  100 - 250 - Read Write
  100 - 250 - Read Write - Average Latency
  100 - 250 - Read Only
  100 - 250 - Read Only - Average Latency
  100 - 500 - Read Write
  100 - 500 - Read Write - Average Latency
  100 - 500 - Read Only
  100 - 500 - Read Only - Average Latency
  100 - 800 - Read Write
  100 - 800 - Read Write - Average Latency
  100 - 800 - Read Only
  100 - 800 - Read Only - Average Latency
  100 - 1000 - Read Write
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Only
  100 - 1000 - Read Only - Average Latency
uvg266:
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
Kvazaar:
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
BRL-CAD
OpenVINO:
  Face Detection FP16 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Person Detection FP32 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
oneDNN:
  Convolution Batch Shapes Auto - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
  IP Shapes 1D - bf16bf16bf16 - CPU
  IP Shapes 3D - bf16bf16bf16 - CPU
  Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
    Celsius