AM5 Noctua Cooling

Benchmarks for a future article by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301314-NE-AM5NOCTUA33
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Web Browsers 1 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 3 Tests
Creator Workloads 6 Tests
Database Test Suite 3 Tests
Encoding 2 Tests
HPC - High Performance Computing 3 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 3 Tests
Multi-Core 5 Tests
Intel oneAPI 2 Tests
Python Tests 4 Tests
Server 3 Tests
Video Encoding 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Wraith
January 29 2023
  9 Hours, 21 Minutes
Noctua NH-L9a-AM5
January 30 2023
  8 Hours, 34 Minutes
Invert Hiding All Results Option
  8 Hours, 58 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AM5 Noctua CoolingOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7900 12-Core @ 3.70GHz (12 Cores / 24 Threads)Gigabyte B650M DS3H (F4h BIOS)AMD Device 14d832GB1000GB Sabrent Rocket 4.0 PlusGigabyte AMD Raphael 512MB (2200/2400MHz)AMD Rembrandt Radeon HD AudioASUS VP28URealtek RTL8125 2.5GbEUbuntu 22.106.2.0-060200rc5daily20230129-generic (x86_64)GNOME Shell 43.0X Server 1.21.1.4 + Wayland4.6 Mesa 23.0.0-devel (git-e20564c 2022-12-12 kinetic-oibaf-ppa) (LLVM 15.0.5 DRM 3.49)1.3.235GCC 12.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAM5 Noctua Cooling BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Python 3.10.7- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Wraith vs. Noctua NH-L9a-AM5 ComparisonPhoronix Test SuiteBaseline+0.8%+0.8%+1.6%+1.6%+2.4%+2.4%3.1%3.1%2.9%2.7%2.4%2%2%N.T.C.D.m - S.S.SN.T.C.D.m - S.S.S100 - 800 - Read Only - Average Latency100 - 800 - Read Only100 - 100 - Read Only - Average Latency2.6%100 - 100 - Read Only2.6%A.G.R.R.0.F - CPU100 - 250 - Read Only2.4%1.R.H.D.F.R.C.C2.3%100 - 500 - Read Only - Average Latency2.3%100 - 500 - Read Only2.3%100 - 250 - Read Only - Average Latency2.1%N.T.C.D.m - A.M.SN.T.C.D.m - A.M.SNeural Magic DeepSparseNeural Magic DeepSparsePostgreSQLPostgreSQLPostgreSQLPostgreSQLOpenVINOPostgreSQLClickHousePostgreSQLPostgreSQLPostgreSQLNeural Magic DeepSparseNeural Magic DeepSparseWraithNoctua NH-L9a-AM5

AM5 Noctua Coolingopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Slowuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 1080p - Ultra Fastkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenems: pyEMS Coupleropenems: openEMS MSL_NotchFilterrocksdb: Rand Fillrocksdb: Rand Fill Syncrocksdb: Seq Fillrocksdb: Read While Writingrocksdb: Rand Readrocksdb: Read Rand Write Randrocksdb: Update Randclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runpgbench: 100 - 100 - Read Writepgbench: 100 - 100 - Read Onlypgbench: 100 - 250 - Read Writepgbench: 100 - 250 - Read Onlypgbench: 100 - 500 - Read Writepgbench: 100 - 500 - Read Onlypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Onlypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Onlybrl-cad: VGR Performance Metricselenium: WASM collisionDetection - Google Chromeselenium: WASM imageConvolute - Google Chromeselenium: Kraken - Google Chromepgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Only - Average Latencyopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamselenium: Maze Solver - Google ChromeWraithNoctua NH-L9a-AM59.4518.6128590.2516963.595.105.061886.01944.861195.04605.521101.3393.6845.4950.68120.57133.17157.729.5410.6760.8730.4632.5838.5163.59117.17177.25239.0614.7715.0836.2845.7559.6343.976964.949386.0013128.0667127.1538202.32108.09758.736251.741777.956464.222381.42598.08818.7343138.8455298.633424.606627.824843.8363.76116661315722122607731447151050902102519954768655205.19228.14235.24155191304928167481295403164371268375155201235664154851252946285194230.8118.24376.76.4600.07714.9280.19330.4230.39451.5520.64864.7340.798631.51321.980.420.71172.391177.316.366.355.029.95.4464.022.235705.430172.063951.108861.761780.3018261632.36834.03022.737292.369911.624046.83677.857929.6412123.4910684.281919.320476.939015.550173.6222123.6341684.93217.196820.075440.6243215.60656.39.4818.6428734.2317032.325.125.001892.32948.991201.74609.331110.0193.8245.3850.58120.31133.13157.919.5310.6961.3130.4432.6238.4963.92115.14177.09238.5314.7815.1136.4445.7859.4944.137065.316988.6954130.6213126.5379204.13328.12738.727551.951078.192164.098180.77468.11358.7367138.7057298.989624.653427.970744.2963.29116296615953121411131141681050810822503567773461200.54232.45235.09156811271918168311265126164781240365156051269351154351245750281795230.8218.03377.66.3780.07914.8540.19730.3720.40351.2720.63064.7930.803629.79321.360.410.71164.821193.036.346.324.999.845.4063.912.212475.392962.054851.101901.764050.3013461626.60829.47022.654791.846311.270445.92097.896229.3785123.0374685.074619.242076.712515.580074.2171123.2474684.52317.203920.051540.5473214.48496.2OpenBenchmarking.org

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringWraithNoctua NH-L9a-AM520406080100Min: 36.63 / Avg: 73.44 / Max: 92.5Min: 37.13 / Avg: 73.09 / Max: 90.13

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringNoctua NH-L9a-AM5Wraith9001800270036004500Min: 2990 / Avg: 4541.6 / Max: 5440Min: 2971 / Avg: 4519.91 / Max: 5443

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringNoctua NH-L9a-AM5Wraith20406080100Min: 5.72 / Avg: 68.56 / Max: 118.2Min: 5.96 / Avg: 65.84 / Max: 116.13

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM53691215SE +/- 0.01, N = 3SE +/- 0.00, N = 39.459.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM5510152025SE +/- 0.06, N = 3SE +/- 0.03, N = 318.6118.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUWraithNoctua NH-L9a-AM56K12K18K24K30KSE +/- 57.74, N = 3SE +/- 41.32, N = 328590.2528734.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM54K8K12K16K20KSE +/- 22.38, N = 3SE +/- 28.68, N = 316963.5917032.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM51.1522.3043.4564.6085.76SE +/- 0.00, N = 3SE +/- 0.02, N = 35.105.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUNoctua NH-L9a-AM5Wraith1.13852.2773.41554.5545.6925SE +/- 0.04, N = 3SE +/- 0.02, N = 35.005.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM5400800120016002000SE +/- 3.15, N = 3SE +/- 2.47, N = 31886.011892.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM52004006008001000SE +/- 1.62, N = 3SE +/- 1.43, N = 3944.86948.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM530060090012001500SE +/- 2.68, N = 3SE +/- 2.53, N = 31195.041201.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM5130260390520650SE +/- 3.68, N = 3SE +/- 4.07, N = 3605.52609.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM52004006008001000SE +/- 1.48, N = 3SE +/- 1.08, N = 31101.331110.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUWraithNoctua NH-L9a-AM520406080100SE +/- 0.23, N = 3SE +/- 0.09, N = 393.6893.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

uvg266

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowNoctua NH-L9a-AM5Wraith0.14450.2890.43350.5780.72250.6390.642

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.13, N = 4SE +/- 0.14, N = 445.3845.49

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumNoctua NH-L9a-AM5Wraith1122334455SE +/- 0.07, N = 4SE +/- 0.12, N = 450.5850.68

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.10, N = 7SE +/- 0.07, N = 7120.31120.57

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.13, N = 8SE +/- 0.11, N = 8133.13133.17

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastWraithNoctua NH-L9a-AM5306090120150SE +/- 0.15, N = 8SE +/- 0.11, N = 8157.72157.91

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowNoctua NH-L9a-AM5Wraith3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 39.539.54

Kvazaar

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastNoctua NH-L9a-AM5Wraith0.47990.95981.43971.91962.39952.0852.133

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastWraithNoctua NH-L9a-AM50.8461.6922.5383.3844.233.7523.760

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastWraithNoctua NH-L9a-AM51.28722.57443.86165.14886.4365.6935.721

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowWraithNoctua NH-L9a-AM50.04140.08280.12420.16560.2070.1820.184

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumWraithNoctua NH-L9a-AM50.04210.08420.12630.16840.21050.1870.187

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastWraithNoctua NH-L9a-AM50.11390.22780.34170.45560.56950.4970.506

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastWraithNoctua NH-L9a-AM50.14690.29380.44070.58760.73450.6510.653

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumWraithNoctua NH-L9a-AM53691215SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6710.69

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowWraithNoctua NH-L9a-AM51428425670SE +/- 0.32, N = 5SE +/- 0.38, N = 560.8761.311. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastWraithNoctua NH-L9a-AM50.0920.1840.2760.3680.460.4020.409

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastNoctua NH-L9a-AM5Wraith714212835SE +/- 0.02, N = 3SE +/- 0.05, N = 330.4430.46

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastWraithNoctua NH-L9a-AM50.09830.19660.29490.39320.49150.4350.437

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastWraithNoctua NH-L9a-AM5816243240SE +/- 0.06, N = 3SE +/- 0.08, N = 332.5832.62

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith0.11950.2390.35850.4780.59750.5290.531

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith918273645SE +/- 0.05, N = 4SE +/- 0.03, N = 438.4938.51

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumWraithNoctua NH-L9a-AM51428425670SE +/- 0.47, N = 5SE +/- 0.35, N = 563.5963.921. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 2.13, N = 15SE +/- 2.03, N = 15115.14117.171. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastNoctua NH-L9a-AM5Wraith4080120160200SE +/- 0.22, N = 9SE +/- 0.12, N = 9177.09177.251. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith50100150200250SE +/- 0.60, N = 10SE +/- 0.56, N = 10238.53239.061. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith0.20140.40280.60420.80561.0070.8940.895

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowWraithNoctua NH-L9a-AM548121620SE +/- 0.04, N = 3SE +/- 0.05, N = 314.7714.781. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumWraithNoctua NH-L9a-AM548121620SE +/- 0.03, N = 3SE +/- 0.02, N = 315.0815.111. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastWraithNoctua NH-L9a-AM5816243240SE +/- 0.02, N = 4SE +/- 0.01, N = 436.2836.441. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastWraithNoctua NH-L9a-AM51020304050SE +/- 0.07, N = 4SE +/- 0.05, N = 445.7545.781. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith1326395265SE +/- 0.10, N = 5SE +/- 0.09, N = 559.4959.631. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM51020304050SE +/- 0.35, N = 3SE +/- 0.34, N = 343.9844.14

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM51530456075SE +/- 0.39, N = 3SE +/- 0.06, N = 364.9565.32

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM520406080100SE +/- 0.54, N = 3SE +/- 0.45, N = 386.0088.70

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5306090120150SE +/- 0.37, N = 3SE +/- 0.44, N = 3128.07130.62

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.10, N = 3SE +/- 0.23, N = 3126.54127.15

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM54080120160200SE +/- 0.27, N = 3SE +/- 0.25, N = 3202.32204.13

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5246810SE +/- 0.0151, N = 3SE +/- 0.0053, N = 38.09758.1273

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0051, N = 3SE +/- 0.0094, N = 38.72758.7362

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM51224364860SE +/- 0.13, N = 3SE +/- 0.06, N = 351.7451.95

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM520406080100SE +/- 0.06, N = 3SE +/- 0.49, N = 377.9678.19

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.11, N = 3SE +/- 0.06, N = 364.1064.22

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.47, N = 3SE +/- 0.27, N = 380.7781.43

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5246810SE +/- 0.0049, N = 3SE +/- 0.0095, N = 38.08818.1135

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5246810SE +/- 0.0075, N = 3SE +/- 0.0069, N = 38.73438.7367

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.06, N = 3SE +/- 0.40, N = 3138.71138.85

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM570140210280350SE +/- 0.37, N = 3SE +/- 0.36, N = 3298.63298.99

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5612182430SE +/- 0.02, N = 3SE +/- 0.01, N = 324.6124.65

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5714212835SE +/- 0.10, N = 3SE +/- 0.03, N = 327.8227.97

OpenEMS

OpenEMS is a free and open electromagnetic field solver using the FDTD method. This test profile runs OpenEMS and pyEMS benchmark demos. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMCells/s, More Is BetterOpenEMS 0.0.35-86Test: pyEMS CouplerWraithNoctua NH-L9a-AM51020304050SE +/- 1.40, N = 6SE +/- 0.55, N = 943.8344.291. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat

OpenBenchmarking.orgMCells/s Per Watt, More Is BetterOpenEMS 0.0.35-86Test: openEMS MSL_NotchFilterWraithNoctua NH-L9a-AM50.32650.6530.97951.3061.63251.3771.451

OpenBenchmarking.orgMCells/s, More Is BetterOpenEMS 0.0.35-86Test: openEMS MSL_NotchFilterNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.25, N = 3SE +/- 0.59, N = 363.2963.761. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat

Neural Magic DeepSparse

MinAvgMaxNoctua NH-L9a-AM5300048295439Wraith300048885440OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300046145440Noctua NH-L9a-AM5370046255439OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300047735439Wraith300048395439OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300046435439Wraith300046675440OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300048175304Wraith300048235439OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5331446815098Wraith370046914986OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxNoctua NH-L9a-AM5300047575430Wraith370048175440OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300047785439Noctua NH-L9a-AM5300047935402OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300048085422Wraith370048245415OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300045695440Noctua NH-L9a-AM5300045795380OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300048045155Noctua NH-L9a-AM5300048085432OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300047725193Noctua NH-L9a-AM5370047795165OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxNoctua NH-L9a-AM5300047295439Wraith300047765414OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith319747715393Noctua NH-L9a-AM5300047795414OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300048385439Wraith300048595390OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300046345439Wraith300046415415OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300047405439Wraith300047655398OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300047405396Noctua NH-L9a-AM5370047775432OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

RocksDB

MinAvgMaxNoctua NH-L9a-AM5370046674928Wraith370046955140OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxNoctua NH-L9a-AM5300047844913Wraith370047944919OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxNoctua NH-L9a-AM5300047305387Wraith300047325239OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300044594605Wraith300045075299OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300046974844Noctua NH-L9a-AM5300046975102OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300047074876Noctua NH-L9a-AM5300047214877OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxNoctua NH-L9a-AM5345547425077Wraith300047454953OpenBenchmarking.orgMegahertz, More Is BetterRocksDB 7.9.2CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Selenium

MinAvgMaxWraith300037705440Noctua NH-L9a-AM5300037945414OpenBenchmarking.orgMegahertz, More Is BetterSeleniumCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300042985440Wraith300043485440OpenBenchmarking.orgMegahertz, More Is BetterSeleniumCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300038725443Noctua NH-L9a-AM5300039375439OpenBenchmarking.orgMegahertz, More Is BetterSeleniumCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300041655440Noctua NH-L9a-AM5300042145439OpenBenchmarking.orgMegahertz, More Is BetterSeleniumCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

ClickHouse

MinAvgMaxNoctua NH-L9a-AM5300050165397Wraith300050315440OpenBenchmarking.orgMegahertz, More Is BetterClickHouse 22.12.3.5CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

PostgreSQL

MinAvgMaxNoctua NH-L9a-AM5299239275439Wraith297139595440OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300046885439Wraith300046965440OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5299236165439Wraith299137125440OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxNoctua NH-L9a-AM5300046785439Wraith300046975440OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith299237245440Noctua NH-L9a-AM5299037485439OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300046885440Noctua NH-L9a-AM5300047035439OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith299241365440Noctua NH-L9a-AM5299342295439OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300046915440Noctua NH-L9a-AM5300046925439OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) MonitorWraithNoctua NH-L9a-AM59001800270036004500Min: 2988 / Avg: 4648.85 / Max: 5440Min: 2994 / Avg: 4736.81 / Max: 5440

MinAvgMaxNoctua NH-L9a-AM5300046645439Wraith300046765440OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

BRL-CAD

MinAvgMaxWraith370044645330Noctua NH-L9a-AM5370044785239OpenBenchmarking.orgMegahertz, More Is BetterBRL-CAD 7.34CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenVINO

MinAvgMaxWraith300044275148Noctua NH-L9a-AM5370044525164OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300044795140Noctua NH-L9a-AM5300044975164OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300043075190Noctua NH-L9a-AM5370043245219OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300043995083Noctua NH-L9a-AM5300044105267OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxNoctua NH-L9a-AM5300045315252Wraith364445495165OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith370045195389Noctua NH-L9a-AM5370045715141OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith370044124925Noctua NH-L9a-AM5300044164536OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300044095214Noctua NH-L9a-AM5300044454564OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300043774526Noctua NH-L9a-AM5300044005366OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300045644861Noctua NH-L9a-AM5333745914888OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxWraith370044975160Noctua NH-L9a-AM5370045055181OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300045755276Noctua NH-L9a-AM5300045965225OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.3CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

oneDNN

MinAvgMaxNoctua NH-L9a-AM5300042855439Wraith319543655028OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith370045075438Noctua NH-L9a-AM5370045275438OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxWraith300039984664Noctua NH-L9a-AM5300040264707OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxWraith300045015039Noctua NH-L9a-AM5300045075042OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300046275291Noctua NH-L9a-AM5333446495198OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300044925117Noctua NH-L9a-AM5370045425269OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300046445340Noctua NH-L9a-AM5300046575308OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxWraith300045845227Noctua NH-L9a-AM5300046155314OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

RocksDB

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 7.9.2Test: Random FillNoctua NH-L9a-AM5Wraith3K6K9K12K15K13679.4613731.33

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random FillNoctua NH-L9a-AM5Wraith200K400K600K800K1000KSE +/- 3379.18, N = 3SE +/- 1263.47, N = 3116296611666131. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill SyncWraithNoctua NH-L9a-AM53K6K9K12K15KSE +/- 147.40, N = 3SE +/- 67.67, N = 315722159531. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 7.9.2Test: Sequential FillNoctua NH-L9a-AM5Wraith3K6K9K12K15K15945.3916241.97

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential FillNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 642.22, N = 3SE +/- 3237.54, N = 3121411112260771. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 7.9.2Test: Random ReadNoctua NH-L9a-AM5Wraith300K600K900K1200K1500K1240296.661243877.82

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 7.9.2Test: Read While WritingNoctua NH-L9a-AM5Wraith8K16K24K32K40K36740.5636978.18

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While WritingNoctua NH-L9a-AM5Wraith700K1400K2100K2800K3500KSE +/- 7283.63, N = 3SE +/- 43430.73, N = 3311416831447151. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomNoctua NH-L9a-AM5Wraith6K12K18K24K30K29467.4529720.72

OpenBenchmarking.orgOp/s Per Watt, More Is BetterRocksDB 7.9.2Test: Update RandomWraithNoctua NH-L9a-AM52K4K6K8K10K9049.689119.03

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random ReadNoctua NH-L9a-AM5Wraith20M40M60M80M100MSE +/- 438183.14, N = 3SE +/- 622147.23, N = 31050810821050902101. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomNoctua NH-L9a-AM5Wraith500K1000K1500K2000K2500KSE +/- 12706.45, N = 3SE +/- 10913.09, N = 3250356725199541. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomWraithNoctua NH-L9a-AM5170K340K510K680K850KSE +/- 904.07, N = 3SE +/- 1466.13, N = 37686557734611. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheNoctua NH-L9a-AM5Wraith50100150200250SE +/- 1.23, N = 3SE +/- 2.04, N = 5200.54205.19MIN: 14 / MAX: 8571.43MIN: 13.88 / MAX: 8571.43

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunWraithNoctua NH-L9a-AM550100150200250SE +/- 1.81, N = 5SE +/- 1.43, N = 3228.14232.45MIN: 14.25 / MAX: 10000MIN: 14.21 / MAX: 10000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunNoctua NH-L9a-AM5Wraith50100150200250SE +/- 3.31, N = 3SE +/- 1.63, N = 5235.09235.24MIN: 14.22 / MAX: 10000MIN: 14.23 / MAX: 8571.43

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

Benchmark: PSPDFKit WASM - Browser: Google Chrome

Wraith: The test quit with a non-zero exit status. E: NameError: name 'StaleElementReferenceException' is not defined

Noctua NH-L9a-AM5: The test quit with a non-zero exit status. E: NameError: name 'StaleElementReferenceException' is not defined

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteWraithNoctua NH-L9a-AM53K6K9K12K15KSE +/- 234.08, N = 12SE +/- 116.23, N = 315519156811. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 1401.49, N = 3SE +/- 10312.47, N = 3127191813049281. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteWraithNoctua NH-L9a-AM54K8K12K16K20KSE +/- 91.73, N = 3SE +/- 96.50, N = 316748168311. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 14728.11, N = 3SE +/- 2942.90, N = 3126512612954031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteWraithNoctua NH-L9a-AM54K8K12K16K20KSE +/- 120.21, N = 3SE +/- 149.35, N = 1216437164781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 12175.03, N = 3SE +/- 11732.69, N = 3124036512683751. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read WriteWraithNoctua NH-L9a-AM53K6K9K12K15KSE +/- 118.84, N = 3SE +/- 111.95, N = 315520156051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read OnlyWraithNoctua NH-L9a-AM5300K600K900K1200K1500KSE +/- 2024.35, N = 3SE +/- 5877.09, N = 3123566412693511. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 92.72, N = 3SE +/- 217.62, N = 1215435154851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 8627.67, N = 3SE +/- 8347.19, N = 3124575012529461. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Scaling Factor: 100 - Clients: 5000 - Mode: Read Write

Wraith: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Noctua NH-L9a-AM5: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Scaling Factor: 100 - Clients: 5000 - Mode: Read Only

Wraith: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Noctua NH-L9a-AM5: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance MetricNoctua NH-L9a-AM5Wraith60K120K180K240K300K2817952851941. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Neural Magic DeepSparse

MinAvgMaxWraith36.664.272.4Noctua NH-L9a-AM537.161.069.1OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith52.870.775.4Noctua NH-L9a-AM551.068.172.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith54.873.077.3Noctua NH-L9a-AM553.069.273.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith56.674.177.5Noctua NH-L9a-AM555.071.074.1OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith57.375.679.0Noctua NH-L9a-AM555.672.075.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith57.875.579.0Noctua NH-L9a-AM556.172.876.1OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.474.777.8Noctua NH-L9a-AM555.871.174.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.174.278.0Noctua NH-L9a-AM556.572.876.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith57.873.577.3Noctua NH-L9a-AM556.571.476.8OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.174.381.8Noctua NH-L9a-AM556.972.280.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.176.580.5Noctua NH-L9a-AM556.974.778.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith59.076.280.3Noctua NH-L9a-AM557.474.277.6OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith57.573.978.1Noctua NH-L9a-AM554.971.376.3OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.375.279.5Noctua NH-L9a-AM557.073.678.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.074.077.9Noctua NH-L9a-AM556.171.676.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.375.385.4Noctua NH-L9a-AM556.873.282.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.174.278.4Noctua NH-L9a-AM557.171.975.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

MinAvgMaxWraith58.375.383.8Noctua NH-L9a-AM557.173.281.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.3.2CPU Temperature Monitor20406080100

Selenium

MinAvgMaxNoctua NH-L9a-AM550.055.561.4Wraith44.150.564.4OpenBenchmarking.orgCelsius, Fewer Is BetterSeleniumCPU Temperature Monitor20406080100

MinAvgMaxNoctua NH-L9a-AM541.953.863.8Wraith39.852.364.6OpenBenchmarking.orgCelsius, Fewer Is BetterSeleniumCPU Temperature Monitor20406080100

MinAvgMaxNoctua NH-L9a-AM542.551.861.4Wraith41.550.160.3OpenBenchmarking.orgCelsius, Fewer Is BetterSeleniumCPU Temperature Monitor20406080100

MinAvgMaxNoctua NH-L9a-AM541.553.466.4Wraith40.052.165.0OpenBenchmarking.orgCelsius, Fewer Is BetterSeleniumCPU Temperature Monitor20406080100

PostgreSQL

MinAvgMaxNoctua NH-L9a-AM547.356.576.4Wraith45.955.276.4OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith44.075.582.4Noctua NH-L9a-AM544.574.180.0OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith46.856.378.1Noctua NH-L9a-AM546.955.678.3OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith44.375.982.9Noctua NH-L9a-AM544.073.880.4OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith48.157.878.8Noctua NH-L9a-AM546.555.076.8OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith45.376.383.3Noctua NH-L9a-AM544.173.781.3OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith51.662.878.8Noctua NH-L9a-AM551.361.777.6OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

MinAvgMaxWraith48.376.283.1Noctua NH-L9a-AM547.574.580.8OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature MonitorWraithNoctua NH-L9a-AM51530456075Min: 52.75 / Avg: 68.33 / Max: 78.13Min: 54.13 / Avg: 67.33 / Max: 77.38

MinAvgMaxWraith50.676.882.5Noctua NH-L9a-AM550.175.582.0OpenBenchmarking.orgCelsius, Fewer Is BetterPostgreSQL 15CPU Temperature Monitor20406080100

OpenVINO

MinAvgMaxWraith61.578.888.3Noctua NH-L9a-AM559.876.586.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.578.584.6Noctua NH-L9a-AM558.576.282.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith59.977.179.6Noctua NH-L9a-AM558.474.476.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith59.877.380.3Noctua NH-L9a-AM557.874.677.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.080.285.6Noctua NH-L9a-AM557.877.187.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.580.588.0Noctua NH-L9a-AM558.177.783.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith61.178.180.6Noctua NH-L9a-AM558.375.077.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.478.280.5Noctua NH-L9a-AM558.075.177.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.477.880.3Noctua NH-L9a-AM558.374.977.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.877.880.3Noctua NH-L9a-AM558.375.177.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.578.480.9Noctua NH-L9a-AM558.175.577.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

MinAvgMaxWraith60.678.881.4Noctua NH-L9a-AM558.376.178.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.3CPU Temperature Monitor20406080100

oneDNN

MinAvgMaxWraith60.470.974.4Noctua NH-L9a-AM558.668.472.3OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith55.475.481.6Noctua NH-L9a-AM553.973.178.9OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith57.164.568.3Noctua NH-L9a-AM555.462.466.3OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith52.369.374.0Noctua NH-L9a-AM550.567.071.5OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith55.470.778.9Noctua NH-L9a-AM553.368.776.8OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith54.868.072.0Noctua NH-L9a-AM552.865.769.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith54.578.684.4Noctua NH-L9a-AM552.876.382.1OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

MinAvgMaxWraith59.480.084.6Noctua NH-L9a-AM557.577.782.9OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.0CPU Temperature Monitor20406080100

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google ChromeNoctua NH-L9a-AM5Wraith50100150200250SE +/- 0.03, N = 5SE +/- 0.02, N = 5230.82230.811. chrome 109.0.5414.119

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Google ChromeWraithNoctua NH-L9a-AM548121620SE +/- 0.31, N = 15SE +/- 0.16, N = 618.2418.031. chrome 109.0.5414.119

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeNoctua NH-L9a-AM5Wraith80160240320400SE +/- 2.52, N = 3SE +/- 3.32, N = 3377.6376.71. chrome 109.0.5414.119

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyWraithNoctua NH-L9a-AM5246810SE +/- 0.099, N = 12SE +/- 0.047, N = 36.4606.3781. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.01780.03560.05340.07120.089SE +/- 0.000, N = 3SE +/- 0.001, N = 30.0790.0771. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyWraithNoctua NH-L9a-AM548121620SE +/- 0.08, N = 3SE +/- 0.08, N = 314.9314.851. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.04430.08860.13290.17720.2215SE +/- 0.002, N = 3SE +/- 0.001, N = 30.1970.1931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyWraithNoctua NH-L9a-AM5714212835SE +/- 0.22, N = 3SE +/- 0.29, N = 1230.4230.371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.09070.18140.27210.36280.4535SE +/- 0.004, N = 3SE +/- 0.003, N = 30.4030.3941. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average LatencyWraithNoctua NH-L9a-AM51224364860SE +/- 0.40, N = 3SE +/- 0.37, N = 351.5551.271. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average LatencyWraithNoctua NH-L9a-AM50.14580.29160.43740.58320.729SE +/- 0.001, N = 3SE +/- 0.003, N = 30.6480.6301. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.39, N = 3SE +/- 1.02, N = 1264.7964.731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.18070.36140.54210.72280.9035SE +/- 0.005, N = 3SE +/- 0.005, N = 30.8030.7981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM5140280420560700SE +/- 0.55, N = 3SE +/- 0.23, N = 3631.51629.79MIN: 552.36 / MAX: 655.2MIN: 553.7 / MAX: 655.391. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM570140210280350SE +/- 0.89, N = 3SE +/- 0.37, N = 3321.98321.36MIN: 227.32 / MAX: 342.52MIN: 285.91 / MAX: 334.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUWraithNoctua NH-L9a-AM50.09450.1890.28350.3780.4725SE +/- 0.00, N = 3SE +/- 0.00, N = 30.420.41MIN: 0.24 / MAX: 8.88MIN: 0.23 / MAX: 8.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith0.15750.3150.47250.630.7875SE +/- 0.00, N = 3SE +/- 0.00, N = 30.70.7MIN: 0.39 / MAX: 8.93MIN: 0.35 / MAX: 9.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM530060090012001500SE +/- 1.18, N = 3SE +/- 4.76, N = 31172.391164.82MIN: 669.11 / MAX: 1373.05MIN: 731.65 / MAX: 1351.61. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUNoctua NH-L9a-AM5Wraith30060090012001500SE +/- 10.05, N = 3SE +/- 4.20, N = 31193.031177.31MIN: 1010.43 / MAX: 1377.34MIN: 677.05 / MAX: 1380.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM5246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.366.34MIN: 3.54 / MAX: 14.82MIN: 3.48 / MAX: 13.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM5246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.356.32MIN: 3.25 / MAX: 14.93MIN: 3.23 / MAX: 14.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM51.12952.2593.38854.5185.6475SE +/- 0.01, N = 3SE +/- 0.01, N = 35.024.99MIN: 3.04 / MAX: 14.5MIN: 3.62 / MAX: 13.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM53691215SE +/- 0.06, N = 3SE +/- 0.07, N = 39.909.84MIN: 4.2 / MAX: 21.61MIN: 4.88 / MAX: 21.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUWraithNoctua NH-L9a-AM51.2242.4483.6724.8966.12SE +/- 0.01, N = 3SE +/- 0.01, N = 35.445.40MIN: 4 / MAX: 15.22MIN: 3.98 / MAX: 14.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUWraithNoctua NH-L9a-AM51428425670SE +/- 0.15, N = 3SE +/- 0.06, N = 364.0263.91MIN: 52.86 / MAX: 75.56MIN: 41.47 / MAX: 78.261. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM50.5031.0061.5092.0122.515SE +/- 0.01794, N = 9SE +/- 0.00682, N = 72.235702.21247MIN: 2.12MIN: 2.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM51.22182.44363.66544.88726.109SE +/- 0.02649, N = 3SE +/- 0.00123, N = 35.430175.39296MIN: 4.91MIN: 4.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM50.46440.92881.39321.85762.322SE +/- 0.00663, N = 9SE +/- 0.00572, N = 92.063952.05485MIN: 1.92MIN: 1.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM50.24950.4990.74850.9981.2475SE +/- 0.00091, N = 4SE +/- 0.00191, N = 41.108861.10190MIN: 1MIN: 0.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.39690.79381.19071.58761.9845SE +/- 0.00606, N = 5SE +/- 0.00435, N = 51.764051.76178MIN: 1.66MIN: 1.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM50.06790.13580.20370.27160.3395SE +/- 0.000157, N = 4SE +/- 0.000096, N = 40.3018260.301346MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM5400800120016002000SE +/- 3.38, N = 3SE +/- 1.28, N = 31632.361626.60MIN: 1623.03MIN: 1621.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM52004006008001000SE +/- 1.85, N = 3SE +/- 1.64, N = 3834.03829.47MIN: 826.35MIN: 822.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5510152025SE +/- 0.18, N = 3SE +/- 0.17, N = 322.7422.65

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM520406080100SE +/- 0.55, N = 3SE +/- 0.09, N = 392.3791.85

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM53691215SE +/- 0.07, N = 3SE +/- 0.06, N = 311.6211.27

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM51122334455SE +/- 0.13, N = 3SE +/- 0.15, N = 346.8445.92

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0066, N = 3SE +/- 0.0144, N = 37.89627.8579

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5714212835SE +/- 0.04, N = 3SE +/- 0.04, N = 329.6429.38

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5306090120150SE +/- 0.23, N = 3SE +/- 0.08, N = 3123.49123.04

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith150300450600750SE +/- 0.17, N = 3SE +/- 0.62, N = 3685.07684.28

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5510152025SE +/- 0.05, N = 3SE +/- 0.02, N = 319.3219.24

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM520406080100SE +/- 0.06, N = 3SE +/- 0.48, N = 376.9476.71

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith48121620SE +/- 0.03, N = 3SE +/- 0.02, N = 315.5815.55

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith1632486480SE +/- 0.44, N = 3SE +/- 0.23, N = 374.2273.62

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5306090120150SE +/- 0.08, N = 3SE +/- 0.14, N = 3123.63123.25

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5150300450600750SE +/- 0.53, N = 3SE +/- 0.58, N = 3684.93684.52

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0033, N = 3SE +/- 0.0206, N = 37.20397.1968

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5510152025SE +/- 0.03, N = 3SE +/- 0.02, N = 320.0820.05

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5918273645SE +/- 0.03, N = 3SE +/- 0.02, N = 340.6240.55

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM550100150200250SE +/- 0.76, N = 3SE +/- 0.21, N = 3215.61214.48

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSeleniumBenchmark: Maze Solver - Browser: Google ChromeWraithNoctua NH-L9a-AM5246810SE +/- 0.08, N = 15SE +/- 0.03, N = 46.36.21. chrome 109.0.5414.119

260 Results Shown

CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Megahertz
    Watts
OpenVINO:
  Face Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Vehicle Detection FP16 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
uvg266
uvg266:
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
  Bosphorus 4K - Slow
Kvazaar:
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
uvg266
Kvazaar
uvg266
uvg266
uvg266
uvg266
uvg266
uvg266
Kvazaar:
  Bosphorus 1080p - Medium
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
Kvazaar
Kvazaar:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Synchronous Single-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
OpenEMS
OpenEMS
OpenEMS
Neural Magic DeepSparse:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
  Rand Fill:
    Op/s Per Watt
RocksDB:
  Rand Fill
  Rand Fill Sync
RocksDB
RocksDB
RocksDB:
  Rand Read
  Read While Writing
RocksDB
RocksDB:
  Read Rand Write Rand
  Update Rand
RocksDB:
  Rand Read
  Read Rand Write Rand
  Update Rand
ClickHouse:
  100M Rows Hits Dataset, First Run / Cold Cache
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, Third Run
PostgreSQL:
  100 - 100 - Read Write
  100 - 100 - Read Only
  100 - 250 - Read Write
  100 - 250 - Read Only
  100 - 500 - Read Write
  100 - 500 - Read Only
  100 - 800 - Read Write
  100 - 800 - Read Only
  100 - 1000 - Read Write
  100 - 1000 - Read Only
BRL-CAD
Neural Magic DeepSparse:
  CPU Temp Monitor:
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
Selenium:
  WASM collisionDetection - Google Chrome
  WASM imageConvolute - Google Chrome
  Kraken - Google Chrome
PostgreSQL:
  100 - 100 - Read Write - Average Latency
  100 - 100 - Read Only - Average Latency
  100 - 250 - Read Write - Average Latency
  100 - 250 - Read Only - Average Latency
  100 - 500 - Read Write - Average Latency
  100 - 500 - Read Only - Average Latency
  100 - 800 - Read Write - Average Latency
  100 - 800 - Read Only - Average Latency
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Only - Average Latency
OpenVINO:
  Face Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Vehicle Detection FP16 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
oneDNN:
  Convolution Batch Shapes Auto - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
  IP Shapes 1D - bf16bf16bf16 - CPU
  IP Shapes 3D - bf16bf16bf16 - CPU
  Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Synchronous Single-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
Selenium