AM5 Noctua Cooling

Benchmarks for a future article by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301314-NE-AM5NOCTUA33
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Web Browsers 1 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 3 Tests
Creator Workloads 6 Tests
Database Test Suite 3 Tests
Encoding 2 Tests
HPC - High Performance Computing 3 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 3 Tests
Multi-Core 5 Tests
Intel oneAPI 2 Tests
Python Tests 4 Tests
Server 3 Tests
Video Encoding 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Wraith
January 29 2023
  9 Hours, 21 Minutes
Noctua NH-L9a-AM5
January 30 2023
  8 Hours, 34 Minutes
Invert Hiding All Results Option
  8 Hours, 58 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AM5 Noctua CoolingOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 7900 12-Core @ 3.70GHz (12 Cores / 24 Threads)Gigabyte B650M DS3H (F4h BIOS)AMD Device 14d832GB1000GB Sabrent Rocket 4.0 PlusGigabyte AMD Raphael 512MB (2200/2400MHz)AMD Rembrandt Radeon HD AudioASUS VP28URealtek RTL8125 2.5GbEUbuntu 22.106.2.0-060200rc5daily20230129-generic (x86_64)GNOME Shell 43.0X Server 1.21.1.4 + Wayland4.6 Mesa 23.0.0-devel (git-e20564c 2022-12-12 kinetic-oibaf-ppa) (LLVM 15.0.5 DRM 3.49)1.3.235GCC 12.2.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionAM5 Noctua Cooling BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Python 3.10.7- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Wraith vs. Noctua NH-L9a-AM5 ComparisonPhoronix Test SuiteBaseline+0.8%+0.8%+1.6%+1.6%+2.4%+2.4%3.1%3.1%2.9%2.7%2.4%2%2%N.T.C.D.m - S.S.SN.T.C.D.m - S.S.S100 - 800 - Read Only - Average Latency100 - 800 - Read Only100 - 100 - Read Only - Average Latency2.6%100 - 100 - Read Only2.6%A.G.R.R.0.F - CPU100 - 250 - Read Only2.4%1.R.H.D.F.R.C.C2.3%100 - 500 - Read Only - Average Latency2.3%100 - 500 - Read Only2.3%100 - 250 - Read Only - Average Latency2.1%N.T.C.D.m - A.M.SN.T.C.D.m - A.M.SNeural Magic DeepSparseNeural Magic DeepSparsePostgreSQLPostgreSQLPostgreSQLPostgreSQLOpenVINOPostgreSQLClickHousePostgreSQLPostgreSQLPostgreSQLNeural Magic DeepSparseNeural Magic DeepSparseWraithNoctua NH-L9a-AM5

AM5 Noctua Coolingopenems: pyEMS Couplerpgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 100 - Read Write - Average Latencypgbench: 100 - 100 - Read Writepgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Writeclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachebrl-cad: VGR Performance Metricpgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 250 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 800 - Read Onlypgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 250 - Read Onlypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 500 - Read Onlypgbench: 100 - 100 - Read Only - Average Latencypgbench: 100 - 100 - Read Onlyonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUuvg266: Bosphorus 4K - Slowopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenems: openEMS MSL_NotchFilterrocksdb: Rand Fill Syncopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUrocksdb: Rand Fillrocksdb: Update Randrocksdb: Read Rand Write Randrocksdb: Read While Writingrocksdb: Rand Readuvg266: Bosphorus 4K - Mediumselenium: Maze Solver - Google Chromedeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamkvazaar: Bosphorus 4K - Slowdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamkvazaar: Bosphorus 4K - Mediumdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamkvazaar: Bosphorus 1080p - Very Fastselenium: WASM imageConvolute - Google Chromekvazaar: Bosphorus 4K - Very Fastonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUuvg266: Bosphorus 4K - Ultra Fastonednn: IP Shapes 1D - bf16bf16bf16 - CPUuvg266: Bosphorus 4K - Very Fastrocksdb: Seq Fillselenium: WASM collisionDetection - Google Chromeuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 1080p - Slowkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastselenium: Kraken - Google Chromekvazaar: Bosphorus 1080p - Slowonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUuvg266: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Mediumonednn: IP Shapes 3D - bf16bf16bf16 - CPUuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Ultra Fastkvazaar: Bosphorus 1080p - Super Fastonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUkvazaar: Bosphorus 1080p - Ultra FastWraithNoctua NH-L9a-AM543.8364.734154856.4601551930.42316437235.24228.14205.192851940.798125294614.9281674851.552155200.64812356640.19312954030.39412683750.07713049281632.36834.0301177.315.069.541172.395.10631.519.45321.9818.6163.761572264.0293.685.441101.335.021195.049.9605.520.4228590.256.361886.010.716963.596.35944.8611666137686552519954314471510509021010.676.3215.606527.8248684.28198.7362684.93218.7343123.63418.088192.369964.949340.624324.6066123.49108.097522.737243.97697.1968138.845514.7719.320451.741715.0820.0754298.633476.939077.956411.624086.001346.8367128.06677.8579127.153815.550164.222373.622281.425929.6412202.3210117.1718.2436.285.4301738.511.1088630.461226077230.8132.5845.4945.7559.63376.760.872.235700.30182650.6863.591.76178133.17120.57157.72177.252.06395239.0644.2964.793154356.3781568130.37216478235.09232.45200.542817950.803124575014.8541683151.272156050.63012693510.19712651260.40312403650.07912719181626.60829.4701193.035.009.531164.825.12629.799.48321.3618.6463.291595363.9193.825.401110.014.991201.749.84609.330.4128734.236.341892.320.717032.326.32948.9911629667734612503567311416810508108210.696.2214.484927.9707685.07468.7275684.52318.7367123.24748.113591.846365.316940.547324.6534123.03748.127322.654744.13707.2039138.705714.7819.242051.951015.1120.0515298.989676.712578.192111.270488.695445.9209130.62137.8962126.537915.580064.098174.217180.774629.3785204.1332115.1418.0336.445.3929638.491.1019030.441214111230.8232.6245.3845.7859.49377.661.312.212470.30134650.5863.921.76405133.13120.31157.91177.092.05485238.53OpenBenchmarking.org

OpenEMS

OpenEMS is a free and open electromagnetic field solver using the FDTD method. This test profile runs OpenEMS and pyEMS benchmark demos. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMCells/s, More Is BetterOpenEMS 0.0.35-86Test: pyEMS CouplerNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.55, N = 9SE +/- 1.40, N = 644.2943.831. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyWraithNoctua NH-L9a-AM51428425670SE +/- 1.02, N = 12SE +/- 0.39, N = 364.7364.791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteWraithNoctua NH-L9a-AM53K6K9K12K15KSE +/- 217.62, N = 12SE +/- 92.72, N = 315485154351. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith246810SE +/- 0.047, N = 3SE +/- 0.099, N = 126.3786.4601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read WriteNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 116.23, N = 3SE +/- 234.08, N = 1215681155191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith714212835SE +/- 0.29, N = 12SE +/- 0.22, N = 330.3730.421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read WriteNoctua NH-L9a-AM5Wraith4K8K12K16K20KSE +/- 149.35, N = 12SE +/- 120.21, N = 316478164371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunWraithNoctua NH-L9a-AM550100150200250SE +/- 1.63, N = 5SE +/- 3.31, N = 3235.24235.09MIN: 14.23 / MAX: 8571.43MIN: 14.22 / MAX: 10000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunNoctua NH-L9a-AM5Wraith50100150200250SE +/- 1.43, N = 3SE +/- 1.81, N = 5232.45228.14MIN: 14.21 / MAX: 10000MIN: 14.25 / MAX: 10000

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheWraithNoctua NH-L9a-AM550100150200250SE +/- 2.04, N = 5SE +/- 1.23, N = 3205.19200.54MIN: 13.88 / MAX: 8571.43MIN: 14 / MAX: 8571.43

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance MetricWraithNoctua NH-L9a-AM560K120K180K240K300K2851942817951. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyWraithNoctua NH-L9a-AM50.18070.36140.54210.72280.9035SE +/- 0.005, N = 3SE +/- 0.005, N = 30.7980.8031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyWraithNoctua NH-L9a-AM5300K600K900K1200K1500KSE +/- 8347.19, N = 3SE +/- 8627.67, N = 3125294612457501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith48121620SE +/- 0.08, N = 3SE +/- 0.08, N = 314.8514.931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read WriteNoctua NH-L9a-AM5Wraith4K8K12K16K20KSE +/- 96.50, N = 3SE +/- 91.73, N = 316831167481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average LatencyNoctua NH-L9a-AM5Wraith1224364860SE +/- 0.37, N = 3SE +/- 0.40, N = 351.2751.551. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read WriteNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 111.95, N = 3SE +/- 118.84, N = 315605155201. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average LatencyNoctua NH-L9a-AM5Wraith0.14580.29160.43740.58320.729SE +/- 0.003, N = 3SE +/- 0.001, N = 30.6300.6481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read OnlyNoctua NH-L9a-AM5Wraith300K600K900K1200K1500KSE +/- 5877.09, N = 3SE +/- 2024.35, N = 3126935112356641. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyWraithNoctua NH-L9a-AM50.04430.08860.13290.17720.2215SE +/- 0.001, N = 3SE +/- 0.002, N = 30.1930.1971. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyWraithNoctua NH-L9a-AM5300K600K900K1200K1500KSE +/- 2942.90, N = 3SE +/- 14728.11, N = 3129540312651261. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyWraithNoctua NH-L9a-AM50.09070.18140.27210.36280.4535SE +/- 0.003, N = 3SE +/- 0.004, N = 30.3940.4031. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyWraithNoctua NH-L9a-AM5300K600K900K1200K1500KSE +/- 11732.69, N = 3SE +/- 12175.03, N = 3126837512403651. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average LatencyWraithNoctua NH-L9a-AM50.01780.03560.05340.07120.089SE +/- 0.001, N = 3SE +/- 0.000, N = 30.0770.0791. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 100 - Mode: Read OnlyWraithNoctua NH-L9a-AM5300K600K900K1200K1500KSE +/- 10312.47, N = 3SE +/- 1401.49, N = 3130492812719181. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith400800120016002000SE +/- 1.28, N = 3SE +/- 3.38, N = 31626.601632.36MIN: 1621.03MIN: 1623.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith2004006008001000SE +/- 1.64, N = 3SE +/- 1.85, N = 3829.47834.03MIN: 822.38MIN: 826.351. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUWraithNoctua NH-L9a-AM530060090012001500SE +/- 4.20, N = 3SE +/- 10.05, N = 31177.311193.03MIN: 677.05 / MAX: 1380.59MIN: 1010.43 / MAX: 1377.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUWraithNoctua NH-L9a-AM51.13852.2773.41554.5545.6925SE +/- 0.02, N = 3SE +/- 0.04, N = 35.065.001. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowWraithNoctua NH-L9a-AM53691215SE +/- 0.01, N = 3SE +/- 0.01, N = 39.549.53

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith30060090012001500SE +/- 4.76, N = 3SE +/- 1.18, N = 31164.821172.39MIN: 731.65 / MAX: 1351.6MIN: 669.11 / MAX: 1373.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith1.1522.3043.4564.6085.76SE +/- 0.02, N = 3SE +/- 0.00, N = 35.125.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith140280420560700SE +/- 0.23, N = 3SE +/- 0.55, N = 3629.79631.51MIN: 553.7 / MAX: 655.39MIN: 552.36 / MAX: 655.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith3691215SE +/- 0.00, N = 3SE +/- 0.01, N = 39.489.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith70140210280350SE +/- 0.37, N = 3SE +/- 0.89, N = 3321.36321.98MIN: 285.91 / MAX: 334.03MIN: 227.32 / MAX: 342.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith510152025SE +/- 0.03, N = 3SE +/- 0.06, N = 318.6418.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenEMS

OpenEMS is a free and open electromagnetic field solver using the FDTD method. This test profile runs OpenEMS and pyEMS benchmark demos. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMCells/s, More Is BetterOpenEMS 0.0.35-86Test: openEMS MSL_NotchFilterWraithNoctua NH-L9a-AM51428425670SE +/- 0.59, N = 3SE +/- 0.25, N = 363.7663.291. (CXX) g++ options: -O3 -rdynamic -ltinyxml -lcrypto -lcurl -lpthread -lsz -lz -ldl -lm -lexpat

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill SyncNoctua NH-L9a-AM5Wraith3K6K9K12K15KSE +/- 67.67, N = 3SE +/- 147.40, N = 315953157221. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.06, N = 3SE +/- 0.15, N = 363.9164.02MIN: 41.47 / MAX: 78.26MIN: 52.86 / MAX: 75.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.09, N = 3SE +/- 0.23, N = 393.8293.681. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith1.2242.4483.6724.8966.12SE +/- 0.01, N = 3SE +/- 0.01, N = 35.405.44MIN: 3.98 / MAX: 14.51MIN: 4 / MAX: 15.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith2004006008001000SE +/- 1.08, N = 3SE +/- 1.48, N = 31110.011101.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith1.12952.2593.38854.5185.6475SE +/- 0.01, N = 3SE +/- 0.01, N = 34.995.02MIN: 3.62 / MAX: 13.47MIN: 3.04 / MAX: 14.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith30060090012001500SE +/- 2.53, N = 3SE +/- 2.68, N = 31201.741195.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith3691215SE +/- 0.07, N = 3SE +/- 0.06, N = 39.849.90MIN: 4.88 / MAX: 21.38MIN: 4.2 / MAX: 21.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith130260390520650SE +/- 4.07, N = 3SE +/- 3.68, N = 3609.33605.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUNoctua NH-L9a-AM5Wraith0.09450.1890.28350.3780.4725SE +/- 0.00, N = 3SE +/- 0.00, N = 30.410.42MIN: 0.23 / MAX: 8.84MIN: 0.24 / MAX: 8.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUNoctua NH-L9a-AM5Wraith6K12K18K24K30KSE +/- 41.32, N = 3SE +/- 57.74, N = 328734.2328590.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.346.36MIN: 3.48 / MAX: 13.92MIN: 3.54 / MAX: 14.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith400800120016002000SE +/- 2.47, N = 3SE +/- 3.15, N = 31892.321886.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUWraithNoctua NH-L9a-AM50.15750.3150.47250.630.7875SE +/- 0.00, N = 3SE +/- 0.00, N = 30.70.7MIN: 0.35 / MAX: 9.23MIN: 0.39 / MAX: 8.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUNoctua NH-L9a-AM5Wraith4K8K12K16K20KSE +/- 28.68, N = 3SE +/- 22.38, N = 317032.3216963.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith246810SE +/- 0.01, N = 3SE +/- 0.01, N = 36.326.35MIN: 3.23 / MAX: 14.44MIN: 3.25 / MAX: 14.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUNoctua NH-L9a-AM5Wraith2004006008001000SE +/- 1.43, N = 3SE +/- 1.62, N = 3948.99944.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random FillWraithNoctua NH-L9a-AM5200K400K600K800K1000KSE +/- 1263.47, N = 3SE +/- 3379.18, N = 3116661311629661. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomNoctua NH-L9a-AM5Wraith170K340K510K680K850KSE +/- 1466.13, N = 3SE +/- 904.07, N = 37734617686551. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write RandomWraithNoctua NH-L9a-AM5500K1000K1500K2000K2500KSE +/- 10913.09, N = 3SE +/- 12706.45, N = 3251995425035671. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While WritingWraithNoctua NH-L9a-AM5700K1400K2100K2800K3500KSE +/- 43430.73, N = 3SE +/- 7283.63, N = 3314471531141681. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random ReadWraithNoctua NH-L9a-AM520M40M60M80M100MSE +/- 622147.23, N = 3SE +/- 438183.14, N = 31050902101050810821. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumNoctua NH-L9a-AM5Wraith3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 310.6910.67

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSeleniumBenchmark: Maze Solver - Browser: Google ChromeNoctua NH-L9a-AM5Wraith246810SE +/- 0.03, N = 4SE +/- 0.08, N = 156.26.31. chrome 109.0.5414.119

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith50100150200250SE +/- 0.21, N = 3SE +/- 0.76, N = 3214.48215.61

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith714212835SE +/- 0.03, N = 3SE +/- 0.10, N = 327.9727.82

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5150300450600750SE +/- 0.62, N = 3SE +/- 0.17, N = 3684.28685.07

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM5246810SE +/- 0.0094, N = 3SE +/- 0.0051, N = 38.73628.7275

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith150300450600750SE +/- 0.58, N = 3SE +/- 0.53, N = 3684.52684.93

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0069, N = 3SE +/- 0.0075, N = 38.73678.7343

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.14, N = 3SE +/- 0.08, N = 3123.25123.63

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0095, N = 3SE +/- 0.0049, N = 38.11358.0881

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.09, N = 3SE +/- 0.55, N = 391.8592.37

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith1530456075SE +/- 0.06, N = 3SE +/- 0.39, N = 365.3264.95

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith918273645SE +/- 0.02, N = 3SE +/- 0.03, N = 340.5540.62

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith612182430SE +/- 0.01, N = 3SE +/- 0.02, N = 324.6524.61

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.08, N = 3SE +/- 0.23, N = 3123.04123.49

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith246810SE +/- 0.0053, N = 3SE +/- 0.0151, N = 38.12738.0975

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith510152025SE +/- 0.17, N = 3SE +/- 0.18, N = 322.6522.74

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.34, N = 3SE +/- 0.35, N = 344.1443.98

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5246810SE +/- 0.0206, N = 3SE +/- 0.0033, N = 37.19687.2039

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5306090120150SE +/- 0.40, N = 3SE +/- 0.06, N = 3138.85138.71

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowNoctua NH-L9a-AM5Wraith48121620SE +/- 0.05, N = 3SE +/- 0.04, N = 314.7814.771. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith510152025SE +/- 0.02, N = 3SE +/- 0.05, N = 319.2419.32

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith1224364860SE +/- 0.06, N = 3SE +/- 0.13, N = 351.9551.74

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumNoctua NH-L9a-AM5Wraith48121620SE +/- 0.02, N = 3SE +/- 0.03, N = 315.1115.081. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

Benchmark: PSPDFKit WASM - Browser: Google Chrome

Wraith: The test quit with a non-zero exit status. E: NameError: name 'StaleElementReferenceException' is not defined

Noctua NH-L9a-AM5: The test quit with a non-zero exit status. E: NameError: name 'StaleElementReferenceException' is not defined

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith510152025SE +/- 0.02, N = 3SE +/- 0.03, N = 320.0520.08

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith70140210280350SE +/- 0.36, N = 3SE +/- 0.37, N = 3298.99298.63

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.48, N = 3SE +/- 0.06, N = 376.7176.94

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.49, N = 3SE +/- 0.06, N = 378.1977.96

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith3691215SE +/- 0.06, N = 3SE +/- 0.07, N = 311.2711.62

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamNoctua NH-L9a-AM5Wraith20406080100SE +/- 0.45, N = 3SE +/- 0.54, N = 388.7086.00

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith1122334455SE +/- 0.15, N = 3SE +/- 0.13, N = 345.9246.84

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.44, N = 3SE +/- 0.37, N = 3130.62128.07

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5246810SE +/- 0.0144, N = 3SE +/- 0.0066, N = 37.85797.8962

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM5306090120150SE +/- 0.23, N = 3SE +/- 0.10, N = 3127.15126.54

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM548121620SE +/- 0.02, N = 3SE +/- 0.03, N = 315.5515.58

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-StreamWraithNoctua NH-L9a-AM51428425670SE +/- 0.06, N = 3SE +/- 0.11, N = 364.2264.10

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM51632486480SE +/- 0.23, N = 3SE +/- 0.44, N = 373.6274.22

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamWraithNoctua NH-L9a-AM520406080100SE +/- 0.27, N = 3SE +/- 0.47, N = 381.4380.77

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith714212835SE +/- 0.04, N = 3SE +/- 0.04, N = 329.3829.64

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamNoctua NH-L9a-AM5Wraith4080120160200SE +/- 0.25, N = 3SE +/- 0.27, N = 3204.13202.32

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastWraithNoctua NH-L9a-AM5306090120150SE +/- 2.03, N = 15SE +/- 2.13, N = 15117.17115.141. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM imageConvolute - Browser: Google ChromeNoctua NH-L9a-AM5Wraith48121620SE +/- 0.16, N = 6SE +/- 0.31, N = 1518.0318.241. chrome 109.0.5414.119

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastNoctua NH-L9a-AM5Wraith816243240SE +/- 0.01, N = 4SE +/- 0.02, N = 436.4436.281. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith1.22182.44363.66544.88726.109SE +/- 0.00123, N = 3SE +/- 0.02649, N = 35.392965.43017MIN: 4.91MIN: 4.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastWraithNoctua NH-L9a-AM5918273645SE +/- 0.03, N = 4SE +/- 0.05, N = 438.5138.49

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.24950.4990.74850.9981.2475SE +/- 0.00191, N = 4SE +/- 0.00091, N = 41.101901.10886MIN: 0.99MIN: 11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastWraithNoctua NH-L9a-AM5714212835SE +/- 0.05, N = 3SE +/- 0.02, N = 330.4630.44

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential FillWraithNoctua NH-L9a-AM5300K600K900K1200K1500KSE +/- 3237.54, N = 3SE +/- 642.22, N = 3122607712141111. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: WASM collisionDetection - Browser: Google ChromeWraithNoctua NH-L9a-AM550100150200250SE +/- 0.02, N = 5SE +/- 0.03, N = 5230.81230.821. chrome 109.0.5414.119

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastNoctua NH-L9a-AM5Wraith816243240SE +/- 0.08, N = 3SE +/- 0.06, N = 332.6232.58

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowWraithNoctua NH-L9a-AM51020304050SE +/- 0.14, N = 4SE +/- 0.13, N = 445.4945.38

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastNoctua NH-L9a-AM5Wraith1020304050SE +/- 0.05, N = 4SE +/- 0.07, N = 445.7845.751. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastWraithNoctua NH-L9a-AM51326395265SE +/- 0.09, N = 5SE +/- 0.10, N = 559.6359.491. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Selenium

This test profile uses the Selenium WebDriver for running various browser benchmarks in different available web browsers such as Mozilla Firefox and Google Chrome. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterSeleniumBenchmark: Kraken - Browser: Google ChromeWraithNoctua NH-L9a-AM580160240320400SE +/- 3.32, N = 3SE +/- 2.52, N = 3376.7377.61. chrome 109.0.5414.119

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.38, N = 5SE +/- 0.32, N = 561.3160.871. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.5031.0061.5092.0122.515SE +/- 0.00682, N = 7SE +/- 0.01794, N = 92.212472.23570MIN: 2.13MIN: 2.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.06790.13580.20370.27160.3395SE +/- 0.000096, N = 4SE +/- 0.000157, N = 40.3013460.301826MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

Scaling Factor: 100 - Clients: 5000 - Mode: Read Write

Wraith: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Noctua NH-L9a-AM5: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumWraithNoctua NH-L9a-AM51122334455SE +/- 0.12, N = 4SE +/- 0.07, N = 450.6850.58

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumNoctua NH-L9a-AM5Wraith1428425670SE +/- 0.35, N = 5SE +/- 0.47, N = 563.9263.591. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

Scaling Factor: 100 - Clients: 5000 - Mode: Read Only

Wraith: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

Noctua NH-L9a-AM5: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUWraithNoctua NH-L9a-AM50.39690.79381.19071.58761.9845SE +/- 0.00435, N = 5SE +/- 0.00606, N = 51.761781.76405MIN: 1.67MIN: 1.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastWraithNoctua NH-L9a-AM5306090120150SE +/- 0.11, N = 8SE +/- 0.13, N = 8133.17133.13

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastWraithNoctua NH-L9a-AM5306090120150SE +/- 0.07, N = 7SE +/- 0.10, N = 7120.57120.31

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastNoctua NH-L9a-AM5Wraith306090120150SE +/- 0.11, N = 8SE +/- 0.15, N = 8157.91157.72

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastWraithNoctua NH-L9a-AM54080120160200SE +/- 0.12, N = 9SE +/- 0.22, N = 9177.25177.091. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUNoctua NH-L9a-AM5Wraith0.46440.92881.39321.85762.322SE +/- 0.00572, N = 9SE +/- 0.00663, N = 92.054852.06395MIN: 1.91MIN: 1.921. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastWraithNoctua NH-L9a-AM550100150200250SE +/- 0.56, N = 10SE +/- 0.60, N = 10239.06238.531. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringNoctua NH-L9a-AM5Wraith20406080100Min: 37.13 / Avg: 73.09 / Max: 90.13Min: 36.63 / Avg: 73.44 / Max: 92.5

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringWraithNoctua NH-L9a-AM520406080100Min: 5.96 / Avg: 65.84 / Max: 116.13Min: 5.72 / Avg: 68.56 / Max: 118.2

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringWraithNoctua NH-L9a-AM59001800270036004500Min: 2971 / Avg: 4519.91 / Max: 5443Min: 2990 / Avg: 4541.6 / Max: 5440

128 Results Shown

OpenEMS
PostgreSQL:
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
  100 - 100 - Read Write - Average Latency
  100 - 100 - Read Write
  100 - 500 - Read Write - Average Latency
  100 - 500 - Read Write
ClickHouse:
  100M Rows Hits Dataset, Third Run
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, First Run / Cold Cache
BRL-CAD
PostgreSQL:
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Only
  100 - 250 - Read Write - Average Latency
  100 - 250 - Read Write
  100 - 800 - Read Write - Average Latency
  100 - 800 - Read Write
  100 - 800 - Read Only - Average Latency
  100 - 800 - Read Only
  100 - 250 - Read Only - Average Latency
  100 - 250 - Read Only
  100 - 500 - Read Only - Average Latency
  100 - 500 - Read Only
  100 - 100 - Read Only - Average Latency
  100 - 100 - Read Only
oneDNN:
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
OpenVINO:
  Person Detection FP32 - CPU:
    ms
    FPS
uvg266
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
  Face Detection FP16 - CPU:
    ms
    FPS
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
OpenEMS
RocksDB
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
  Vehicle Detection FP16 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16 - CPU:
    ms
    FPS
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
  Weld Porosity Detection FP16 - CPU:
    ms
    FPS
RocksDB:
  Rand Fill
  Update Rand
  Read Rand Write Rand
  Read While Writing
  Rand Read
uvg266
Selenium
Neural Magic DeepSparse:
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream:
    ms/batch
    items/sec
  NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream:
    ms/batch
    items/sec
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream:
    ms/batch
    items/sec
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream:
    ms/batch
    items/sec
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream:
    ms/batch
    items/sec
Kvazaar
Neural Magic DeepSparse:
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream:
    ms/batch
    items/sec
Kvazaar
Neural Magic DeepSparse:
  NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream:
    ms/batch
    items/sec
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream:
    ms/batch
    items/sec
  CV Detection, YOLOv5s COCO - Synchronous Single-Stream:
    ms/batch
    items/sec
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    ms/batch
    items/sec
Kvazaar
Selenium
Kvazaar
oneDNN
uvg266
oneDNN
uvg266
RocksDB
Selenium
uvg266:
  Bosphorus 4K - Super Fast
  Bosphorus 1080p - Slow
Kvazaar:
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
Selenium
Kvazaar
oneDNN:
  Convolution Batch Shapes Auto - bf16bf16bf16 - CPU
  Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU
uvg266
Kvazaar
oneDNN
uvg266:
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Ultra Fast
Kvazaar
oneDNN
Kvazaar
CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Watts
    Megahertz