AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpus

Benchmarks for a future article on Phoronix.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301151-PTS-EO2022BE21
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Ryzen 5 7600
January 05 2023
  4 Hours, 52 Minutes
Ryzen 7 7700
January 01 2023
  4 Hours, 7 Minutes
Ryzen 9 7900
December 28 2022
  3 Hours, 35 Minutes
Ryzen 9 7950X
December 27 2022
  3 Hours, 17 Minutes
Core i5 12400
January 12 2023
  5 Hours, 15 Minutes
12400
January 13 2023
  5 Hours, 13 Minutes
13400
January 14 2023
  11 Hours, 43 Minutes
Core i5 13400
January 15 2023
  4 Hours, 54 Minutes
Invert Behavior (Only Show Selected Data)
  5 Hours, 22 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 13400AMD Ryzen 5 7600 6-Core @ 5.17GHz (6 Cores / 12 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21 HDMI AudioASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160AMD Ryzen 7 7700 8-Core @ 5.39GHz (8 Cores / 16 Threads)2000GB Samsung SSD 980 PRO 2TB + 2000GBAMD Ryzen 9 7900 12-Core @ 5.48GHz (12 Cores / 24 Threads)2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6750 XT 12GB (2880/1124MHz)AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)2000GB Samsung SSD 980 PRO 2TB + 257GB Flash DriveIntel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a272000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6700 XT 12GB (2855/1000MHz)Realtek ALC897ASUS VP28UIntel Device 7a70Intel Core i5-13400 @ 3.40GHz (10 Cores / 16 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 5 7600: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 7 7700: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7900: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7950X: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Core i5 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25- Core i5 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25Python Details- Python 3.10.4Security Details- Ryzen 5 7600: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 7 7700: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7900: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Core i5 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Core i5 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 13400Logarithmic Result OverviewPhoronix Test SuiteminiBUDEQuadRayOpenVINOBlenderXmrigOpenRadiossTimed Linux Kernel CompilationStargate Digital Audio WorkstationTensorFlowOpenVKLlibavif avifencNeural Magic DeepSparseY-CruncherSVT-AV1nekRSspaCyCockroachDBJPEG XL libjxlEnCodecJPEG XL Decoding libjxl

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusopenvino: Weld Porosity Detection FP16 - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1openvino: Face Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUquadray: 5 - 1080pquadray: 5 - 4Kquadray: 3 - 4Kquadray: 3 - 1080pquadray: 1 - 4Kopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUquadray: 1 - 1080pquadray: 2 - 4Kquadray: 2 - 1080popenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenradioss: Rubber O-Ring Seal Installationopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUopenvino: Face Detection FP16 - CPUdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamopenvino: Vehicle Detection FP16 - CPUblender: Barbershop - CPU-Onlydeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Face Detection FP16-INT8 - CPUblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyxmrig: Wownero - 1Mopenvino: Machine Translation EN To DE FP16 - CPUtensorflow: CPU - 64 - AlexNetblender: BMW27 - CPU-Onlybuild-linux-kernel: allmodconfigstargate: 44100 - 1024stargate: 96000 - 1024stargate: 44100 - 512stargate: 480000 - 512openradioss: Cell Phone Drop Testdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamopenvino: Person Detection FP32 - CPUtensorflow: CPU - 16 - GoogLeNetdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamstargate: 192000 - 1024tensorflow: CPU - 32 - GoogLeNetopenvino: Person Detection FP16 - CPUxmrig: Monero - 1Mstargate: 480000 - 1024tensorflow: CPU - 64 - GoogLeNetdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamavifenc: 6deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streambuild-linux-kernel: defconfigopenradioss: INIVOL and Fluid Structure Interaction Drop Containeronednn: IP Shapes 3D - u8s8f32 - CPUopenradioss: Bumper Beamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamopenvino: Person Vehicle Bike Detection FP16 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16-INT8 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUtensorflow: CPU - 32 - AlexNetonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUavifenc: 0openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamnginx: 200nginx: 100onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUopenvino: Vehicle Detection FP16 - CPUavifenc: 6, Losslessopenvino: Vehicle Detection FP16-INT8 - CPUnginx: 500openvkl: vklBenchmark ISPCopenradioss: Bird Strike on Windshieldonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUtensorflow: CPU - 32 - ResNet-50openvkl: vklBenchmark Scalaronednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 1D - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUstargate: 96000 - 512tensorflow: CPU - 64 - ResNet-50onednn: Deconvolution Batch shapes_3d - f32 - CPUtensorflow: CPU - 16 - ResNet-50cockroach: KV, 95% Reads - 256deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamy-cruncher: 500Mdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamy-cruncher: 1Bdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamavifenc: 2deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamsvt-av1: Preset 4 - Bosphorus 4Kspacy: en_core_web_trfcockroach: KV, 95% Reads - 1024svt-av1: Preset 8 - Bosphorus 4Kcockroach: KV, 95% Reads - 512cockroach: KV, 60% Reads - 1024nginx: 1000stargate: 192000 - 512svt-av1: Preset 8 - Bosphorus 1080popenvino: Weld Porosity Detection FP16 - CPUcockroach: KV, 50% Reads - 1024deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamtensorflow: CPU - 16 - AlexNetonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUcockroach: KV, 95% Reads - 128openvino: Face Detection FP16-INT8 - CPUcockroach: KV, 10% Reads - 1024svt-av1: Preset 4 - Bosphorus 1080ponednn: Deconvolution Batch shapes_1d - f32 - CPUavifenc: 10, Losslessonednn: IP Shapes 3D - bf16bf16bf16 - CPUsvt-av1: Preset 12 - Bosphorus 4Kopenfoam: drivaerFastback, Small Mesh Size - Execution Timecockroach: KV, 60% Reads - 512nekrs: TurboPipe Periodiccockroach: KV, 50% Reads - 512onednn: IP Shapes 1D - u8s8f32 - CPUsvt-av1: Preset 13 - Bosphorus 4Kopenfoam: drivaerFastback, Small Mesh Size - Mesh Timedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 1080pjpegxl-decode: Allcockroach: KV, 10% Reads - 512svt-av1: Preset 13 - Bosphorus 1080pjpegxl: JPEG - 90jpegxl: PNG - 90jpegxl: JPEG - 80onednn: Convolution Batch Shapes Auto - u8s8f32 - CPUjpegxl: PNG - 80onednn: IP Shapes 3D - f32 - CPUkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastbrl-cad: VGR Performance Metrickvazaar: Bosphorus 4K - Ultra Fastonednn: Convolution Batch Shapes Auto - f32 - CPUkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 4K - Ultra Fastjpegxl-decode: 1uvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumnginx: 20spacy: en_core_web_lgnginx: 4000encodec: 6 kbpsjpegxl: PNG - 100encodec: 24 kbpsencodec: 1.5 kbpsencodec: 3 kbpsclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachejpegxl: JPEG - 100clickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runcockroach: KV, 50% Reads - 128cockroach: KV, 10% Reads - 256cockroach: KV, 10% Reads - 128cockroach: KV, 50% Reads - 256cockroach: KV, 60% Reads - 128cockroach: MoVR - 512cockroach: MoVR - 128cockroach: KV, 60% Reads - 256cockroach: MoVR - 1024cockroach: MoVR - 256smhasher: wyhashRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 13400527.78519.8520.7945.3216542.873.070.772.429.3610.323.073.0140.512.8210.75701.4260.19684.780.36154.841054.549515.2935.51241.64133747.16113.641671.4077370.071287.7448.614210.36357.43173.74433.057963.266.42170.35134.761287.7173.0386442.2295542.9641162.901453104.8711.733285.18381319.780.0149.28931.4897679.151299.357111.32.97038278.3621.895545.65866.69461.695896.35576.50.996005140.2331.068732.18255.74.74744.74985.690.54784515.67539.3759363.7782897.042899.28148.412894.81451.111452.02142.8230.631.038681444.74211.96164.7177211.7154.723279667.0881219.420.31429210.89.9675.8474959.98163316.733.2960727.28771.580044.02951.349542.16168727.045.3531427.4564003.923.282915.07542.93633.17984.454967.86126.386542.00213.03584854217.337.02357478.44574871972.121.432106106.3117.5744158.460.8294114.993.2519966158.5386.143860310.345.412524.3762.59867126.653275.4576495814909970000044990.40.751812135.09335.667484631.5967631.9121523.708304.4732015.2577.56910.6310.9510.847.0729911.144.451346.3847.88104.2324.4930.5617368941.97.377729.45128.899.65172.419.5120.7885.9325.1866.4190.6729.5833.15108.635.876.6168924.191887471632.4828.3510.9632.94727.09228.4110.7911791.713607.46588.723677.215076.8125.8125.829982.1125.3125.8686.8676.11627.0456.8821216.533.880.983.0611.8413.113.893.9350.913.613.57815.5481.2878.340.37127.811366.9812465.6745.7161.53406580.85145.760191.7537492.6987.2857.337813.6273.02134.71334.8710175.549.24211.48103.861022.5134.3093783.1114224.1679814.05106885.148.0834123.61871013.2697.0261.67782.07927795.881026.047820.94.1998594.3917.062658.5855.45269.747578.962504.920.951469127.3225.001639.98844.96.12716.13245.850.43673512.47557.6436980.12752292.792286.06178.792284.921153.921153.65117.1080.640.8107271151.66164.10146.0935164.12696.092699945.51101913.040.2514558.118.1944.5594196.15206260.882.5230632.21981.269343.256391.001193.00319131.93.9403732.3281006.518.303312.70954.606828.01187.485556.28627.430543.58443.663105968924.145.41275589.858030.389489.331.958033128.8725.8255451.264.817133.383.358783774293.7247874.512.0414.391063.9392.49982151.27254.9280157896.55546120000051227.60.600197160.86831.599213652.214652.4324609.385320.9437644.8664.22311.2411.5211.427.3250111.714.3277.6513467.9888942.431940787991.41270.9331.22425.54326.9190.8911773.913882.36681.124135.414780.9126126.630242.8125.9125.8931.52914.96436.5999.3427745.565.231.314.0515.7217.165.245.2565.94.7517.71119.5599.461180.30.4384.431858.4416732.8863.24670.656781640.67204.9837128.5884683.3713.9982.239918.31200.2698.99245.3714345.360.28273.8276.34731.3625.3711733.9013515.2127995.02705969.197.5016133.21171137.54117.7486.97352.598702118.971140.44132795.268366117.3518.179554.99114.14272.930658.295351.060.361776104.2821.092547.4015.358.67078.65286.450.30927910.72595.5754593.19231659.311654.84217.931657.57844.735843.75793.720.710.61744845.732124.27078.0466124.26238.0472129714.87131511.710.186288.776.7325.08124644.27278201.842.1313937.781351.127072.463880.8632193.71108537.693.3910736.9295980.315.374110.77465.007823.04794.815346.28729.249646.64644.511139386491.757.16293584.771172.6116337.682.422028161.16.4468221.768.9368154.191.8440694461.6327.1955906.213.6633.461523.5761.52828185.429175.0657264464.36660100000057623.60.583775192.68926.423261693.0702691.4685685.384212.7443498.7739.02812.3612.7112.575.2095612.883.1765.6980874.171949625.371.0229.12624.29625.4690.9312631.314338.97076.925105.614938.5125.8125.930313.7126125.51446.821421.57856.86314.3644954.598.382.16.5325.0126.477.67.59103.217.4828.61703.89134.331851.750.3563.182903.2826078.9694.95340.433981554.95295.1781182.3955762.16470.397.80128.27130.3364.4159.2120480.959.51344.5449.54516.2558.4110545.8870847.7808747.52034954.984.9123203.35511048.95143.32115.00443.808642145.591045.7613104.37.590926143.415.441764.73643.21681.770843.41286.190.370988.116.637560.08984.6912.560112.53845.510.2093358.83693.6305113.11021132.891138.44260.051141.29576.369577.90472.0950.610.419833584.27485.936311.635985.962111.6325194668.2197728.820.12994510.495.5334.31177431.3344165.91.4080444.241750.6775581.734910.5821884.18867744.592.344642.65129868.612.79429.10178.098819.64784.237837.72527.089843.84735.1281806114820.866.416117739.291613.2149355.732.189449174.4045.5283215.669.4434173.851.75749109601.2282.7765240.211.913.140413.3971.54188198.497162.8275674346.97131420000066871.10.468351197.39722.570834635.5082633.815578.976267.2345991.3518.17511.6412.0211.95.1932412.173.213195.5991970.451980026.3450.9930.44825.21726.0730.921199713554.16757.624264.214664.6122.2122.830094.3122.8122.8207.49255.43510.2171.96329.922.180.551.76.97.451.321.3227.922.178.21318.6325.49390.020.94195.38788.776963.1725.05252098.2978.752449.7462205.521728.226.83987.93445.12217.84536.666231.7156.75109.57154.161597.0452.7280481.9426772.5900082.511893112.0914.721967.90693026.3947.9938.70651.28265949.293016.234585.32.64176249.9442.364123.60119.127111.7492122.039644.83178.3743.844822.80612.556.03366.03387.622.153845.1328102.4180.8960.86172.72645.7894173.07755.777619.4513.16610.25146333.3919.28751.81629919.7118.757642.828.761719.59334.759842.66119.729782.83438.083760.29662.405153555187.631.61156455.544079.61.16818387.11128.9141950.877.417890.3159000.6503.5936820.57.8995.841117.29643959.35692680000041073.5123.338497.1534497.2002453.392269.9830654.1497.7128.688.938.879.1433.1234.4775.4517.7922.2214959830.76.9394.937.13127.5314.4415.4964.1718.9355.7468.622.4125.1482.414.485.061590727.1950.8431.17926.04727.083180.380.83200.59202.9011841.813343.26631.223659.614590.1125.4125.329557.2125.8124.9209.02255.53410.2211.96317.972.180.551.76.727.411.331.3327.652.188.21316.1325.57390.030.94195.67790.356960.1424.6852094.0678.563648.8231205.791726.2926.74897.95444.9216.93535.476201.5156.31109.35154.31592.632.721681.9454862.5895812.503436111.9214.681668.09353010.5648.0939.25091.28469549.173012.8645902.65036749.9742.816623.35169.05112.1283121.358644.8178.1345.600821.927912.655.96666.01977.5822.823343.8089102.84180.6520.86174.37735.7346175.05975.712219.4313.10110.25147333.4319.32751.81141719.7218.735747028.757819.64534.762742.766121.512682.42438.173761.43672.408155755093.531.55356109.544239.51.17861886.71428.741862.476.373389.9659140.6503.1136894.87.9155.747116.983439815653830000040974.9123.734498.3122501.9394447.691271.9730683.9497.2178.929.089.099.2533.234.4375.6317.8422.2614955130.666.9495.037.12127.3614.4715.564.1518.9256.8868.522.425.1382.384.495.061588526.2060.8429.90125.01326.143185.390.83194.52196.9111716.513478.1662223631.114628.7124.9125.329540.2124.8124.9181.19185.2937.4122.525970.931.230.311.084.214.571.71.717.981.315.1637732.08460.221.66292.59684.896606.3326.93021583.0786.357254.5129249.831359.528.66979.26348.77171.62418.187122.9124.62117.43119.201243.6383.9834382.8216043.7119773.579666165.1314.597768.48422330.8754.7442.07601.85855256.002328.15168.43.86892757.5144.036622.70516.970173.503695.932796.75242.5243.057223.223210.66.47796.506814.5321.416046.6875108.31140.7151.51161.46426.1932161.38886.19611610.1208.68175387.7818.92932.54553219.4718.9468318.528.520720.45535.054843.368184.542865.72357.802891.47912.873104065255.637.99867125.851715.51.642601103.92955.149206.7118.513094.0569633.9429.8942546.19.0984.906134.94650477.04354920000045770.2141.411764.8044765.8951502.961304.2234012.0537.8869.599.719.759.8843.3745.0292.7122.2127.9320507838.318.67119.278.9165.2918.2919.5381.6323.9457.9988.3329.5532.93107.575.586.31645931.0360.8834.69129.12730.305212.370.86228.27225.5512043.813657.06690.823946.214829.2124.4124.229512.3124.4124.3179.69185.8487.4342.516046.321.230.311.084.214.551.71.717.951.315.16376.1832458.381.65291.76694.556605.8626.81421584.9186.878654.5751249.211365.2128.70429.17348.54171.28419.67156.9124.93117.14119.151245.0713.9734042.8142643.6753623.563979164.8414.605368.44992341.3954.7242.7451.85006655.952334.055164.33.8586557.543.955822.74667.011173.132996.778785.44239.4743.151223.172610.626.52956.492914.3421.137147.3035107.89140.4741.51161.69316.1844161.73376.182916.0410.0788.72176388.718.94932.52484719.4318.9768289.128.5320.42935.043443.61185.088765.42557.509191.49592.889103465146.237.93466905.651692.81.620242103.77455.6149201.1116.534294.3869900.2432.13425519.0124.983134.25250413.54347820000045816.5142.941765.8308761.8269500.426304.2334253.8533.9419.619.729.779.8743.6745.1392.5622.1127.7420473338.188.67119.648.88164.918.2519.4481.7223.7757.9188.2629.3732.86107.55.576.291663230.8220.8835.27829.31830.425209.340.86222.15224.4812118.2137046770.524114.214961.3124.6124.829664.7124.6124.9OpenBenchmarking.org

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30060090012001500209.02181.19207.49179.69527.78686.80931.521446.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

miniBUDE

MiniBUDE is a mini application for the the core computation of the Bristol University Docking Engine (BUDE). This test profile currently makes use of the OpenMP implementation of miniBUDE for CPU benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM11240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30060090012001500SE +/- 0.67, N = 3255.53185.29255.44185.85519.85676.12914.961421.581. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM11240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1326395265SE +/- 0.027, N = 310.2217.41210.2177.43420.79427.04536.59956.8631. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X481216201.902.521.902.515.326.889.3414.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X10K20K30K40K50K6317.975970.936329.926046.3216542.8721216.5327745.5644954.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

VectorChief's QuadRay is a real-time ray-tracing engine written to support SIMD across ARM, MIPS, PPC, and x86/x86_64 processors. QuadRay supports SSE/SSE2/SSE4 and AVX/AVX2/AVX-512 usage on Intel/AMD CPUs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.00, N = 32.181.232.181.233.073.885.238.381. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.47250.9451.41751.892.3625SE +/- 0.00, N = 30.550.310.550.310.770.981.312.101. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.00, N = 31.701.081.701.082.423.064.056.531. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X612182430SE +/- 0.00, N = 36.724.216.904.219.3611.8415.7225.011. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X612182430SE +/- 0.00, N = 37.414.577.454.5510.3213.1117.1626.471. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468101.331.701.321.703.073.895.247.601. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468101.331.701.321.703.013.935.257.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

VectorChief's QuadRay is a real-time ray-tracing engine written to support SIMD across ARM, MIPS, PPC, and x86/x86_64 processors. QuadRay supports SSE/SSE2/SSE4 and AVX/AVX2/AVX-512 usage on Intel/AMD CPUs. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.03, N = 327.6517.9827.9217.9540.5150.9165.90103.211. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.00, N = 32.181.312.171.312.823.604.757.481. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X714212835SE +/- 0.00, N = 38.215.168.215.1610.7513.5717.7028.601. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X400800120016002000316.13377.00318.63376.18701.42815.541119.551703.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30609012015025.5732.0825.4932.0060.1981.2099.46134.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X400800120016002000390.03460.22390.02458.38684.78878.341180.301851.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.37350.7471.12051.4941.86750.941.660.941.650.360.370.430.35MIN: 0.91 / MAX: 6.48MIN: 0.97 / MAX: 2.79MIN: 0.9 / MAX: 6.47MIN: 1.27 / MAX: 2.22MIN: 0.22 / MAX: 2.91MIN: 0.23 / MAX: 12.52MIN: 0.25 / MAX: 8.27MIN: 0.22 / MAX: 8.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal Installation1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300SE +/- 0.41, N = 3195.67292.59195.38291.76154.84127.8184.4363.18

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X6001200180024003000790.35684.89788.77694.551054.541366.981858.442903.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X6K12K18K24K30K6960.146606.336963.176605.869515.2912465.6716732.8826078.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.07, N = 324.6926.9325.0526.8135.5145.7263.2594.95

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.36930.73861.10791.47721.84651.6413301.5340600.6567810.433981MIN: 1.62MIN: 1.41MIN: 0.61MIN: 0.421. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50010001500200025002094.061583.072098.291584.91747.16580.85640.67554.95MIN: 2054 / MAX: 2144.08MIN: 1477.42 / MAX: 1887.76MIN: 2052.06 / MAX: 2136.02MIN: 1427.31 / MAX: 1889.25MIN: 702.8 / MAX: 764.81MIN: 540.23 / MAX: 609.84MIN: 582.42 / MAX: 667.21MIN: 524.6 / MAX: 612.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300SE +/- 0.33, N = 378.5686.3678.7586.88113.64145.76204.98295.18

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.05, N = 348.8254.5149.7554.5871.4191.75128.59182.40

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X160320480640800205.79249.83205.52249.21370.07492.60683.30762.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4008001200160020001726.291359.501728.201365.211287.74987.28713.99470.30

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.10, N = 326.7528.6726.8428.7048.6157.3482.2497.80

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X7142128357.959.267.939.1710.3613.6018.3128.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X100200300400500SE +/- 0.14, N = 3444.90348.77445.12348.54357.43273.02200.26130.33

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 0.17, N = 3216.93171.62217.84171.28173.74134.7198.9964.40

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X120240360480600535.47418.18536.66419.60433.05334.87245.37159.21

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmlrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1M1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4K8K12K16K20KSE +/- 15.59, N = 36201.57122.96231.77156.97963.210175.514345.320480.91. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150156.31124.62156.75124.9366.4249.2460.2859.51MIN: 149.83 / MAX: 167MIN: 111.98 / MAX: 178.7MIN: 149.92 / MAX: 175.47MIN: 111.3 / MAX: 183.58MIN: 32.92 / MAX: 70.79MIN: 28.96 / MAX: 62.2MIN: 49.85 / MAX: 73.62MIN: 30.43 / MAX: 93.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X70140210280350SE +/- 0.25, N = 3109.35117.43109.57117.14170.35211.48273.82344.54

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.02, N = 3154.30119.20154.16119.15134.76103.8676.3449.54

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfig1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30060090012001500SE +/- 0.19, N = 31592.631243.641597.051245.071287.721022.51731.36516.26

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.002717, N = 32.7216803.9834382.7280483.9734043.0386444.3093785.3711738.4110541. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.32462.64923.97385.29846.623SE +/- 0.000675, N = 31.9454862.8216041.9426772.8142642.2295543.1114223.9013515.8870841. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.000973, N = 32.5895813.7119772.5900083.6753622.9641164.1679815.2127997.7808741. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.001049, N = 32.5034363.5796662.5118933.5639792.9014534.0510685.0270597.5203491. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop Test1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 1.12, N = 3111.92165.13112.09164.84104.8785.1469.1954.98

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X48121620SE +/- 0.0097, N = 314.681614.597714.721914.605311.73328.08347.50164.9123

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.04, N = 368.0968.4867.9168.4585.18123.62133.21203.36

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030003010.562330.873026.392341.391319.701013.261137.541048.95MIN: 2966.05 / MAX: 3058.2MIN: 2130.11 / MAX: 3008.71MIN: 2963.75 / MAX: 3245.44MIN: 2163.53 / MAX: 3007.58MIN: 748.58 / MAX: 1432.8MIN: 678.12 / MAX: 1133.16MIN: 906.91 / MAX: 1301.86MIN: 661.91 / MAX: 1252.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.11, N = 348.0954.7447.9954.7280.0197.02117.74143.32

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.17, N = 339.2542.0838.7142.7549.2961.6886.97115.00

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.85691.71382.57073.42764.2845SE +/- 0.000775, N = 31.2846951.8585521.2826591.8500661.4897602.0792772.5987023.8086421. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.07, N = 349.1756.0049.2955.9579.1595.88118.97145.59

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030003012.862328.103016.232334.051299.351026.041140.441045.76MIN: 2985.99 / MAX: 3074.98MIN: 2104.47 / MAX: 2986.35MIN: 2973.48 / MAX: 3071.33MIN: 2135.53 / MAX: 3065.89MIN: 1211.98 / MAX: 1428.07MIN: 926.38 / MAX: 1134.19MIN: 761.08 / MAX: 1262.9MIN: 892.85 / MAX: 1274.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmlrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1M1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 5.44, N = 34590.05168.44585.35164.37111.37820.913279.013104.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.003281, N = 32.6503673.8689272.6417623.8586502.9703824.1998505.2683667.5909261. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.13, N = 349.9757.5149.9457.5078.3694.39117.35143.40

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.11, N = 342.8244.0442.3643.9621.9017.0618.1815.44

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1428425670SE +/- 0.06, N = 323.3522.7123.6022.7545.6658.5954.9964.74

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 61240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.012, N = 39.0506.9709.1277.0116.6945.4524.1423.2161. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.65, N = 3112.13173.50111.75173.1361.7069.7572.9381.77

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.34, N = 3121.3695.93122.0496.7896.3578.9658.3043.41

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop Container1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2004006008001000SE +/- 3.17, N = 3644.80796.75644.83785.44576.50504.92351.06286.19

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.22410.44820.67230.89641.12050.9960050.9514690.3617760.370900MIN: 0.93MIN: 0.85MIN: 0.34MIN: 0.321. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper Beam1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 2.21, N = 3178.13242.52178.37239.47140.23127.32104.2888.10

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.05, N = 345.6043.0643.8443.1531.0725.0021.0916.64

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1326395265SE +/- 0.02, N = 321.9323.2222.8123.1732.1839.9947.4060.09

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X369121512.6510.6012.5510.625.704.905.354.69MIN: 12.01 / MAX: 18.99MIN: 9.52 / MAX: 16.08MIN: 12.23 / MAX: 20.14MIN: 9.14 / MAX: 16.53MIN: 4.69 / MAX: 7.25MIN: 3.95 / MAX: 17.52MIN: 3.97 / MAX: 8.07MIN: 3.81 / MAX: 10.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0214, N = 35.96666.47796.03366.52954.74746.12718.670712.5601

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0278, N = 36.01976.50686.03386.49294.74986.13248.652812.5384

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X481216207.5814.537.6014.345.695.856.455.51MIN: 7.47 / MAX: 33.92MIN: 8.16 / MAX: 18.15MIN: 7.46 / MAX: 12.65MIN: 11.11 / MAX: 15.47MIN: 3.01 / MAX: 14.04MIN: 3.19 / MAX: 18.82MIN: 3.63 / MAX: 14.04MIN: 3.02 / MAX: 13.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.12330.24660.36990.49320.61650.5478450.4367350.3092790.209335MIN: 0.52MIN: 0.39MIN: 0.28MIN: 0.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X510152025SE +/- 0.0418, N = 322.823321.416022.153821.137115.675312.475510.72598.8369

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X36912159.375937.643695.575453.63050MIN: 8.99MIN: 7.01MIN: 5.15MIN: 3.491. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.09, N = 343.8146.6945.1347.3063.7880.1393.19113.11

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030002897.042292.791659.311132.89MIN: 2894.58MIN: 2263.98MIN: 1653.28MIN: 1126.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030002899.282286.061654.841138.44MIN: 2894.06MIN: 2264.7MIN: 1650.57MIN: 1134.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300SE +/- 0.40, N = 3102.84108.31102.40107.89148.41178.79217.93260.05

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030002894.802284.921657.571141.29MIN: 2890.45MIN: 2256.32MIN: 1652.65MIN: 1136.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X300600900120015001451.111153.92844.74576.37MIN: 1446.43MIN: 1131.1MIN: 841.12MIN: 571.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X300600900120015001452.021153.65843.76577.90MIN: 1449.41MIN: 1128.34MIN: 839.84MIN: 572.81. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 01240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.36, N = 3180.65140.72180.90140.47142.82117.1193.7272.101. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.33980.67961.01941.35921.6990.861.510.861.510.630.640.710.61MIN: 0.83 / MAX: 6.58MIN: 1.14 / MAX: 2.14MIN: 0.84 / MAX: 6.54MIN: 1.11 / MAX: 1.95MIN: 0.35 / MAX: 8.21MIN: 0.36 / MAX: 12.08MIN: 0.38 / MAX: 8.93MIN: 0.35 / MAX: 8.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.23370.46740.70110.93481.16851.0386800.8107270.6174400.419833MIN: 1MIN: 0.74MIN: 0.56MIN: 0.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X300600900120015001444.741151.66845.73584.27MIN: 1431.65MIN: 1129.92MIN: 841.79MIN: 578.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 0.02, N = 3174.38161.46172.73161.69211.96164.10124.2785.94

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0006, N = 35.73466.19325.78946.18444.71776.09358.046611.6359

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 0.25, N = 3175.06161.39173.08161.73211.72164.13124.2685.96

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0097, N = 35.71226.19615.77766.18294.72326.09268.047211.6325

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X40K80K120K160K200K79667.0899945.51129714.87194668.201. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Connections: 200

Core i5 12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Core i5 13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X40K80K120K160K200K81219.42101913.04131511.71197728.821. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Connections: 100

Core i5 12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Core i5 13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.07070.14140.21210.28280.35350.3142920.2514550.1862800.129945MIN: 0.3MIN: 0.22MIN: 0.17MIN: 0.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X51015202519.4316.0019.4516.0410.808.118.7710.49MIN: 18.46 / MAX: 26.18MIN: 14.09 / MAX: 25.84MIN: 18.39 / MAX: 25.47MIN: 13.66 / MAX: 25.82MIN: 5.27 / MAX: 12.56MIN: 4.87 / MAX: 21.23MIN: 7.17 / MAX: 17.28MIN: 4.87 / MAX: 19.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, Lossless1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.021, N = 313.10110.12013.16610.0789.9678.1946.7325.5331. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X369121510.258.6810.258.725.844.555.084.31MIN: 10.11 / MAX: 17.66MIN: 7.54 / MAX: 17.41MIN: 10.08 / MAX: 16.3MIN: 7.54 / MAX: 22.25MIN: 3.64 / MAX: 14.42MIN: 3.21 / MAX: 16.73MIN: 3.14 / MAX: 13.29MIN: 2.7 / MAX: 13.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X40K80K120K160K200K74959.9894196.15124644.27177431.301. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Connections: 500

Core i5 12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Core i5 13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPC1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X70140210280350SE +/- 0.58, N = 3147175146176163206278344MIN: 15 / MAX: 2299MIN: 18 / MAX: 2713MIN: 15 / MAX: 2301MIN: 19 / MAX: 2712MIN: 21 / MAX: 2129MIN: 27 / MAX: 2543MIN: 38 / MAX: 3234MIN: 55 / MAX: 2868

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on Windshield1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X80160240320400SE +/- 1.87, N = 3333.43387.78333.39388.70316.73260.88201.84165.90

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.74161.48322.22482.96643.7083.296072.523062.131391.40804MIN: 3.13MIN: 2.34MIN: 2.04MIN: 1.361. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-501240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.02, N = 319.3218.9219.2818.9427.2832.2137.7844.24

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalar1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.00, N = 3759375937798135175MIN: 7 / MAX: 1385MIN: 9 / MAX: 1775MIN: 7 / MAX: 1382MIN: 9 / MAX: 1779MIN: 7 / MAX: 1390MIN: 9 / MAX: 1750MIN: 13 / MAX: 2264MIN: 19 / MAX: 2252

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.35550.7111.06651.4221.77751.5800401.2693401.1270700.677558MIN: 1.5MIN: 1.15MIN: 1.04MIN: 0.61. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.90661.81322.71983.62644.5334.029503.256392.463881.73491MIN: 3.77MIN: 2.9MIN: 2.23MIN: 1.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.30360.60720.91081.21441.5181.3495401.0011900.8632190.582188MIN: 1.29MIN: 0.9MIN: 0.82MIN: 0.571. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.94251.8852.82753.774.7125SE +/- 0.001647, N = 31.8114172.5455321.8162992.5248472.1616873.0031913.7110854.1886771. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-501240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.02, N = 319.7219.4719.7119.4327.0431.9037.6944.59

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.20452.4093.61354.8186.02255.353143.940373.391072.34460MIN: 5.3MIN: 3.73MIN: 3.3MIN: 2.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-501240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.01, N = 318.7318.9418.7018.9727.4532.3236.9242.65

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30K60K90K120K150KSE +/- 126.38, N = 357470.068318.557642.868289.164003.981006.595980.3129868.6

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X714212835SE +/- 0.05, N = 328.7628.5228.7628.5323.2818.3015.3712.79

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500M1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X510152025SE +/- 0.057, N = 319.64520.45519.59320.42915.07512.70910.7749.101

Neural Magic DeepSparse

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.06, N = 334.7635.0534.7635.0442.9454.6165.0178.10

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1B1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.13, N = 342.7743.3742.6643.6133.1828.0123.0519.65

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.37, N = 3121.51184.54119.73185.0984.4587.4994.8284.24

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 21240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.04, N = 382.4265.7282.8365.4367.8656.2946.2937.731. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1326395265SE +/- 0.22, N = 338.1757.8038.0857.5126.3927.4329.2527.09

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.08, N = 361.4491.4860.3091.5042.0043.5846.6543.85

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.15382.30763.46144.61525.769SE +/- 0.004, N = 32.4082.8732.4052.8893.0353.6634.5115.1281. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

spaCy

The spaCy library is an open-source solution for advanced neural language processing (NLP). The spaCy library leverages Python and is a leading neural language processing solution. This test profile times the spaCy CPU performance with various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trf1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X400800120016002000SE +/- 2.60, N = 31557104015351034848105913931806

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 72.44, N = 355093.565255.655187.665146.254217.368924.186491.7114820.8

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1530456075SE +/- 0.10, N = 331.5538.0031.6137.9337.0245.4157.1666.421. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30K60K90K120K150KSE +/- 241.43, N = 356109.567125.856455.566905.657478.475589.893584.7117739.2

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 106.59, N = 344239.551715.544079.651692.845748.058030.371172.691613.2

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30K60K90K120K150K71972.1289489.33116337.68149355.731. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Connections: 1000

Core i5 12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Core i5 13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Stargate Digital Audio Workstation

Stargate is an open-source, cross-platform digital audio workstation (DAW) software package with "a unique and carefully curated experience" with scalability from old systems up through modern multi-core systems. Stargate is GPLv3 licensed and makes use of Qt5 (PyQt5) for its user-interface. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.5451.091.6352.182.725SE +/- 0.000398, N = 31.1786181.6426011.1681831.6202421.4321061.9580332.4220282.1894491. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.36, N = 386.71103.9387.11103.77106.31128.87161.10174.401. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X122436486028.7055.1028.9155.617.575.826.445.52MIN: 28.15 / MAX: 35.06MIN: 43.43 / MAX: 57.02MIN: 28.13 / MAX: 34.69MIN: 41.77 / MAX: 68.79MIN: 6.66 / MAX: 10.78MIN: 3.04 / MAX: 18.04MIN: 3.32 / MAX: 13.96MIN: 2.89 / MAX: 13.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 93.19, N = 341862.449206.741950.849201.144158.455451.268221.783215.6

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.50, N = 376.37118.5177.42116.5360.8364.8268.9469.44

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries too. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.07, N = 389.9694.0590.3194.38114.99133.38154.19173.85

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.75571.51142.26713.02283.77853.251993.358701.844061.75749MIN: 3.19MIN: 3.09MIN: 1.78MIN: 1.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 104.96, N = 359140.669633.959000.669900.266158.583774.094461.6109601.2

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X110220330440550503.11429.89503.59432.13386.14293.72327.19282.77MIN: 498.88 / MAX: 511.99MIN: 339.29 / MAX: 913.71MIN: 492.41 / MAX: 512.07MIN: 360.39 / MAX: 940.27MIN: 369.36 / MAX: 391.28MIN: 175.59 / MAX: 313.02MIN: 305.59 / MAX: 336.37MIN: 272.65 / MAX: 321.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X14K28K42K56K70KSE +/- 24.23, N = 336894.842546.136820.542551.038603.047874.555906.265240.2

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X48121620SE +/- 0.055, N = 37.9159.0987.8999.01210.34012.04113.66311.9101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.21782.43563.65344.87126.0895.412524.391063.461523.14041MIN: 5.22MIN: 3.82MIN: 3.03MIN: 2.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

libavif avifenc

This is a test of the AOMedia libavif library testing the encoding of a JPEG image to AV1 Image Format (AVIF). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, Lossless1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.31422.62843.94265.25686.571SE +/- 0.021, N = 35.7474.9065.8414.9834.3763.9393.5763.3971. (CXX) g++ options: -O3 -fPIC -lm

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.58471.16941.75412.33882.92352.598672.499821.528281.54188MIN: 2.52MIN: 2.28MIN: 1.45MIN: 1.451. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.26, N = 3116.98134.95117.30134.25126.65151.27185.43198.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300275.46254.93175.07162.831. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X16K32K48K64K80KSE +/- 42.65, N = 343981.050477.043959.350413.549581.057896.564464.374346.9

nekRS

nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe Periodic1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X15000M30000M45000M60000M75000MSE +/- 42366535.54, N = 356538300000435492000005692680000043478200000490997000005546120000066601000000713142000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X14K28K42K56K70KSE +/- 45.17, N = 340974.945770.241073.545816.544990.451227.657623.666871.1

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.16920.33840.50760.67680.8460.7518120.6001970.5837750.468351MIN: 0.73MIN: 0.55MIN: 0.54MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.71, N = 3123.73141.41123.34142.94135.09160.87192.69197.401. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X81624324035.6731.6026.4222.571. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

Neural Magic DeepSparse

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X170340510680850SE +/- 2.15, N = 3498.31764.80497.15765.83631.60652.21693.07635.51

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X170340510680850SE +/- 1.42, N = 3501.94765.90497.20761.83631.91652.43691.47633.82

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X150300450600750SE +/- 3.43, N = 3447.69502.96453.39500.43523.71609.39685.38578.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

JPEG XL Decoding libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is suited for JPEG XL decode performance testing to PNG output file, the pts/jpexl test is for encode performance. The JPEG XL encoding/decoding is done using the libjxl codebase. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: All1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X70140210280350SE +/- 0.38, N = 3271.97304.22269.98304.23304.47320.94212.74267.23

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X10K20K30K40K50KSE +/- 56.87, N = 330683.934012.030654.134253.832015.237644.843498.745991.3

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X160320480640800SE +/- 2.55, N = 3497.22537.89497.71533.94577.57664.22739.03518.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

JPEG XL libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 901240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.01, N = 38.929.598.689.6110.6311.2412.3611.641. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 901240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.01, N = 39.089.718.939.7210.9511.5212.7112.021. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 801240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.00, N = 39.099.758.879.7710.8411.4212.5711.901. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468107.072997.325015.209565.19324MIN: 7MIN: 6.99MIN: 5.13MIN: 5.141. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

JPEG XL libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 801240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.01, N = 39.259.889.149.8711.1411.7112.8812.171. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.00152.0033.00454.0065.00754.451304.327003.176003.21319MIN: 4.36MIN: 4.15MIN: 3.12MIN: 3.171. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 7600112233445533.2043.3733.1243.6746.381. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 7600112233445534.4345.0234.4745.1347.881. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010075.6392.7175.4592.56104.231. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760061218243017.8422.2117.7922.1124.491. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760071421283522.2627.9322.2227.7430.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

BRL-CAD

BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metric1240013400Core i5 12400Core i5 13400Ryzen 5 760040K80K120K160K200K1495512050781495982047331736891. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 7600102030405030.6638.3130.7038.1841.901. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468107.377727.651345.698085.59919MIN: 7.29MIN: 7.22MIN: 5.61MIN: 5.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 760036912156.948.676.938.679.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760030609012015095.03119.2794.93119.64128.891. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 760036912157.128.907.138.889.651. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76004080120160200127.36165.29127.53164.90172.401. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760051015202514.4718.2914.4418.2519.51

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760051015202515.5019.5315.4919.4420.78

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010064.1581.6364.1781.7285.93

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760061218243018.9223.9418.9323.7725.18

JPEG XL Decoding libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is suited for JPEG XL decode performance testing to PNG output file, the pts/jpexl test is for encode performance. The JPEG XL encoding/decoding is done using the libjxl codebase. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 11240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1632486480SE +/- 0.12, N = 356.8857.9955.7457.9166.4167.9874.1770.45

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010068.5088.3368.6088.2690.67

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 760071421283522.4029.5522.4129.3729.58

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 760081624324025.1332.9325.1432.8633.15

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010082.38107.5782.41107.50108.63

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 76001.32082.64163.96245.28326.6044.495.584.485.575.87

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 76002468105.066.305.066.296.61

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 20Ryzen 5 7600Ryzen 7 770020K40K60K80K100K68924.1988942.431. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Connections: 20

Ryzen 9 7900: The test quit with a non-zero exit status.

Ryzen 9 7950X: The test quit with a non-zero exit status.

Core i5 12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Core i5 13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

spaCy

The spaCy library is an open-source solution for advanced neural language processing (NLP). The spaCy library leverages Python and is a leading neural language processing solution. This test profile times the spaCy CPU performance with various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lg1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4K8K12K16K20KSE +/- 53.42, N = 31588516459159071663218874194071949619800

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 4000Ryzen 5 7600Ryzen 7 770020K40K60K80K100K71632.4887991.411. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Connections: 4000

Ryzen 9 7900: The test quit with a non-zero exit status.

Ryzen 9 7950X: The test quit with a non-zero exit status.

Core i5 12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

12400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

Core i5 13400: The test quit with a non-zero exit status. E: unable to connect to 127.0.0.1:8089 Connection refused

EnCodec

EnCodec is a Facebook/Meta developed AI means of compressing audio files using High Fidelity Neural Audio Compression. EnCodec is designed to provide codec compression at 6 kbps using their novel AI-powered compression technique. The test profile uses a lengthy JFK speech as the audio input for benchmarking and the performance measurement is measuring the time to encode the EnCodec file from WAV. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X71421283526.2131.0427.2030.8228.3527.0025.3726.35

JPEG XL libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 1001240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.22950.4590.68850.9181.1475SE +/- 0.00, N = 30.840.880.840.880.960.931.020.991. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

EnCodec

EnCodec is a Facebook/Meta developed AI means of compressing audio files using High Fidelity Neural Audio Compression. EnCodec is designed to provide codec compression at 6 kbps using their novel AI-powered compression technique. The test profile uses a lengthy JFK speech as the audio input for benchmarking and the performance measurement is measuring the time to encode the EnCodec file from WAV. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X81624324029.9034.6931.1835.2832.9531.2229.1330.45

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X71421283525.0129.1326.0529.3227.0925.5424.3025.22

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X71421283526.1430.3127.0830.4328.4126.9225.4726.07

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cache1240013400Core i5 12400Core i5 1340050100150200250185.00212.37180.38209.34MIN: 6.4 / MAX: 6666.67MIN: 9.19 / MAX: 7500MIN: 6.59 / MAX: 6666.67MIN: 9.46 / MAX: 7500

JPEG XL libjxl

The JPEG XL Image Coding System is designed to provide next-generation JPEG image capabilities with JPEG XL offering better image quality and compression over legacy JPEG. This test profile is currently focused on the multi-threaded JPEG XL image encode performance using the reference libjxl library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 1001240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.20930.41860.62790.83721.0465SE +/- 0.00, N = 30.830.860.830.860.790.890.930.921. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Run1240013400Core i5 12400Core i5 1340050100150200250194.52228.27200.59222.15MIN: 6.8 / MAX: 7500MIN: 9.34 / MAX: 8571.43MIN: 6.72 / MAX: 7500MIN: 9.54 / MAX: 7500

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Run1240013400Core i5 12400Core i5 1340050100150200250196.91225.55202.90224.48MIN: 6.79 / MAX: 7500MIN: 9.32 / MAX: 7500MIN: 6.79 / MAX: 8571.43MIN: 9.15 / MAX: 7500

CockroachDB

CockroachDB is a cloud-native, distributed SQL database for data intensive applications. This test profile uses a server-less CockroachDB configuration to test various Coackroach workloads on the local host with a single node. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 141.12, N = 311716.512043.811841.812118.211791.711773.912631.311997.0

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 57.49, N = 313478.113657.013343.213704.013607.413882.314338.913554.1

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X15003000450060007500SE +/- 28.90, N = 36622.06690.86631.26770.56588.76681.17076.96757.6

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X5K10K15K20K25KSE +/- 42.71, N = 323631.123946.223659.624114.223677.224135.425105.624264.2

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 39.43, N = 314628.714829.214590.114961.315076.814780.914938.514664.6

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.10, N = 3124.9124.4125.4124.6125.8126.0125.8122.2

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.07, N = 3125.3124.2125.3124.8125.8126.6125.9122.8

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X6K12K18K24K30KSE +/- 213.65, N = 329540.229512.329557.229664.729982.130242.830313.730094.3

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.07, N = 3124.8124.4125.8124.6125.3125.9126.0122.8

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.00, N = 3124.9124.3124.9124.9125.8125.8125.5122.8

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

Connections: 1

Ryzen 5 7600: The test quit with a non-zero exit status.

Ryzen 7 7700: The test quit with a non-zero exit status.

Ryzen 9 7900: The test quit with a non-zero exit status.

Ryzen 9 7950X: The test quit with a non-zero exit status.

Core i5 12400: The test quit with a non-zero exit status.

12400: The test quit with a non-zero exit status.

13400: The test quit with a non-zero exit status.

Core i5 13400: The test quit with a non-zero exit status.

SMHasher

SMHasher is a hash function tester supporting various algorithms and able to make use of AVX and other modern CPU instruction set extensions. Learn more via the OpenBenchmarking.org test page.

Hash: MeowHash x86_64 AES-NI

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: t1ha0_aes_avx2 x86_64

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: FarmHash32 x86_64 AVX

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: t1ha2_atonce

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: FarmHash128

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: fasthash32

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: Spooky32

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: SHA3-256

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Hash: wyhash

Ryzen 5 7600: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 7 7700: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7900: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Ryzen 9 7950X: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

12400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

Core i5 13400: The test quit with a non-zero exit status. E: ./smhasher: 3: ./SMHasher: not found

201 Results Shown

OpenVINO
miniBUDE:
  OpenMP - BM1:
    GFInst/s
    Billion Interactions/s
OpenVINO:
  Face Detection FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
QuadRay:
  5 - 1080p
  5 - 4K
  3 - 4K
  3 - 1080p
  1 - 4K
OpenVINO:
  Person Detection FP16 - CPU
  Person Detection FP32 - CPU
QuadRay:
  1 - 1080p
  2 - 4K
  2 - 1080p
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
OpenRadioss
OpenVINO:
  Weld Porosity Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Neural Magic DeepSparse
oneDNN
OpenVINO
Neural Magic DeepSparse:
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
OpenVINO
Blender
Neural Magic DeepSparse
OpenVINO
Blender:
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
Xmrig
OpenVINO
TensorFlow
Blender
Timed Linux Kernel Compilation
Stargate Digital Audio Workstation:
  44100 - 1024
  96000 - 1024
  44100 - 512
  480000 - 512
OpenRadioss
Neural Magic DeepSparse:
  CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream:
    ms/batch
    items/sec
OpenVINO
TensorFlow
Neural Magic DeepSparse
Stargate Digital Audio Workstation
TensorFlow
OpenVINO
Xmrig
Stargate Digital Audio Workstation
TensorFlow
Neural Magic DeepSparse:
  NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream:
    ms/batch
    items/sec
libavif avifenc
Neural Magic DeepSparse
Timed Linux Kernel Compilation
OpenRadioss
oneDNN
OpenRadioss
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream:
    ms/batch
    items/sec
OpenVINO
Neural Magic DeepSparse:
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
OpenVINO
oneDNN
Neural Magic DeepSparse
oneDNN
Neural Magic DeepSparse
oneDNN:
  Recurrent Neural Network Training - f32 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
TensorFlow
oneDNN:
  Recurrent Neural Network Training - u8s8f32 - CPU
  Recurrent Neural Network Inference - f32 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
libavif avifenc
OpenVINO
oneDNN:
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream:
    ms/batch
    items/sec
  NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream:
    ms/batch
    items/sec
nginx:
  200
  100
oneDNN
OpenVINO
libavif avifenc
OpenVINO
nginx
OpenVKL
OpenRadioss
oneDNN
TensorFlow
OpenVKL
oneDNN:
  IP Shapes 1D - bf16bf16bf16 - CPU
  IP Shapes 1D - f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
Stargate Digital Audio Workstation
TensorFlow
oneDNN
TensorFlow
CockroachDB
Neural Magic DeepSparse
Y-Cruncher
Neural Magic DeepSparse
Y-Cruncher
Neural Magic DeepSparse
libavif avifenc
Neural Magic DeepSparse:
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
SVT-AV1
spaCy
CockroachDB
SVT-AV1
CockroachDB:
  KV, 95% Reads - 512
  KV, 60% Reads - 1024
nginx
Stargate Digital Audio Workstation
SVT-AV1
OpenVINO
CockroachDB
Neural Magic DeepSparse
TensorFlow
oneDNN
CockroachDB
OpenVINO
CockroachDB
SVT-AV1
oneDNN
libavif avifenc
oneDNN
SVT-AV1
OpenFOAM
CockroachDB
nekRS
CockroachDB
oneDNN
SVT-AV1
OpenFOAM
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
SVT-AV1
JPEG XL Decoding libjxl
CockroachDB
SVT-AV1
JPEG XL libjxl:
  JPEG - 90
  PNG - 90
  JPEG - 80
oneDNN
JPEG XL libjxl
oneDNN
Kvazaar:
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 1080p - Very Fast
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
BRL-CAD
Kvazaar
oneDNN
Kvazaar:
  Bosphorus 4K - Slow
  Bosphorus 1080p - Super Fast
  Bosphorus 4K - Medium
  Bosphorus 1080p - Ultra Fast
uvg266:
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 1080p - Very Fast
  Bosphorus 4K - Ultra Fast
JPEG XL Decoding libjxl
uvg266:
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 1080p - Ultra Fast
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
nginx
spaCy
nginx
EnCodec
JPEG XL libjxl
EnCodec:
  24 kbps
  1.5 kbps
  3 kbps
ClickHouse
JPEG XL libjxl
ClickHouse:
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, Third Run
CockroachDB:
  KV, 50% Reads - 128
  KV, 10% Reads - 256
  KV, 10% Reads - 128
  KV, 50% Reads - 256
  KV, 60% Reads - 128
  MoVR - 512
  MoVR - 128
  KV, 60% Reads - 256
  MoVR - 1024
  MoVR - 256