AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpus

Benchmarks for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2301151-PTS-EO2022BE21&grs&sor.

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 13400AMD Ryzen 5 7600 6-Core @ 5.17GHz (6 Cores / 12 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21 HDMI AudioASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160AMD Ryzen 7 7700 8-Core @ 5.39GHz (8 Cores / 16 Threads)2000GB Samsung SSD 980 PRO 2TB + 2000GBAMD Ryzen 9 7900 12-Core @ 5.48GHz (12 Cores / 24 Threads)2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6750 XT 12GB (2880/1124MHz)AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)2000GB Samsung SSD 980 PRO 2TB + 257GB Flash DriveIntel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a272000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6700 XT 12GB (2855/1000MHz)Realtek ALC897ASUS VP28UIntel Device 7a70Intel Core i5-13400 @ 3.40GHz (10 Cores / 16 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 5 7600: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 7 7700: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7900: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7950X: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Core i5 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25- Core i5 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25Python Details- Python 3.10.4Security Details- Ryzen 5 7600: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 7 7700: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7900: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Core i5 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Core i5 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusopenvino: Weld Porosity Detection FP16 - CPUminibude: OpenMP - BM1minibude: OpenMP - BM1openvino: Face Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUquadray: 5 - 1080pquadray: 5 - 4Kquadray: 3 - 4Kquadray: 3 - 1080pquadray: 1 - 4Kopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUquadray: 1 - 1080pquadray: 2 - 4Kquadray: 2 - 1080popenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenradioss: Rubber O-Ring Seal Installationopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUopenvino: Face Detection FP16 - CPUdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamopenvino: Vehicle Detection FP16 - CPUblender: Barbershop - CPU-Onlydeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamopenvino: Face Detection FP16-INT8 - CPUblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyxmrig: Wownero - 1Mopenvino: Machine Translation EN To DE FP16 - CPUtensorflow: CPU - 64 - AlexNetblender: BMW27 - CPU-Onlybuild-linux-kernel: allmodconfigstargate: 44100 - 1024stargate: 96000 - 1024stargate: 44100 - 512stargate: 480000 - 512openradioss: Cell Phone Drop Testdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamopenvino: Person Detection FP32 - CPUtensorflow: CPU - 16 - GoogLeNetdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamstargate: 192000 - 1024tensorflow: CPU - 32 - GoogLeNetopenvino: Person Detection FP16 - CPUxmrig: Monero - 1Mstargate: 480000 - 1024tensorflow: CPU - 64 - GoogLeNetdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamavifenc: 6deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streambuild-linux-kernel: defconfigopenradioss: INIVOL and Fluid Structure Interaction Drop Containeronednn: IP Shapes 3D - u8s8f32 - CPUopenradioss: Bumper Beamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamopenvino: Person Vehicle Bike Detection FP16 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16-INT8 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUtensorflow: CPU - 32 - AlexNetonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUavifenc: 0openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamnginx: 200nginx: 100onednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUopenvino: Vehicle Detection FP16 - CPUavifenc: 6, Losslessopenvino: Vehicle Detection FP16-INT8 - CPUnginx: 500openvkl: vklBenchmark ISPCopenradioss: Bird Strike on Windshieldonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUtensorflow: CPU - 32 - ResNet-50openvkl: vklBenchmark Scalaronednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 1D - f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUstargate: 96000 - 512tensorflow: CPU - 64 - ResNet-50onednn: Deconvolution Batch shapes_3d - f32 - CPUtensorflow: CPU - 16 - ResNet-50cockroach: KV, 95% Reads - 256deepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamy-cruncher: 500Mdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamy-cruncher: 1Bdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamavifenc: 2deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamsvt-av1: Preset 4 - Bosphorus 4Kspacy: en_core_web_trfcockroach: KV, 95% Reads - 1024svt-av1: Preset 8 - Bosphorus 4Kcockroach: KV, 95% Reads - 512cockroach: KV, 60% Reads - 1024nginx: 1000stargate: 192000 - 512svt-av1: Preset 8 - Bosphorus 1080popenvino: Weld Porosity Detection FP16 - CPUcockroach: KV, 50% Reads - 1024deepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamtensorflow: CPU - 16 - AlexNetonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUcockroach: KV, 95% Reads - 128openvino: Face Detection FP16-INT8 - CPUcockroach: KV, 10% Reads - 1024svt-av1: Preset 4 - Bosphorus 1080ponednn: Deconvolution Batch shapes_1d - f32 - CPUavifenc: 10, Losslessonednn: IP Shapes 3D - bf16bf16bf16 - CPUsvt-av1: Preset 12 - Bosphorus 4Kopenfoam: drivaerFastback, Small Mesh Size - Execution Timecockroach: KV, 60% Reads - 512nekrs: TurboPipe Periodiccockroach: KV, 50% Reads - 512onednn: IP Shapes 1D - u8s8f32 - CPUsvt-av1: Preset 13 - Bosphorus 4Kopenfoam: drivaerFastback, Small Mesh Size - Mesh Timedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 1080pjpegxl-decode: Allcockroach: KV, 10% Reads - 512svt-av1: Preset 13 - Bosphorus 1080pjpegxl: JPEG - 90jpegxl: PNG - 90jpegxl: JPEG - 80onednn: Convolution Batch Shapes Auto - u8s8f32 - CPUjpegxl: PNG - 80onednn: IP Shapes 3D - f32 - CPUkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastbrl-cad: VGR Performance Metrickvazaar: Bosphorus 4K - Ultra Fastonednn: Convolution Batch Shapes Auto - f32 - CPUkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 4K - Ultra Fastjpegxl-decode: 1uvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumnginx: 20spacy: en_core_web_lgnginx: 4000encodec: 6 kbpsjpegxl: PNG - 100encodec: 24 kbpsencodec: 1.5 kbpsencodec: 3 kbpsclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachejpegxl: JPEG - 100clickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runcockroach: KV, 50% Reads - 128cockroach: KV, 10% Reads - 256cockroach: KV, 10% Reads - 128cockroach: KV, 50% Reads - 256cockroach: KV, 60% Reads - 128cockroach: MoVR - 512cockroach: MoVR - 128cockroach: KV, 60% Reads - 256cockroach: MoVR - 1024cockroach: MoVR - 256smhasher: wyhashRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 13400527.78519.8520.7945.3216542.873.070.772.429.3610.323.073.0140.512.8210.75701.4260.19684.780.36154.841054.549515.2935.51241.64133747.16113.641671.4077370.071287.7448.614210.36357.43173.74433.057963.266.42170.35134.761287.7173.0386442.2295542.9641162.901453104.8711.733285.18381319.780.0149.28931.4897679.151299.357111.32.97038278.3621.895545.65866.69461.695896.35576.50.996005140.2331.068732.18255.74.74744.74985.690.54784515.67539.3759363.7782897.042899.28148.412894.81451.111452.02142.8230.631.038681444.74211.96164.7177211.7154.723279667.0881219.420.31429210.89.9675.8474959.98163316.733.2960727.28771.580044.02951.349542.16168727.045.3531427.4564003.923.282915.07542.93633.17984.454967.86126.386542.00213.03584854217.337.02357478.44574871972.121.432106106.3117.5744158.460.8294114.993.2519966158.5386.143860310.345.412524.3762.59867126.653275.4576495814909970000044990.40.751812135.09335.667484631.5967631.9121523.708304.4732015.2577.56910.6310.9510.847.0729911.144.451346.3847.88104.2324.4930.5617368941.97.377729.45128.899.65172.419.5120.7885.9325.1866.4190.6729.5833.15108.635.876.6168924.191887471632.4828.3510.9632.94727.09228.4110.7911791.713607.46588.723677.215076.8125.8125.829982.1125.3125.8686.8676.11627.0456.8821216.533.880.983.0611.8413.113.893.9350.913.613.57815.5481.2878.340.37127.811366.9812465.6745.7161.53406580.85145.760191.7537492.6987.2857.337813.6273.02134.71334.8710175.549.24211.48103.861022.5134.3093783.1114224.1679814.05106885.148.0834123.61871013.2697.0261.67782.07927795.881026.047820.94.1998594.3917.062658.5855.45269.747578.962504.920.951469127.3225.001639.98844.96.12716.13245.850.43673512.47557.6436980.12752292.792286.06178.792284.921153.921153.65117.1080.640.8107271151.66164.10146.0935164.12696.092699945.51101913.040.2514558.118.1944.5594196.15206260.882.5230632.21981.269343.256391.001193.00319131.93.9403732.3281006.518.303312.70954.606828.01187.485556.28627.430543.58443.663105968924.145.41275589.858030.389489.331.958033128.8725.8255451.264.817133.383.358783774293.7247874.512.0414.391063.9392.49982151.27254.9280157896.55546120000051227.60.600197160.86831.599213652.214652.4324609.385320.9437644.8664.22311.2411.5211.427.3250111.714.3277.6513467.9888942.431940787991.41270.9331.22425.54326.9190.8911773.913882.36681.124135.414780.9126126.630242.8125.9125.8931.52914.96436.5999.3427745.565.231.314.0515.7217.165.245.2565.94.7517.71119.5599.461180.30.4384.431858.4416732.8863.24670.656781640.67204.9837128.5884683.3713.9982.239918.31200.2698.99245.3714345.360.28273.8276.34731.3625.3711733.9013515.2127995.02705969.197.5016133.21171137.54117.7486.97352.598702118.971140.44132795.268366117.3518.179554.99114.14272.930658.295351.060.361776104.2821.092547.4015.358.67078.65286.450.30927910.72595.5754593.19231659.311654.84217.931657.57844.735843.75793.720.710.61744845.732124.27078.0466124.26238.0472129714.87131511.710.186288.776.7325.08124644.27278201.842.1313937.781351.127072.463880.8632193.71108537.693.3910736.9295980.315.374110.77465.007823.04794.815346.28729.249646.64644.511139386491.757.16293584.771172.6116337.682.422028161.16.4468221.768.9368154.191.8440694461.6327.1955906.213.6633.461523.5761.52828185.429175.0657264464.36660100000057623.60.583775192.68926.423261693.0702691.4685685.384212.7443498.7739.02812.3612.7112.575.2095612.883.1765.6980874.171949625.371.0229.12624.29625.4690.9312631.314338.97076.925105.614938.5125.8125.930313.7126125.51446.821421.57856.86314.3644954.598.382.16.5325.0126.477.67.59103.217.4828.61703.89134.331851.750.3563.182903.2826078.9694.95340.433981554.95295.1781182.3955762.16470.397.80128.27130.3364.4159.2120480.959.51344.5449.54516.2558.4110545.8870847.7808747.52034954.984.9123203.35511048.95143.32115.00443.808642145.591045.7613104.37.590926143.415.441764.73643.21681.770843.41286.190.370988.116.637560.08984.6912.560112.53845.510.2093358.83693.6305113.11021132.891138.44260.051141.29576.369577.90472.0950.610.419833584.27485.936311.635985.962111.6325194668.2197728.820.12994510.495.5334.31177431.3344165.91.4080444.241750.6775581.734910.5821884.18867744.592.344642.65129868.612.79429.10178.098819.64784.237837.72527.089843.84735.1281806114820.866.416117739.291613.2149355.732.189449174.4045.5283215.669.4434173.851.75749109601.2282.7765240.211.913.140413.3971.54188198.497162.8275674346.97131420000066871.10.468351197.39722.570834635.5082633.815578.976267.2345991.3518.17511.6412.0211.95.1932412.173.213195.5991970.451980026.3450.9930.44825.21726.0730.921199713554.16757.624264.214664.6122.2122.830094.3122.8122.8207.49255.43510.2171.96329.922.180.551.76.97.451.321.3227.922.178.21318.6325.49390.020.94195.38788.776963.1725.05252098.2978.752449.7462205.521728.226.83987.93445.12217.84536.666231.7156.75109.57154.161597.0452.7280481.9426772.5900082.511893112.0914.721967.90693026.3947.9938.70651.28265949.293016.234585.32.64176249.9442.364123.60119.127111.7492122.039644.83178.3743.844822.80612.556.03366.03387.622.153845.1328102.4180.8960.86172.72645.7894173.07755.777619.4513.16610.25146333.3919.28751.81629919.7118.757642.828.761719.59334.759842.66119.729782.83438.083760.29662.405153555187.631.61156455.544079.61.16818387.11128.9141950.877.417890.3159000.6503.5936820.57.8995.841117.29643959.35692680000041073.5123.338497.1534497.2002453.392269.9830654.1497.7128.688.938.879.1433.1234.4775.4517.7922.2214959830.76.9394.937.13127.5314.4415.4964.1718.9355.7468.622.4125.1482.414.485.061590727.1950.8431.17926.04727.083180.380.83200.59202.9011841.813343.26631.223659.614590.1125.4125.329557.2125.8124.9209.02255.53410.2211.96317.972.180.551.76.727.411.331.3327.652.188.21316.1325.57390.030.94195.67790.356960.1424.6852094.0678.563648.8231205.791726.2926.74897.95444.9216.93535.476201.5156.31109.35154.31592.632.721681.9454862.5895812.503436111.9214.681668.09353010.5648.0939.25091.28469549.173012.8645902.65036749.9742.816623.35169.05112.1283121.358644.8178.1345.600821.927912.655.96666.01977.5822.823343.8089102.84180.6520.86174.37735.7346175.05975.712219.4313.10110.25147333.4319.32751.81141719.7218.735747028.757819.64534.762742.766121.512682.42438.173761.43672.408155755093.531.55356109.544239.51.17861886.71428.741862.476.373389.9659140.6503.1136894.87.9155.747116.983439815653830000040974.9123.734498.3122501.9394447.691271.9730683.9497.2178.929.089.099.2533.234.4375.6317.8422.2614955130.666.9495.037.12127.3614.4715.564.1518.9256.8868.522.425.1382.384.495.061588526.2060.8429.90125.01326.143185.390.83194.52196.9111716.513478.1662223631.114628.7124.9125.329540.2124.8124.9181.19185.2937.4122.525970.931.230.311.084.214.571.71.717.981.315.1637732.08460.221.66292.59684.896606.3326.93021583.0786.357254.5129249.831359.528.66979.26348.77171.62418.187122.9124.62117.43119.201243.6383.9834382.8216043.7119773.579666165.1314.597768.48422330.8754.7442.07601.85855256.002328.15168.43.86892757.5144.036622.70516.970173.503695.932796.75242.5243.057223.223210.66.47796.506814.5321.416046.6875108.31140.7151.51161.46426.1932161.38886.19611610.1208.68175387.7818.92932.54553219.4718.9468318.528.520720.45535.054843.368184.542865.72357.802891.47912.873104065255.637.99867125.851715.51.642601103.92955.149206.7118.513094.0569633.9429.8942546.19.0984.906134.94650477.04354920000045770.2141.411764.8044765.8951502.961304.2234012.0537.8869.599.719.759.8843.3745.0292.7122.2127.9320507838.318.67119.278.9165.2918.2919.5381.6323.9457.9988.3329.5532.93107.575.586.31645931.0360.8834.69129.12730.305212.370.86228.27225.5512043.813657.06690.823946.214829.2124.4124.229512.3124.4124.3179.69185.8487.4342.516046.321.230.311.084.214.551.71.717.951.315.16376.1832458.381.65291.76694.556605.8626.81421584.9186.878654.5751249.211365.2128.70429.17348.54171.28419.67156.9124.93117.14119.151245.0713.9734042.8142643.6753623.563979164.8414.605368.44992341.3954.7242.7451.85006655.952334.055164.33.8586557.543.955822.74667.011173.132996.778785.44239.4743.151223.172610.626.52956.492914.3421.137147.3035107.89140.4741.51161.69316.1844161.73376.182916.0410.0788.72176388.718.94932.52484719.4318.9768289.128.5320.42935.043443.61185.088765.42557.509191.49592.889103465146.237.93466905.651692.81.620242103.77455.6149201.1116.534294.3869900.2432.13425519.0124.983134.25250413.54347820000045816.5142.941765.8308761.8269500.426304.2334253.8533.9419.619.729.779.8743.6745.1392.5622.1127.7420473338.188.67119.648.88164.918.2519.4481.7223.7757.9188.2629.3732.86107.55.576.291663230.8220.8835.27829.31830.425209.340.86222.15224.4812118.2137046770.524114.214961.3124.6124.829664.7124.6124.9OpenBenchmarking.org

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 1240013400Core i5 13400300600900120015001446.82931.52686.80527.78209.02207.49181.19179.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 134001340030060090012001500SE +/- 0.67, N = 31421.58914.96676.12519.85255.53255.44185.85185.291. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 13400134001326395265SE +/- 0.027, N = 356.86336.59927.04520.79410.22110.2177.4347.4121. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124004812162014.369.346.885.322.522.511.901.901. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1240012400Core i5 134001340010K20K30K40K50K44954.5927745.5621216.5316542.876329.926317.976046.325970.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

Scene: 5 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 1340013400246810SE +/- 0.00, N = 38.385.233.883.072.182.181.231.231. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 5 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 13400134000.47250.9451.41751.892.3625SE +/- 0.00, N = 32.101.310.980.770.550.550.310.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 1340013400246810SE +/- 0.00, N = 36.534.053.062.421.701.701.081.081. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1240012400Core i5 1340013400612182430SE +/- 0.00, N = 325.0115.7211.849.366.906.724.214.211. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400612182430SE +/- 0.00, N = 326.4717.1613.1110.327.457.414.574.551. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124002468107.605.243.893.071.701.701.331.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124002468107.595.253.933.011.701.701.331.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

QuadRay

Scene: 1 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.03, N = 3103.2165.9050.9140.5127.9227.6517.9817.951. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 1340013400246810SE +/- 0.00, N = 37.484.753.602.822.182.171.311.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 1340013400714212835SE +/- 0.00, N = 328.6017.7013.5710.758.218.215.165.161. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 12400124004008001200160020001703.891119.55815.54701.42377.00376.18318.63316.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 12400306090120150134.3399.4681.2060.1932.0832.0025.5725.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124004008001200160020001851.751180.30878.34684.78460.22458.38390.03390.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7950XRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Core i5 1240012400Core i5 13400134000.37350.7471.12051.4941.86750.350.360.370.430.940.941.651.66MIN: 0.22 / MAX: 8.03MIN: 0.22 / MAX: 2.91MIN: 0.23 / MAX: 12.52MIN: 0.25 / MAX: 8.27MIN: 0.9 / MAX: 6.47MIN: 0.91 / MAX: 6.48MIN: 1.27 / MAX: 2.22MIN: 0.97 / MAX: 2.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1240012400Core i5 134001340060120180240300SE +/- 0.41, N = 363.1884.43127.81154.84195.38195.67291.76292.59

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 134001340060012001800240030002903.281858.441366.981054.54790.35788.77694.55684.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134006K12K18K24K30K26078.9616732.8812465.679515.296963.176960.146606.336605.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 124001240020406080100SE +/- 0.07, N = 394.9563.2545.7235.5126.9326.8125.0524.69

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.36930.73861.10791.47721.84650.4339810.6567811.5340601.641330MIN: 0.42MIN: 0.61MIN: 1.41MIN: 1.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 760013400Core i5 1340012400Core i5 124005001000150020002500554.95580.85640.67747.161583.071584.912094.062098.29MIN: 524.6 / MAX: 612.36MIN: 540.23 / MAX: 609.84MIN: 582.42 / MAX: 667.21MIN: 702.8 / MAX: 764.81MIN: 1477.42 / MAX: 1887.76MIN: 1427.31 / MAX: 1889.25MIN: 2054 / MAX: 2144.08MIN: 2052.06 / MAX: 2136.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 124001240060120180240300SE +/- 0.33, N = 3295.18204.98145.76113.6486.8886.3678.7578.56

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 12400124004080120160200SE +/- 0.05, N = 3182.40128.5991.7571.4154.5854.5149.7548.82

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 12400160320480640800762.16683.30492.60370.07249.83249.21205.79205.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 12400400800120016002000470.30713.99987.281287.741359.501365.211726.291728.20

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 124001240020406080100SE +/- 0.10, N = 397.8082.2457.3448.6128.7028.6726.8426.75

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 1240071421283528.2718.3113.6010.369.269.177.957.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 12400100200300400500SE +/- 0.14, N = 3130.33200.26273.02348.54348.77357.43444.90445.12

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 1240050100150200250SE +/- 0.17, N = 364.4098.99134.71171.28171.62173.74216.93217.84

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 12400120240360480600159.21245.37334.87418.18419.60433.05535.47536.66

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 12400124004K8K12K16K20KSE +/- 15.59, N = 320480.914345.310175.57963.27156.97122.96231.76201.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 7 7700Ryzen 9 7950XRyzen 9 7900Ryzen 5 760013400Core i5 1340012400Core i5 1240030609012015049.2459.5160.2866.42124.62124.93156.31156.75MIN: 28.96 / MAX: 62.2MIN: 30.43 / MAX: 93.61MIN: 49.85 / MAX: 73.62MIN: 32.92 / MAX: 70.79MIN: 111.98 / MAX: 178.7MIN: 111.3 / MAX: 183.58MIN: 149.83 / MAX: 167MIN: 149.92 / MAX: 175.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 124001240070140210280350SE +/- 0.25, N = 3344.54273.82211.48170.35117.43117.14109.57109.35

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 7600Core i5 1240012400306090120150SE +/- 0.02, N = 349.5476.34103.86119.15119.20134.76154.16154.30

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigRyzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 1240030060090012001500SE +/- 0.19, N = 3516.26731.361022.511243.641245.071287.721592.631597.05

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 1240012400246810SE +/- 0.002717, N = 38.4110545.3711734.3093783.9834383.9734043.0386442.7280482.7216801. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 124001.32462.64923.97385.29846.623SE +/- 0.000675, N = 35.8870843.9013513.1114222.8216042.8142642.2295541.9454861.9426771. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 1240012400246810SE +/- 0.000973, N = 37.7808745.2127994.1679813.7119773.6753622.9641162.5900082.5895811. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 1240012400246810SE +/- 0.001049, N = 37.5203495.0270594.0510683.5796663.5639792.9014532.5118932.5034361. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 13400134004080120160200SE +/- 1.12, N = 354.9869.1985.14104.87111.92112.09164.84165.13

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 1240048121620SE +/- 0.0097, N = 34.91237.50168.083411.733214.597714.605314.681614.7219

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124004080120160200SE +/- 0.04, N = 3203.36133.21123.6285.1868.4868.4568.0967.91

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 7 7700Ryzen 9 7950XRyzen 9 7900Ryzen 5 760013400Core i5 1340012400Core i5 1240060012001800240030001013.261048.951137.541319.702330.872341.393010.563026.39MIN: 678.12 / MAX: 1133.16MIN: 661.91 / MAX: 1252.57MIN: 906.91 / MAX: 1301.86MIN: 748.58 / MAX: 1432.8MIN: 2130.11 / MAX: 3008.71MIN: 2163.53 / MAX: 3007.58MIN: 2966.05 / MAX: 3058.2MIN: 2963.75 / MAX: 3245.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 12400306090120150SE +/- 0.11, N = 3143.32117.7497.0280.0154.7454.7248.0947.99

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 12400306090120150SE +/- 0.17, N = 3115.0086.9761.6849.2942.7542.0839.2538.71

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 124000.85691.71382.57073.42764.2845SE +/- 0.000775, N = 33.8086422.5987022.0792771.8585521.8500661.4897601.2846951.2826591. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 1240012400306090120150SE +/- 0.07, N = 3145.59118.9795.8879.1556.0055.9549.2949.17

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 7 7700Ryzen 9 7950XRyzen 9 7900Ryzen 5 760013400Core i5 1340012400Core i5 1240060012001800240030001026.041045.761140.441299.352328.102334.053012.863016.23MIN: 926.38 / MAX: 1134.19MIN: 892.85 / MAX: 1274.02MIN: 761.08 / MAX: 1262.9MIN: 1211.98 / MAX: 1428.07MIN: 2104.47 / MAX: 2986.35MIN: 2135.53 / MAX: 3065.89MIN: 2985.99 / MAX: 3074.98MIN: 2973.48 / MAX: 3071.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MRyzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124003K6K9K12K15KSE +/- 5.44, N = 313279.013104.37820.97111.35168.45164.34590.04585.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 12400246810SE +/- 0.003281, N = 37.5909265.2683664.1998503.8689273.8586502.9703822.6503672.6417621. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 12400306090120150SE +/- 0.13, N = 3143.40117.3594.3978.3657.5157.5049.9749.94

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 7600Core i5 1240012400Core i5 13400134001020304050SE +/- 0.11, N = 315.4417.0618.1821.9042.3642.8243.9644.04

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 7600Core i5 1240012400Core i5 13400134001428425670SE +/- 0.06, N = 364.7458.5954.9945.6623.6023.3522.7522.71

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124003691215SE +/- 0.012, N = 33.2164.1425.4526.6946.9707.0119.0509.1271. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 1240012400Core i5 13400134004080120160200SE +/- 0.65, N = 361.7069.7572.9381.77111.75112.13173.13173.50

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigRyzen 9 7950XRyzen 9 7900Ryzen 7 770013400Ryzen 5 7600Core i5 1340012400Core i5 12400306090120150SE +/- 0.34, N = 343.4158.3078.9695.9396.3596.78121.36122.04

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 13400134002004006008001000SE +/- 3.17, N = 3286.19351.06504.92576.50644.80644.83785.44796.75

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPURyzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 76000.22410.44820.67230.89641.12050.3617760.3709000.9514690.996005MIN: 0.34MIN: 0.32MIN: 0.85MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 134001340050100150200250SE +/- 2.21, N = 388.10104.28127.32140.23178.13178.37239.47242.52

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 12400124001020304050SE +/- 0.05, N = 316.6421.0925.0031.0743.0643.1543.8445.60

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 12400124001326395265SE +/- 0.02, N = 360.0947.4039.9932.1823.2223.1722.8121.93

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 760013400Core i5 13400Core i5 124001240036912154.694.905.355.7010.6010.6212.5512.65MIN: 3.81 / MAX: 10.73MIN: 3.95 / MAX: 17.52MIN: 3.97 / MAX: 8.07MIN: 4.69 / MAX: 7.25MIN: 9.52 / MAX: 16.08MIN: 9.14 / MAX: 16.53MIN: 12.23 / MAX: 20.14MIN: 12.01 / MAX: 18.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Core i5 1340013400Ryzen 7 7700Core i5 1240012400Ryzen 5 76003691215SE +/- 0.0214, N = 312.56018.67076.52956.47796.12716.03365.96664.7474

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 790013400Core i5 13400Ryzen 7 7700Core i5 1240012400Ryzen 5 76003691215SE +/- 0.0278, N = 312.53848.65286.50686.49296.13246.03386.01974.7498

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 5 7600Ryzen 7 7700Ryzen 9 790012400Core i5 12400Core i5 1340013400481216205.515.695.856.457.587.6014.3414.53MIN: 3.02 / MAX: 13.92MIN: 3.01 / MAX: 14.04MIN: 3.19 / MAX: 18.82MIN: 3.63 / MAX: 14.04MIN: 7.47 / MAX: 33.92MIN: 7.46 / MAX: 12.65MIN: 11.11 / MAX: 15.47MIN: 8.16 / MAX: 18.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.12330.24660.36990.49320.61650.2093350.3092790.4367350.547845MIN: 0.2MIN: 0.28MIN: 0.39MIN: 0.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 1240012400510152025SE +/- 0.0418, N = 38.836910.725912.475515.675321.137121.416022.153822.8233

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760036912153.630505.575457.643699.37593MIN: 3.49MIN: 5.15MIN: 7.01MIN: 8.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 1240012400306090120150SE +/- 0.09, N = 3113.1193.1980.1363.7847.3046.6945.1343.81

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060012001800240030001132.891659.312292.792897.04MIN: 1126.66MIN: 1653.28MIN: 2263.98MIN: 2894.581. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060012001800240030001138.441654.842286.062899.28MIN: 1134.81MIN: 1650.57MIN: 2264.7MIN: 2894.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 1240060120180240300SE +/- 0.40, N = 3260.05217.93178.79148.41108.31107.89102.84102.40

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060012001800240030001141.291657.572284.922894.80MIN: 1136.34MIN: 1652.65MIN: 2256.32MIN: 2890.451. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030060090012001500576.37844.741153.921451.11MIN: 571.99MIN: 841.12MIN: 1131.1MIN: 1446.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030060090012001500577.90843.761153.651452.02MIN: 572.8MIN: 839.84MIN: 1128.34MIN: 1449.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 124004080120160200SE +/- 0.36, N = 372.1093.72117.11140.47140.72142.82180.65180.901. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7950XRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Core i5 124001240013400Core i5 134000.33980.67961.01941.35921.6990.610.630.640.710.860.861.511.51MIN: 0.35 / MAX: 8.79MIN: 0.35 / MAX: 8.21MIN: 0.36 / MAX: 12.08MIN: 0.38 / MAX: 8.93MIN: 0.84 / MAX: 6.54MIN: 0.83 / MAX: 6.58MIN: 1.14 / MAX: 2.14MIN: 1.11 / MAX: 1.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.23370.46740.70110.93481.16850.4198330.6174400.8107271.038680MIN: 0.4MIN: 0.56MIN: 0.74MIN: 11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030060090012001500584.27845.731151.661444.74MIN: 578.68MIN: 841.79MIN: 1129.92MIN: 1431.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 790013400Core i5 13400Ryzen 7 7700Core i5 1240012400Ryzen 5 760050100150200250SE +/- 0.02, N = 385.94124.27161.46161.69164.10172.73174.38211.96

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 790013400Core i5 13400Ryzen 7 7700Core i5 1240012400Ryzen 5 76003691215SE +/- 0.0006, N = 311.63598.04666.19326.18446.09355.78945.73464.7177

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 790013400Core i5 13400Ryzen 7 7700Core i5 1240012400Ryzen 5 760050100150200250SE +/- 0.25, N = 385.96124.26161.39161.73164.13173.08175.06211.72

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 790013400Core i5 13400Ryzen 7 7700Core i5 1240012400Ryzen 5 76003691215SE +/- 0.0097, N = 311.63258.04726.19616.18296.09265.77765.71224.7232

nginx

Connections: 200

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760040K80K120K160K200K194668.20129714.8799945.5179667.081. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760040K80K120K160K200K197728.82131511.71101913.0481219.421. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.07070.14140.21210.28280.35350.1299450.1862800.2514550.314292MIN: 0.12MIN: 0.17MIN: 0.22MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 7 7700Ryzen 9 7900Ryzen 9 7950XRyzen 5 760013400Core i5 1340012400Core i5 124005101520258.118.7710.4910.8016.0016.0419.4319.45MIN: 4.87 / MAX: 21.23MIN: 7.17 / MAX: 17.28MIN: 4.87 / MAX: 19.49MIN: 5.27 / MAX: 12.56MIN: 14.09 / MAX: 25.84MIN: 13.66 / MAX: 25.82MIN: 18.46 / MAX: 26.18MIN: 18.39 / MAX: 25.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124003691215SE +/- 0.021, N = 35.5336.7328.1949.96710.07810.12013.10113.1661. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 760013400Core i5 13400Core i5 124001240036912154.314.555.085.848.688.7210.2510.25MIN: 2.7 / MAX: 13.22MIN: 3.21 / MAX: 16.73MIN: 3.14 / MAX: 13.29MIN: 3.64 / MAX: 14.42MIN: 7.54 / MAX: 17.41MIN: 7.54 / MAX: 22.25MIN: 10.08 / MAX: 16.3MIN: 10.11 / MAX: 17.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760040K80K120K160K200K177431.30124644.2794196.1574959.981. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 1240070140210280350SE +/- 0.58, N = 3344278206176175163147146MIN: 55 / MAX: 2868MIN: 38 / MAX: 3234MIN: 27 / MAX: 2543MIN: 19 / MAX: 2712MIN: 18 / MAX: 2713MIN: 21 / MAX: 2129MIN: 15 / MAX: 2299MIN: 15 / MAX: 2301

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340080160240320400SE +/- 1.87, N = 3165.90201.84260.88316.73333.39333.43387.78388.70

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.74161.48322.22482.96643.7081.408042.131392.523063.29607MIN: 1.36MIN: 2.04MIN: 2.34MIN: 3.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 12400Core i5 13400134001020304050SE +/- 0.02, N = 344.2437.7832.2127.2819.3219.2818.9418.92

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ScalarRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 124004080120160200SE +/- 0.00, N = 3175135989393777575MIN: 19 / MAX: 2252MIN: 13 / MAX: 2264MIN: 9 / MAX: 1750MIN: 9 / MAX: 1779MIN: 9 / MAX: 1775MIN: 7 / MAX: 1390MIN: 7 / MAX: 1385MIN: 7 / MAX: 1382

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.35550.7111.06651.4221.77750.6775581.1270701.2693401.580040MIN: 0.6MIN: 1.04MIN: 1.15MIN: 1.51. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.90661.81322.71983.62644.5331.734912.463883.256394.02950MIN: 1.55MIN: 2.23MIN: 2.9MIN: 3.771. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.30360.60720.91081.21441.5180.5821880.8632191.0011901.349540MIN: 0.57MIN: 0.82MIN: 0.9MIN: 1.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 12400124000.94251.8852.82753.774.7125SE +/- 0.001647, N = 34.1886773.7110853.0031912.5455322.5248472.1616871.8162991.8114171. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760012400Core i5 1240013400Core i5 134001020304050SE +/- 0.02, N = 344.5937.6931.9027.0419.7219.7119.4719.43

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76001.20452.4093.61354.8186.02252.344603.391073.940375.35314MIN: 2.29MIN: 3.3MIN: 3.73MIN: 5.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124001020304050SE +/- 0.01, N = 342.6536.9232.3227.4518.9718.9418.7318.70

CockroachDB

Workload: KV, 95% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 256Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 124001240030K60K90K120K150KSE +/- 126.38, N = 3129868.695980.381006.568318.568289.164003.957642.857470.0

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 12400714212835SE +/- 0.05, N = 312.7915.3718.3023.2828.5228.5328.7628.76

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1240012400Core i5 1340013400510152025SE +/- 0.057, N = 39.10110.77412.70915.07519.59319.64520.42920.455

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 1240020406080100SE +/- 0.06, N = 378.1065.0154.6142.9435.0535.0434.7634.76

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.13, N = 319.6523.0528.0133.1842.6642.7743.3743.61

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Core i5 124001240013400Core i5 134004080120160200SE +/- 0.37, N = 384.2484.4587.4994.82119.73121.51184.54185.09

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 1240020406080100SE +/- 0.04, N = 337.7346.2956.2965.4365.7267.8682.4282.831. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamRyzen 5 7600Ryzen 9 7950XRyzen 7 7700Ryzen 9 7900Core i5 1240012400Core i5 13400134001326395265SE +/- 0.22, N = 326.3927.0927.4329.2538.0838.1757.5157.80

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamRyzen 5 7600Ryzen 7 7700Ryzen 9 7950XRyzen 9 7900Core i5 124001240013400Core i5 1340020406080100SE +/- 0.08, N = 342.0043.5843.8546.6560.3061.4491.4891.50

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124001.15382.30763.46144.61525.769SE +/- 0.004, N = 35.1284.5113.6633.0352.8892.8732.4082.4051. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfRyzen 9 7950X12400Core i5 12400Ryzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600400800120016002000SE +/- 2.60, N = 31806155715351393105910401034848

CockroachDB

Workload: KV, 95% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Core i5 1240012400Ryzen 5 760020K40K60K80K100KSE +/- 72.44, N = 3114820.886491.768924.165255.665146.255187.655093.554217.3

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 12400124001530456075SE +/- 0.10, N = 366.4257.1645.4138.0037.9337.0231.6131.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 124001240030K60K90K120K150KSE +/- 241.43, N = 3117739.293584.775589.867125.866905.657478.456455.556109.5

CockroachDB

Workload: KV, 60% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 1240020K40K60K80K100KSE +/- 106.59, N = 391613.271172.658030.351715.551692.845748.044239.544079.6

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030K60K90K120K150K149355.73116337.6889489.3371972.121. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Ryzen 9 7900Ryzen 9 7950XRyzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 124000.5451.091.6352.182.725SE +/- 0.000398, N = 32.4220282.1894491.9580331.6426011.6202421.4321061.1786181.1681831. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Core i5 12400124004080120160200SE +/- 0.36, N = 3174.40161.10128.87106.31103.93103.7787.1186.711. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 760012400Core i5 1240013400Core i5 1340012243648605.525.826.447.5728.7028.9155.1055.61MIN: 2.89 / MAX: 13.87MIN: 3.04 / MAX: 18.04MIN: 3.32 / MAX: 13.96MIN: 6.66 / MAX: 10.78MIN: 28.15 / MAX: 35.06MIN: 28.13 / MAX: 34.69MIN: 43.43 / MAX: 57.02MIN: 41.77 / MAX: 68.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

CockroachDB

Workload: KV, 50% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 124001240020K40K60K80K100KSE +/- 93.19, N = 383215.668221.755451.249206.749201.144158.441950.841862.4

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X12400Core i5 12400Core i5 1340013400306090120150SE +/- 0.50, N = 360.8364.8268.9469.4476.3777.42116.53118.51

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 12400124004080120160200SE +/- 0.07, N = 3173.85154.19133.38114.9994.3894.0590.3189.96

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 5 7600Ryzen 7 77000.75571.51142.26713.02283.77851.757491.844063.251993.35870MIN: 1.68MIN: 1.78MIN: 3.19MIN: 3.091. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

CockroachDB

Workload: KV, 95% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 128Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 1240020K40K60K80K100KSE +/- 104.96, N = 3109601.294461.683774.069900.269633.966158.559140.659000.6

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 7 7700Ryzen 9 7900Ryzen 5 760013400Core i5 1340012400Core i5 12400110220330440550282.77293.72327.19386.14429.89432.13503.11503.59MIN: 272.65 / MAX: 321.95MIN: 175.59 / MAX: 313.02MIN: 305.59 / MAX: 336.37MIN: 369.36 / MAX: 391.28MIN: 339.29 / MAX: 913.71MIN: 360.39 / MAX: 940.27MIN: 498.88 / MAX: 511.99MIN: 492.41 / MAX: 512.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

CockroachDB

Workload: KV, 10% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 1240014K28K42K56K70KSE +/- 24.23, N = 365240.255906.247874.542551.042546.138603.036894.836820.5

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pRyzen 9 7900Ryzen 7 7700Ryzen 9 7950XRyzen 5 760013400Core i5 1340012400Core i5 1240048121620SE +/- 0.055, N = 313.66312.04111.91010.3409.0989.0127.9157.8991. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76001.21782.43563.65344.87126.0893.140413.461524.391065.41252MIN: 2.52MIN: 3.03MIN: 3.82MIN: 5.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, LosslessRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124001.31422.62843.94265.25686.571SE +/- 0.021, N = 33.3973.5763.9394.3764.9064.9835.7475.8411. (CXX) g++ options: -O3 -fPIC -lm

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 76000.58471.16941.75412.33882.92351.528281.541882.499822.59867MIN: 1.45MIN: 1.45MIN: 2.28MIN: 2.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 7600Core i5 12400124004080120160200SE +/- 0.26, N = 3198.50185.43151.27134.95134.25126.65117.30116.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060120180240300162.83175.07254.93275.461. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

CockroachDB

Workload: KV, 60% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 770013400Core i5 13400Ryzen 5 760012400Core i5 1240016K32K48K64K80KSE +/- 42.65, N = 374346.964464.357896.550477.050413.549581.043981.043959.3

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicRyzen 9 7950XRyzen 9 7900Core i5 1240012400Ryzen 7 7700Ryzen 5 760013400Core i5 1340015000M30000M45000M60000M75000MSE +/- 42366535.54, N = 371314200000666010000005692680000056538300000554612000004909970000043549200000434782000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

CockroachDB

Workload: KV, 50% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 7600Core i5 124001240014K28K42K56K70KSE +/- 45.17, N = 366871.157623.651227.645816.545770.244990.441073.540974.9

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.16920.33840.50760.67680.8460.4683510.5837750.6001970.751812MIN: 0.38MIN: 0.54MIN: 0.55MIN: 0.731. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 124004080120160200SE +/- 0.71, N = 3197.40192.69160.87142.94141.41135.09123.73123.341. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760081624324022.5726.4231.6035.671. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamCore i5 1240012400Ryzen 5 7600Ryzen 9 7950XRyzen 7 7700Ryzen 9 790013400Core i5 13400170340510680850SE +/- 2.15, N = 3497.15498.31631.60635.51652.21693.07764.80765.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamCore i5 1240012400Ryzen 5 7600Ryzen 9 7950XRyzen 7 7700Ryzen 9 7900Core i5 1340013400170340510680850SE +/- 1.42, N = 3497.20501.94631.91633.82652.43691.47761.83765.90

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pRyzen 9 7900Ryzen 7 7700Ryzen 9 7950XRyzen 5 760013400Core i5 13400Core i5 1240012400150300450600750SE +/- 3.43, N = 3685.38609.39578.98523.71502.96500.43453.39447.691. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllRyzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 12400Ryzen 9 7950XRyzen 9 790070140210280350SE +/- 0.38, N = 3320.94304.47304.23304.22271.97269.98267.23212.74

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 760012400Core i5 1240010K20K30K40K50KSE +/- 56.87, N = 345991.343498.737644.834253.834012.032015.230683.930654.1

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pRyzen 9 7900Ryzen 7 7700Ryzen 5 760013400Core i5 13400Ryzen 9 7950XCore i5 1240012400160320480640800SE +/- 2.55, N = 3739.03664.22577.57537.89533.94518.18497.71497.221. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124003691215SE +/- 0.01, N = 312.3611.6411.2410.639.619.598.928.681. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124003691215SE +/- 0.01, N = 312.7112.0211.5210.959.729.719.088.931. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 7600Core i5 134001340012400Core i5 124003691215SE +/- 0.00, N = 312.5711.9011.4210.849.779.759.098.871. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 5 7600Ryzen 7 77002468105.193245.209567.072997.32501MIN: 5.14MIN: 5.13MIN: 7MIN: 6.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124003691215SE +/- 0.01, N = 312.8812.1711.7111.149.889.879.259.141. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPURyzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 76001.00152.0033.00454.0065.00753.176003.213194.327004.45130MIN: 3.12MIN: 3.17MIN: 4.15MIN: 4.361. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowRyzen 5 7600Core i5 134001340012400Core i5 12400112233445546.3843.6743.3733.2033.121. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumRyzen 5 7600Core i5 1340013400Core i5 1240012400112233445547.8845.1345.0234.4734.431. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastRyzen 5 760013400Core i5 1340012400Core i5 1240020406080100104.2392.7192.5675.6375.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastRyzen 5 760013400Core i5 1340012400Core i5 1240061218243024.4922.2122.1117.8417.791. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastRyzen 5 760013400Core i5 1340012400Core i5 1240071421283530.5627.9327.7422.2622.221. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metric13400Core i5 13400Ryzen 5 7600Core i5 124001240040K80K120K160K200K2050782047331736891495981495511. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastRyzen 5 760013400Core i5 13400Core i5 1240012400102030405041.9038.3138.1830.7030.661. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 5 7600Ryzen 7 77002468105.599195.698087.377727.65134MIN: 5.53MIN: 5.61MIN: 7.29MIN: 7.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowRyzen 5 7600Core i5 134001340012400Core i5 1240036912159.458.678.676.946.931. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastRyzen 5 7600Core i5 134001340012400Core i5 12400306090120150128.89119.64119.2795.0394.931. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumRyzen 5 760013400Core i5 13400Core i5 124001240036912159.658.908.887.137.121. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastRyzen 5 760013400Core i5 13400Core i5 12400124004080120160200172.40165.29164.90127.53127.361. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastRyzen 5 760013400Core i5 1340012400Core i5 1240051015202519.5118.2918.2514.4714.44

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastRyzen 5 760013400Core i5 1340012400Core i5 1240051015202520.7819.5319.4415.5015.49

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastRyzen 5 7600Core i5 1340013400Core i5 12400124002040608010085.9381.7281.6364.1764.15

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastRyzen 5 760013400Core i5 13400Core i5 124001240061218243025.1823.9423.7718.9318.92

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Ryzen 5 760013400Core i5 1340012400Core i5 124001632486480SE +/- 0.12, N = 374.1770.4567.9866.4157.9957.9156.8855.74

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastRyzen 5 760013400Core i5 13400Core i5 12400124002040608010090.6788.3388.2668.6068.50

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowRyzen 5 760013400Core i5 13400Core i5 124001240071421283529.5829.5529.3722.4122.40

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumRyzen 5 760013400Core i5 13400Core i5 124001240081624324033.1532.9332.8625.1425.13

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastRyzen 5 760013400Core i5 13400Core i5 124001240020406080100108.63107.57107.5082.4182.38

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowRyzen 5 760013400Core i5 1340012400Core i5 124001.32082.64163.96245.28326.6045.875.585.574.494.48

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumRyzen 5 760013400Core i5 1340012400Core i5 124002468106.616.306.295.065.06

nginx

Connections: 20

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 20Ryzen 7 7700Ryzen 5 760020K40K60K80K100K88942.4368924.191. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 1340013400Core i5 12400124004K8K12K16K20KSE +/- 53.42, N = 31980019496194071887416632164591590715885

nginx

Connections: 4000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 4000Ryzen 7 7700Ryzen 5 760020K40K60K80K100K87991.4171632.481. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsRyzen 9 790012400Ryzen 9 7950XRyzen 7 7700Core i5 12400Ryzen 5 7600Core i5 134001340071421283525.3726.2126.3527.0027.2028.3530.8231.04

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Ryzen 9 7900Ryzen 9 7950XRyzen 5 7600Ryzen 7 7700Core i5 134001340012400Core i5 124000.22950.4590.68850.9181.1475SE +/- 0.00, N = 31.020.990.960.930.880.880.840.841. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsRyzen 9 790012400Ryzen 9 7950XCore i5 12400Ryzen 7 7700Ryzen 5 760013400Core i5 1340081624324029.1329.9030.4531.1831.2232.9534.6935.28

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsRyzen 9 790012400Ryzen 9 7950XRyzen 7 7700Core i5 12400Ryzen 5 760013400Core i5 1340071421283524.3025.0125.2225.5426.0527.0929.1329.32

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsRyzen 9 7900Ryzen 9 7950X12400Ryzen 7 7700Core i5 12400Ryzen 5 760013400Core i5 1340071421283525.4726.0726.1426.9227.0828.4130.3130.43

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cache13400Core i5 1340012400Core i5 1240050100150200250212.37209.34185.39180.38MIN: 9.19 / MAX: 7500MIN: 9.46 / MAX: 7500MIN: 6.57 / MAX: 6666.67MIN: 6.59 / MAX: 6666.67

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Core i5 134001340012400Core i5 12400Ryzen 5 76000.20930.41860.62790.83721.0465SE +/- 0.00, N = 30.930.920.890.860.860.830.830.791. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Run13400Core i5 13400Core i5 124001240050100150200250228.27222.15200.59199.01MIN: 9.34 / MAX: 8571.43MIN: 9.54 / MAX: 7500MIN: 6.72 / MAX: 7500MIN: 6.76 / MAX: 6666.67

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Run13400Core i5 13400Core i5 124001240050100150200250225.55224.48202.90201.10MIN: 9.32 / MAX: 7500MIN: 9.15 / MAX: 7500MIN: 6.79 / MAX: 8571.43MIN: 6.78 / MAX: 7500

CockroachDB

Workload: KV, 50% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 128Ryzen 9 7900Core i5 1340013400Ryzen 9 7950XCore i5 12400Ryzen 5 7600Ryzen 7 7700124003K6K9K12K15KSE +/- 141.12, N = 312631.312118.212043.811997.011841.811791.711773.911716.5

CockroachDB

Workload: KV, 10% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 256Ryzen 9 7900Ryzen 7 7700Core i5 1340013400Ryzen 5 7600Ryzen 9 7950X12400Core i5 124003K6K9K12K15KSE +/- 57.49, N = 314338.913882.313704.013657.013607.413554.113478.113343.2

CockroachDB

Workload: KV, 10% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 128Ryzen 9 7900Core i5 13400Ryzen 9 7950X13400Ryzen 7 7700Core i5 1240012400Ryzen 5 760015003000450060007500SE +/- 28.90, N = 37076.96770.56757.66690.86681.16631.26622.06588.7

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256Ryzen 9 7900Ryzen 9 7950XRyzen 7 7700Core i5 1340013400Ryzen 5 7600Core i5 12400124005K10K15K20K25KSE +/- 42.71, N = 325105.624264.224135.424114.223946.223677.223659.623631.1

CockroachDB

Workload: KV, 60% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 128Ryzen 5 7600Core i5 13400Ryzen 9 790013400Ryzen 7 7700Ryzen 9 7950X12400Core i5 124003K6K9K12K15KSE +/- 39.43, N = 315076.814961.314938.514829.214780.914664.614628.714590.1

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512Ryzen 7 7700Ryzen 9 7900Ryzen 5 7600Core i5 1240012400Core i5 1340013400Ryzen 9 7950X306090120150SE +/- 0.10, N = 3126.0125.8125.8125.4124.9124.6124.4122.2

CockroachDB

Workload: MoVR - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 128Ryzen 7 7700Ryzen 9 7900Ryzen 5 760012400Core i5 12400Core i5 1340013400Ryzen 9 7950X306090120150SE +/- 0.07, N = 3126.6125.9125.8125.3125.3124.8124.2122.8

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256Ryzen 9 7900Ryzen 7 7700Ryzen 9 7950XRyzen 5 7600Core i5 13400Core i5 1240012400134006K12K18K24K30KSE +/- 213.65, N = 330313.730242.830094.329982.129664.729557.229540.229512.3

CockroachDB

Workload: MoVR - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 1024Ryzen 9 7900Ryzen 7 7700Core i5 12400Ryzen 5 760012400Core i5 1340013400Ryzen 9 7950X306090120150SE +/- 0.07, N = 3126.0125.9125.8125.3124.8124.6124.4122.8

CockroachDB

Workload: MoVR - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 256Ryzen 7 7700Ryzen 5 7600Ryzen 9 7900Core i5 1340012400Core i5 1240013400Ryzen 9 7950X306090120150SE +/- 0.00, N = 3125.8125.8125.5124.9124.9124.9124.3122.8


Phoronix Test Suite v10.8.5