AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpus

Benchmarks for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2301151-PTS-EO2022BE21&grr&sro.

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 13400AMD Ryzen 5 7600 6-Core @ 5.17GHz (6 Cores / 12 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Navi 21 HDMI AudioASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160AMD Ryzen 7 7700 8-Core @ 5.39GHz (8 Cores / 16 Threads)2000GB Samsung SSD 980 PRO 2TB + 2000GBAMD Ryzen 9 7900 12-Core @ 5.48GHz (12 Cores / 24 Threads)2000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6750 XT 12GB (2880/1124MHz)AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)2000GB Samsung SSD 980 PRO 2TB + 257GB Flash DriveIntel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a272000GB Samsung SSD 980 PRO 2TBAMD Radeon RX 6700 XT 12GB (2855/1000MHz)Realtek ALC897ASUS VP28UIntel Device 7a70Intel Core i5-13400 @ 3.40GHz (10 Cores / 16 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 5 7600: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 7 7700: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7900: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7950X: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Core i5 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25- Core i5 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25Python Details- Python 3.10.4Security Details- Ryzen 5 7600: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 7 7700: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7900: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Core i5 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Core i5 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusbuild-linux-kernel: allmodconfigblender: Barbershop - CPU-Onlyopenradioss: INIVOL and Fluid Structure Interaction Drop Containerbrl-cad: VGR Performance Metricnekrs: TurboPipe Periodicopenvkl: vklBenchmark Scalaropenvkl: vklBenchmark ISPCblender: Classroom - CPU-Onlyopenradioss: Bird Strike on Windshieldblender: Pabellon Barcelona - CPU-Onlytensorflow: CPU - 64 - ResNet-50jpegxl: JPEG - 100jpegxl: PNG - 100clickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheopenradioss: Rubber O-Ring Seal Installationopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenradioss: Bumper Beamxmrig: Monero - 1Mblender: Fishy Cat - CPU-Onlytensorflow: CPU - 32 - ResNet-50avifenc: 0xmrig: Wownero - 1Mopenradioss: Cell Phone Drop Testjpegxl: JPEG - 80blender: BMW27 - CPU-Onlyjpegxl: PNG - 80cockroach: KV, 10% Reads - 1024tensorflow: CPU - 64 - GoogLeNetcockroach: KV, 50% Reads - 1024cockroach: KV, 95% Reads - 1024cockroach: KV, 60% Reads - 1024cockroach: KV, 10% Reads - 512cockroach: KV, 50% Reads - 512cockroach: KV, 60% Reads - 512cockroach: KV, 95% Reads - 512cockroach: KV, 10% Reads - 256cockroach: KV, 60% Reads - 256cockroach: KV, 50% Reads - 256cockroach: KV, 95% Reads - 256cockroach: KV, 60% Reads - 128cockroach: KV, 50% Reads - 128cockroach: KV, 10% Reads - 128cockroach: KV, 95% Reads - 128stargate: 192000 - 512cockroach: MoVR - 256cockroach: MoVR - 1024cockroach: MoVR - 512cockroach: MoVR - 128jpegxl: JPEG - 90jpegxl: PNG - 90stargate: 192000 - 1024uvg266: Bosphorus 4K - Slowbuild-linux-kernel: defconfiguvg266: Bosphorus 4K - Mediumtensorflow: CPU - 16 - ResNet-50nginx: 1000nginx: 500nginx: 200nginx: 100minibude: OpenMP - BM1minibude: OpenMP - BM1stargate: 96000 - 512spacy: en_core_web_trfspacy: en_core_web_lgavifenc: 2stargate: 96000 - 1024kvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumtensorflow: CPU - 32 - GoogLeNetdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamsvt-av1: Preset 4 - Bosphorus 4Kopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUtensorflow: CPU - 64 - AlexNetopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamstargate: 480000 - 512stargate: 44100 - 512deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamstargate: 480000 - 1024jpegxl-decode: 1deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamstargate: 44100 - 1024deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamy-cruncher: 1Bdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamnginx: 4000onednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUtensorflow: CPU - 16 - GoogLeNetuvg266: Bosphorus 4K - Very Fasttensorflow: CPU - 32 - AlexNetuvg266: Bosphorus 4K - Super Fastencodec: 24 kbpsnginx: 20kvazaar: Bosphorus 4K - Very Fastencodec: 6 kbpsencodec: 3 kbpsuvg266: Bosphorus 4K - Ultra Fastjpegxl-decode: Allencodec: 1.5 kbpsquadray: 5 - 4Kquadray: 3 - 4Kquadray: 2 - 4Kquadray: 1 - 4Kquadray: 5 - 1080pquadray: 2 - 1080pquadray: 3 - 1080pquadray: 1 - 1080pkvazaar: Bosphorus 4K - Super Fastuvg266: Bosphorus 1080p - Slowtensorflow: CPU - 16 - AlexNety-cruncher: 500Msvt-av1: Preset 4 - Bosphorus 1080puvg266: Bosphorus 1080p - Mediumsvt-av1: Preset 8 - Bosphorus 4Kkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumavifenc: 6, Losslessonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUavifenc: 6uvg266: Bosphorus 1080p - Very Fastonednn: IP Shapes 1D - f32 - CPUuvg266: Bosphorus 1080p - Super Fastonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUsvt-av1: Preset 8 - Bosphorus 1080pkvazaar: Bosphorus 1080p - Very Fastsvt-av1: Preset 12 - Bosphorus 4Kuvg266: Bosphorus 1080p - Ultra Fastonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUsvt-av1: Preset 13 - Bosphorus 4Kavifenc: 10, Losslesskvazaar: Bosphorus 1080p - Super Fastonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUkvazaar: Bosphorus 1080p - Ultra Fastonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUsvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080ponednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUsmhasher: SHA3-256Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950XCore i5 124001240013400Core i5 134001287.7171287.74576.51736894909970000077163357.43316.73433.0527.040.790.96154.84275.457635.667484140.237111.3173.7427.28142.8237963.2104.8710.84134.7611.143860378.3644158.454217.34574832015.244990.44958157478.413607.429982.123677.264003.915076.811791.76588.766158.51.432106125.8125.3125.8125.810.6310.951.489765.8796.356.6127.4571972.1274959.9879667.0881219.4220.794519.852.1616878481887467.8612.2295549.459.6579.15631.59674.74983.0351299.353.071319.73.01747.165.32170.35386.1410.3666.4260.19631.91214.74745.7701.425.84684.787.57527.7810.8370.075.691054.540.3616542.870.639515.2984.454935.51242.9014532.96411661.695848.61422.97038266.41211.96164.7177211.7154.723231.068732.18253.03864421.895545.658642.002171.407760.829449.289333.17915.675363.77826.3865113.641623.282942.93611.733285.183871632.482897.042894.82899.281452.021444.741451.1180.0119.51148.4120.7832.94768924.1924.4928.35128.41125.18304.4727.0920.772.422.8210.323.0710.759.3640.5130.5629.58114.9915.07510.3433.1537.02341.946.3847.889.9679.375935.412521.038686.69485.934.029590.670.7518121.58004106.311104.23126.653108.630.5478451.641330.314292135.0934.376128.894.45132.598670.996005172.47.377727.072993.25199523.708577.5695.353143.296071.349541022.513987.28504.925546120000098206273.02260.88334.8731.90.890.93127.81254.9280131.599213127.327820.9134.7132.21117.10810175.585.1411.42103.8611.7147874.594.3955451.268924.158030.337644.851227.657896.575589.813882.330242.824135.481006.514780.911773.96681.1837741.958033125.8125.9126126.611.2411.522.07927778.96232.3289489.3394196.1599945.51101913.0427.045676.1163.00319110591940756.2863.11142295.88652.2146.13243.6631026.043.891013.263.93580.856.88211.48293.7213.649.2481.2652.43246.12714.9815.544.55878.345.82686.88.11492.65.851366.980.3721216.530.6412465.6787.485545.7164.0510684.16798169.747557.33784.1998567.98164.10146.0935164.12696.092625.001639.98844.30937817.062658.58543.584491.753764.81761.677828.01112.475580.127527.4305145.760118.303354.60688.0834123.618787991.412292.792284.922286.061153.651151.661153.9297.02178.7931.22488942.432726.919320.9425.5430.983.063.613.113.8813.5711.8450.91133.3812.70912.04145.4128.1947.643694.391060.8107275.4523.256390.6001971.26934128.872151.270.4367351.534060.251455160.8683.9394.3272.499820.9514697.651347.325013.3587609.385664.2233.940372.523061.00119731.362713.99351.0666601000000135278200.26201.84245.3737.690.931.0284.43175.0657226.423261104.281327998.9937.7893.7214345.369.1912.5776.3412.8855906.2117.3568221.786491.771172.643498.757623.664464.393584.714338.930313.725105.695980.314938.512631.37076.994461.62.422028125.5126125.8125.912.3612.712.59870258.29536.92116337.68124644.27129714.87131511.7136.599914.9643.71108513931949646.2873.901351118.97693.07028.65284.5111140.445.241137.545.25640.679.34273.82327.1918.3160.2899.46691.46858.67075.351119.555.081180.36.44931.528.77683.36.451858.440.4327745.560.7116732.8894.815363.24675.0270595.21279972.930682.23995.26836674.17124.27078.0466124.26238.047221.092547.4015.37117318.179554.991146.6464128.588468.936886.973523.04710.725993.192329.2496204.983715.374165.00787.5016133.21171659.311657.571654.84843.757845.732844.735117.74217.9329.12625.3725.469212.7424.2961.314.054.7517.165.2317.715.7265.9154.1910.77413.66357.1626.7325.575453.461520.617444.1422.463880.5837751.12707161.1185.4290.3092790.6567810.18628192.6893.5763.1761.528280.3617765.698085.209561.84406685.384739.0283.391072.131390.863219516.255470.3286.1971314200000175344130.33165.9159.2144.590.920.9963.18162.8275622.57083488.113104.364.444.2472.09520480.954.9811.949.5412.1765240.2143.483215.6114820.891613.245991.366871.174346.9117739.213554.130094.324264.2129868.614664.6119976757.6109601.22.189449122.8122.8122.2122.811.6412.023.80864243.4142.65149355.73177431.3194668.2197728.8256.8631421.5784.18867718061980037.7255.887084145.59635.508212.53845.1281045.767.61048.957.59554.9514.36344.54282.7728.2759.51134.33633.81512.56014.691703.894.311851.755.521446.8210.49762.165.512903.280.3544954.590.6126078.9684.237894.95347.5203497.78087481.770897.8017.59092670.4585.936311.635985.962111.632516.637560.08988.41105415.441764.736443.8473182.395569.4434115.004419.6478.8369113.110227.0898295.178112.794278.09884.9123203.35511132.891141.291138.44577.904584.274576.369143.32260.0530.44826.34526.073267.2325.2172.16.537.4826.478.3828.625.01103.21173.859.10111.9166.4165.5333.63053.140410.4198333.2161.734910.4683510.677558174.404198.4970.2093350.4339810.129945197.3973.3973.213191.541880.37095.599195.193241.75749578.976518.1752.34461.408040.5821881597.0451728.2644.831495985692680000075146445.12333.39536.6619.710.830.84202.90200.59180.38195.38178.374585.3217.8419.28180.8966231.7112.098.87154.169.1436820.549.9441950.855187.644079.630654.141073.543959.356455.513343.229557.223659.657642.814590.111841.86631.259000.61.168183124.9125.8125.4125.38.688.931.2826594.48122.0395.0618.710.217255.4351.81629915351590782.8341.9426776.937.1349.29497.15346.03382.4053016.231.323026.391.322098.291.9109.57503.597.93156.7525.49497.20026.033612.55318.6310.25390.0228.91207.4919.45205.527.6788.770.946329.920.866963.17119.729725.05252.5118932.590008111.749226.83982.64176255.74172.72645.7894173.07755.777643.844822.8062.72804842.364123.601160.296649.746277.417838.706542.6622.153845.132838.083778.752428.761734.759814.721967.906947.9914.44102.415.4931.17917.7927.19527.08318.93269.9826.0470.551.72.177.452.188.216.927.9222.2222.4190.3119.5937.89925.1431.61130.733.1234.4713.1669.12764.1768.687.11175.45117.29682.41123.3385.84194.93127.53453.392497.7121592.631726.29644.81495515653830000075147444.9333.43535.4719.720.830.84196.91194.52185.39195.67178.134590216.9319.32180.6526201.5111.929.09154.39.2536894.849.9741862.455093.544239.530683.940974.94398156109.513478.129540.223631.15747014628.711716.5662259140.61.178618124.9124.8124.9125.38.929.081.2846954.49121.3585.0618.7310.221255.5341.81141715571588582.4241.9454866.947.1249.17498.31226.01972.4083012.861.333010.561.332094.061.9109.35503.117.95156.3125.57501.93945.966612.65316.1310.25390.0328.7209.0219.43205.797.58790.350.946317.970.866960.14121.512624.6852.5034362.589581112.128326.74892.65036756.88174.37735.7346175.05975.712245.600821.92792.7216842.816623.351661.436748.823176.373339.250942.76622.823343.808938.173778.563628.757834.762714.681668.093548.0914.47102.8415.529.90117.8426.20626.14318.92271.9725.0130.551.72.187.412.188.216.7227.6522.2622.489.9619.6457.91525.1331.55330.6633.234.4313.1019.0564.1568.586.71475.63116.98382.38123.7345.74795.03127.36447.691497.2171243.6381359.5796.752050784354920000093175348.77387.78418.1819.470.860.88225.55228.27212.37292.59242.525168.4171.6218.92140.7157122.9165.139.75119.209.8842546.157.5149206.765255.651715.534012.045770.250477.067125.813657.029512.323946.268318.514829.212043.86690.869633.91.642601124.3124.4124.4124.29.599.711.8585525.5895.9326.318.947.412185.2932.54553210401645965.7232.8216048.678.956.00764.80446.50682.8732328.11.72330.871.71583.072.52117.43429.899.26124.6232.08765.89516.477910.63778.68460.2255.1181.1916249.8314.53684.891.665970.931.516606.33184.542826.93023.5796663.711977173.503628.66973.86892757.99161.46426.1932161.38886.196143.057223.22323.98343844.036622.705191.479154.5129118.513042.076043.36821.416046.687557.802886.357228.520735.054814.597768.484254.7418.29108.3119.5334.69122.2131.03630.30523.94304.2229.1270.311.081.314.571.235.164.2117.9827.9329.5594.0520.4559.09832.9337.99838.3143.3745.0210.1206.97081.6388.33103.92992.71134.946107.57141.4114.906119.27165.29502.961537.8861245.0711365.21785.442047334347820000093176348.54388.7419.619.430.860.88224.48222.15209.34291.76239.475164.3171.2818.94140.4747156.9164.849.77119.159.874255157.549201.165146.251692.834253.845816.550413.566905.61370429664.724114.268289.114961.312118.26770.569900.21.620242124.9124.6124.6124.89.619.721.8500665.5796.7786.2918.977.434185.8482.52484710341663265.4252.8142648.678.8855.95765.83086.49292.8892334.051.72341.391.71584.912.51117.14432.139.17124.9332761.82696.529510.62376.188.72458.3855.61179.6916.04249.2114.34694.551.656046.321.516605.86185.088726.81423.5639793.675362173.132928.70423.8586557.91161.69316.1844161.73376.182943.151223.17263.97340443.955822.746691.495954.5751116.534242.74543.6121.137147.303557.509186.878628.5335.043414.605368.449954.7218.25107.8919.4435.27822.1130.82230.42523.77304.2329.3180.311.081.314.551.235.164.2117.9527.7429.3794.3820.4299.01232.8637.93438.1843.6745.1310.0787.01181.7288.26103.77492.56134.252107.5142.9414.983119.64164.9500.426533.941OpenBenchmarking.org

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfig1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30060090012001500SE +/- 0.19, N = 31592.631243.641597.051245.071287.721022.51731.36516.26

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4008001200160020001726.291359.501728.201365.211287.74987.28713.99470.30

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop Container1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2004006008001000SE +/- 3.17, N = 3644.80796.75644.83785.44576.50504.92351.06286.19

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metric1240013400Core i5 12400Core i5 13400Ryzen 5 760040K80K120K160K200K1495512050781495982047331736891. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe Periodic1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X15000M30000M45000M60000M75000MSE +/- 42366535.54, N = 356538300000435492000005692680000043478200000490997000005546120000066601000000713142000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalar1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.00, N = 3759375937798135175MIN: 7 / MAX: 1385MIN: 9 / MAX: 1775MIN: 7 / MAX: 1382MIN: 9 / MAX: 1779MIN: 7 / MAX: 1390MIN: 9 / MAX: 1750MIN: 13 / MAX: 2264MIN: 19 / MAX: 2252

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPC1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X70140210280350SE +/- 0.58, N = 3147175146176163206278344MIN: 15 / MAX: 2299MIN: 18 / MAX: 2713MIN: 15 / MAX: 2301MIN: 19 / MAX: 2712MIN: 21 / MAX: 2129MIN: 27 / MAX: 2543MIN: 38 / MAX: 3234MIN: 55 / MAX: 2868

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X100200300400500SE +/- 0.14, N = 3444.90348.77445.12348.54357.43273.02200.26130.33

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on Windshield1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X80160240320400SE +/- 1.87, N = 3333.43387.78333.39388.70316.73260.88201.84165.90

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X120240360480600535.47418.18536.66419.60433.05334.87245.37159.21

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-501240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.02, N = 319.7219.4719.7119.4327.0431.9037.6944.59

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 1001240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.20930.41860.62790.83721.0465SE +/- 0.00, N = 30.830.860.830.860.790.890.930.921. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 1001240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.22950.4590.68850.9181.1475SE +/- 0.00, N = 30.840.880.840.880.960.931.020.991. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Run1240013400Core i5 12400Core i5 1340050100150200250196.91225.55202.90224.48MIN: 6.79 / MAX: 7500MIN: 9.32 / MAX: 7500MIN: 6.79 / MAX: 8571.43MIN: 9.15 / MAX: 7500

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Run1240013400Core i5 12400Core i5 1340050100150200250194.52228.27200.59222.15MIN: 6.8 / MAX: 7500MIN: 9.34 / MAX: 8571.43MIN: 6.72 / MAX: 7500MIN: 9.54 / MAX: 7500

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cache1240013400Core i5 12400Core i5 1340050100150200250185.00212.37180.38209.34MIN: 6.4 / MAX: 6666.67MIN: 9.19 / MAX: 7500MIN: 6.59 / MAX: 6666.67MIN: 9.46 / MAX: 7500

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal Installation1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300SE +/- 0.41, N = 3195.67292.59195.38291.76154.84127.8184.4363.18

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300275.46254.93175.07162.831. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeRyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X81624324035.6731.6026.4222.571. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper Beam1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 2.21, N = 3178.13242.52178.37239.47140.23127.32104.2888.10

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1M1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 5.44, N = 34590.05168.44585.35164.37111.37820.913279.013104.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 0.17, N = 3216.93171.62217.84171.28173.74134.7198.9964.40

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-501240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.02, N = 319.3218.9219.2818.9427.2832.2137.7844.24

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 01240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.36, N = 3180.65140.72180.90140.47142.82117.1193.7272.101. (CXX) g++ options: -O3 -fPIC -lm

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1M1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4K8K12K16K20KSE +/- 15.59, N = 36201.57122.96231.77156.97963.210175.514345.320480.91. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop Test1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 1.12, N = 3111.92165.13112.09164.84104.8785.1469.1954.98

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 801240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.00, N = 39.099.758.879.7710.8411.4212.5711.901. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-Only1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.02, N = 3154.30119.20154.16119.15134.76103.8676.3449.54

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 801240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.01, N = 39.259.889.149.8711.1411.7112.8812.171. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

CockroachDB

Workload: KV, 10% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X14K28K42K56K70KSE +/- 24.23, N = 336894.842546.136820.542551.038603.047874.555906.265240.2

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.13, N = 349.9757.5149.9457.5078.3694.39117.35143.40

CockroachDB

Workload: KV, 50% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 93.19, N = 341862.449206.741950.849201.144158.455451.268221.783215.6

CockroachDB

Workload: KV, 95% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 72.44, N = 355093.565255.655187.665146.254217.368924.186491.7114820.8

CockroachDB

Workload: KV, 60% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 106.59, N = 344239.551715.544079.651692.845748.058030.371172.691613.2

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X10K20K30K40K50KSE +/- 56.87, N = 330683.934012.030654.134253.832015.237644.843498.745991.3

CockroachDB

Workload: KV, 50% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X14K28K42K56K70KSE +/- 45.17, N = 340974.945770.241073.545816.544990.451227.657623.666871.1

CockroachDB

Workload: KV, 60% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X16K32K48K64K80KSE +/- 42.65, N = 343981.050477.043959.350413.549581.057896.564464.374346.9

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30K60K90K120K150KSE +/- 241.43, N = 356109.567125.856455.566905.657478.475589.893584.7117739.2

CockroachDB

Workload: KV, 10% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 57.49, N = 313478.113657.013343.213704.013607.413882.314338.913554.1

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X6K12K18K24K30KSE +/- 213.65, N = 329540.229512.329557.229664.729982.130242.830313.730094.3

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X5K10K15K20K25KSE +/- 42.71, N = 323631.123946.223659.624114.223677.224135.425105.624264.2

CockroachDB

Workload: KV, 95% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30K60K90K120K150KSE +/- 126.38, N = 357470.068318.557642.868289.164003.981006.595980.3129868.6

CockroachDB

Workload: KV, 60% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 39.43, N = 314628.714829.214590.114961.315076.814780.914938.514664.6

CockroachDB

Workload: KV, 50% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3K6K9K12K15KSE +/- 141.12, N = 311716.512043.811841.812118.211791.711773.912631.311997.0

CockroachDB

Workload: KV, 10% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X15003000450060007500SE +/- 28.90, N = 36622.06690.86631.26770.56588.76681.17076.96757.6

CockroachDB

Workload: KV, 95% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20K40K60K80K100KSE +/- 104.96, N = 359140.669633.959000.669900.266158.583774.094461.6109601.2

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.5451.091.6352.182.725SE +/- 0.000398, N = 31.1786181.6426011.1681831.6202421.4321061.9580332.4220282.1894491. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

CockroachDB

Workload: MoVR - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 2561240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.00, N = 3124.9124.3124.9124.9125.8125.8125.5122.8

CockroachDB

Workload: MoVR - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.07, N = 3124.8124.4125.8124.6125.3125.9126.0122.8

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.10, N = 3124.9124.4125.4124.6125.8126.0125.8122.2

CockroachDB

Workload: MoVR - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 1281240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.07, N = 3125.3124.2125.3124.8125.8126.6125.9122.8

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 901240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.01, N = 38.929.598.689.6110.6311.2412.3611.641. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 901240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.01, N = 39.089.718.939.7210.9511.5212.7112.021. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.85691.71382.57073.42764.2845SE +/- 0.000775, N = 31.2846951.8585521.2826591.8500661.4897602.0792772.5987023.8086421. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 76001.32082.64163.96245.28326.6044.495.584.485.575.87

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfig1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.34, N = 3121.3695.93122.0496.7896.3578.9658.3043.41

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 76002468105.066.305.066.296.61

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-501240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.01, N = 318.7318.9418.7018.9727.4532.3236.9242.65

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30K60K90K120K150K71972.1289489.33116337.68149355.731. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X40K80K120K160K200K74959.9894196.15124644.27177431.301. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 200

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X40K80K120K160K200K79667.0899945.51129714.87194668.201. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X40K80K120K160K200K81219.42101913.04131511.71197728.821. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM11240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1326395265SE +/- 0.027, N = 310.2217.41210.2177.43420.79427.04536.59956.8631. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM11240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30060090012001500SE +/- 0.67, N = 3255.53185.29255.44185.85519.85676.12914.961421.581. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.94251.8852.82753.774.7125SE +/- 0.001647, N = 31.8114172.5455321.8162992.5248472.1616873.0031913.7110854.1886771. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trf1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X400800120016002000SE +/- 2.60, N = 31557104015351034848105913931806

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lg1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4K8K12K16K20KSE +/- 53.42, N = 31588516459159071663218874194071949619800

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 21240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.04, N = 382.4265.7282.8365.4367.8656.2946.2937.731. (CXX) g++ options: -O3 -fPIC -lm

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.32462.64923.97385.29846.623SE +/- 0.000675, N = 31.9454862.8216041.9426772.8142642.2295543.1114223.9013515.8870841. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 760036912156.948.676.938.679.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 760036912157.128.907.138.889.651. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.07, N = 349.1756.0049.2955.9579.1595.88118.97145.59

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X170340510680850SE +/- 2.15, N = 3498.31764.80497.15765.83631.60652.21693.07635.51

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0278, N = 36.01976.50686.03386.49294.74986.13248.652812.5384

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.15382.30763.46144.61525.769SE +/- 0.004, N = 32.4082.8732.4052.8893.0353.6634.5115.1281. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030003012.862328.103016.232334.051299.351026.041140.441045.76MIN: 2985.99 / MAX: 3074.98MIN: 2104.47 / MAX: 2986.35MIN: 2973.48 / MAX: 3071.33MIN: 2135.53 / MAX: 3065.89MIN: 1211.98 / MAX: 1428.07MIN: 926.38 / MAX: 1134.19MIN: 761.08 / MAX: 1262.9MIN: 892.85 / MAX: 1274.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468101.331.701.321.703.073.895.247.601. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030003010.562330.873026.392341.391319.701013.261137.541048.95MIN: 2966.05 / MAX: 3058.2MIN: 2130.11 / MAX: 3008.71MIN: 2963.75 / MAX: 3245.44MIN: 2163.53 / MAX: 3007.58MIN: 748.58 / MAX: 1432.8MIN: 678.12 / MAX: 1133.16MIN: 906.91 / MAX: 1301.86MIN: 661.91 / MAX: 1252.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468101.331.701.321.703.013.935.257.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50010001500200025002094.061583.072098.291584.91747.16580.85640.67554.95MIN: 2054 / MAX: 2144.08MIN: 1477.42 / MAX: 1887.76MIN: 2052.06 / MAX: 2136.02MIN: 1427.31 / MAX: 1889.25MIN: 702.8 / MAX: 764.81MIN: 540.23 / MAX: 609.84MIN: 582.42 / MAX: 667.21MIN: 524.6 / MAX: 612.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X481216201.902.521.902.515.326.889.3414.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X70140210280350SE +/- 0.25, N = 3109.35117.43109.57117.14170.35211.48273.82344.54

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X110220330440550503.11429.89503.59432.13386.14293.72327.19282.77MIN: 498.88 / MAX: 511.99MIN: 339.29 / MAX: 913.71MIN: 492.41 / MAX: 512.07MIN: 360.39 / MAX: 940.27MIN: 369.36 / MAX: 391.28MIN: 175.59 / MAX: 313.02MIN: 305.59 / MAX: 336.37MIN: 272.65 / MAX: 321.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X7142128357.959.267.939.1710.3613.6018.3128.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150156.31124.62156.75124.9366.4249.2460.2859.51MIN: 149.83 / MAX: 167MIN: 111.98 / MAX: 178.7MIN: 149.92 / MAX: 175.47MIN: 111.3 / MAX: 183.58MIN: 32.92 / MAX: 70.79MIN: 28.96 / MAX: 62.2MIN: 49.85 / MAX: 73.62MIN: 30.43 / MAX: 93.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30609012015025.5732.0825.4932.0060.1981.2099.46134.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X170340510680850SE +/- 1.42, N = 3501.94765.90497.20761.83631.91652.43691.47633.82

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0214, N = 35.96666.47796.03366.52954.74746.12718.670712.5601

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X369121512.6510.6012.5510.625.704.905.354.69MIN: 12.01 / MAX: 18.99MIN: 9.52 / MAX: 16.08MIN: 12.23 / MAX: 20.14MIN: 9.14 / MAX: 16.53MIN: 4.69 / MAX: 7.25MIN: 3.95 / MAX: 17.52MIN: 3.97 / MAX: 8.07MIN: 3.81 / MAX: 10.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X400800120016002000316.13377.00318.63376.18701.42815.541119.551703.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X369121510.258.6810.258.725.844.555.084.31MIN: 10.11 / MAX: 17.66MIN: 7.54 / MAX: 17.41MIN: 10.08 / MAX: 16.3MIN: 7.54 / MAX: 22.25MIN: 3.64 / MAX: 14.42MIN: 3.21 / MAX: 16.73MIN: 3.14 / MAX: 13.29MIN: 2.7 / MAX: 13.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X400800120016002000390.03460.22390.02458.38684.78878.341180.301851.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X122436486028.7055.1028.9155.617.575.826.445.52MIN: 28.15 / MAX: 35.06MIN: 43.43 / MAX: 57.02MIN: 28.13 / MAX: 34.69MIN: 41.77 / MAX: 68.79MIN: 6.66 / MAX: 10.78MIN: 3.04 / MAX: 18.04MIN: 3.32 / MAX: 13.96MIN: 2.89 / MAX: 13.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X30060090012001500209.02181.19207.49179.69527.78686.80931.521446.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X51015202519.4316.0019.4516.0410.808.118.7710.49MIN: 18.46 / MAX: 26.18MIN: 14.09 / MAX: 25.84MIN: 18.39 / MAX: 25.47MIN: 13.66 / MAX: 25.82MIN: 5.27 / MAX: 12.56MIN: 4.87 / MAX: 21.23MIN: 7.17 / MAX: 17.28MIN: 4.87 / MAX: 19.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X160320480640800205.79249.83205.52249.21370.07492.60683.30762.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X481216207.5814.537.6014.345.695.856.455.51MIN: 7.47 / MAX: 33.92MIN: 8.16 / MAX: 18.15MIN: 7.46 / MAX: 12.65MIN: 11.11 / MAX: 15.47MIN: 3.01 / MAX: 14.04MIN: 3.19 / MAX: 18.82MIN: 3.63 / MAX: 14.04MIN: 3.02 / MAX: 13.921. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X6001200180024003000790.35684.89788.77694.551054.541366.981858.442903.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.37350.7471.12051.4941.86750.941.660.941.650.360.370.430.35MIN: 0.91 / MAX: 6.48MIN: 0.97 / MAX: 2.79MIN: 0.9 / MAX: 6.47MIN: 1.27 / MAX: 2.22MIN: 0.22 / MAX: 2.91MIN: 0.23 / MAX: 12.52MIN: 0.25 / MAX: 8.27MIN: 0.22 / MAX: 8.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X10K20K30K40K50K6317.975970.936329.926046.3216542.8721216.5327745.5644954.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.33980.67961.01941.35921.6990.861.510.861.510.630.640.710.61MIN: 0.83 / MAX: 6.58MIN: 1.14 / MAX: 2.14MIN: 0.84 / MAX: 6.54MIN: 1.11 / MAX: 1.95MIN: 0.35 / MAX: 8.21MIN: 0.36 / MAX: 12.08MIN: 0.38 / MAX: 8.93MIN: 0.35 / MAX: 8.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X6K12K18K24K30K6960.146606.336963.176605.869515.2912465.6716732.8826078.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.37, N = 3121.51184.54119.73185.0984.4587.4994.8284.24

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.07, N = 324.6926.9325.0526.8135.5145.7263.2594.95

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.001049, N = 32.5034363.5796662.5118933.5639792.9014534.0510685.0270597.5203491. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 5121240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.000973, N = 32.5895813.7119772.5900083.6753622.9641164.1679815.2127997.7808741. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.65, N = 3112.13173.50111.75173.1361.7069.7572.9381.77

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.10, N = 326.7528.6726.8428.7048.6157.3482.2497.80

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.003281, N = 32.6503673.8689272.6417623.8586502.9703824.1998505.2683667.5909261. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 11240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1632486480SE +/- 0.12, N = 356.8857.9955.7457.9166.4167.9874.1770.45

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 0.02, N = 3174.38161.46172.73161.69211.96164.10124.2785.94

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0006, N = 35.73466.19325.78946.18444.71776.09358.046611.6359

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X50100150200250SE +/- 0.25, N = 3175.06161.39173.08161.73211.72164.13124.2685.96

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.0097, N = 35.71226.19615.77766.18294.72326.09268.047211.6325

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.05, N = 345.6043.0643.8443.1531.0725.0021.0916.64

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1326395265SE +/- 0.02, N = 321.9323.2222.8123.1732.1839.9947.4060.09

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 10241240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.002717, N = 32.7216803.9834382.7280483.9734043.0386444.3093785.3711738.4110541. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.11, N = 342.8244.0442.3643.9621.9017.0618.1815.44

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1428425670SE +/- 0.06, N = 323.3522.7123.6022.7545.6658.5954.9964.74

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.08, N = 361.4491.4860.3091.5042.0043.5846.6543.85

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.05, N = 348.8254.5149.7554.5871.4191.75128.59182.40

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.50, N = 376.37118.5177.42116.5360.8364.8268.9469.44

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.17, N = 339.2542.0838.7142.7549.2961.6886.97115.00

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1B1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1020304050SE +/- 0.13, N = 342.7743.3742.6643.6133.1828.0123.0519.65

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X510152025SE +/- 0.0418, N = 322.823321.416022.153821.137115.675312.475510.72598.8369

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.09, N = 343.8146.6945.1347.3063.7880.1393.19113.11

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1326395265SE +/- 0.22, N = 338.1757.8038.0857.5126.3927.4329.2527.09

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300SE +/- 0.33, N = 378.5686.3678.7586.88113.64145.76204.98295.18

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X714212835SE +/- 0.05, N = 328.7628.5228.7628.5323.2818.3015.3712.79

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.06, N = 334.7635.0534.7635.0442.9454.6165.0178.10

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X48121620SE +/- 0.0097, N = 314.681614.597714.721914.605311.73328.08347.50164.9123

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.04, N = 368.0968.4867.9168.4585.18123.62133.21203.36

nginx

Connections: 4000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 4000Ryzen 5 7600Ryzen 7 770020K40K60K80K100K71632.4887991.411. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030002897.042292.791659.311132.89MIN: 2894.58MIN: 2263.98MIN: 1653.28MIN: 1126.661. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030002894.802284.921657.571141.29MIN: 2890.45MIN: 2256.32MIN: 1652.65MIN: 1136.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60012001800240030002899.282286.061654.841138.44MIN: 2894.06MIN: 2264.7MIN: 1650.57MIN: 1134.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X300600900120015001452.021153.65843.76577.90MIN: 1449.41MIN: 1128.34MIN: 839.84MIN: 572.81. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X300600900120015001444.741151.66845.73584.27MIN: 1431.65MIN: 1129.92MIN: 841.79MIN: 578.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X300600900120015001451.111153.92844.74576.37MIN: 1446.43MIN: 1131.1MIN: 841.12MIN: 571.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X306090120150SE +/- 0.11, N = 348.0954.7447.9954.7280.0197.02117.74143.32

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760051015202514.4718.2914.4418.2519.51

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X60120180240300SE +/- 0.40, N = 3102.84108.31102.40107.89148.41178.79217.93260.05

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760051015202515.5019.5315.4919.4420.78

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X81624324029.9034.6931.1835.2832.9531.2229.1330.45

nginx

Connections: 20

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 20Ryzen 5 7600Ryzen 7 770020K40K60K80K100K68924.1988942.431. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760061218243017.8422.2117.7922.1124.491. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X71421283526.2131.0427.2030.8228.3527.0025.3726.35

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X71421283526.1430.3127.0830.4328.4126.9225.4726.07

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760061218243018.9223.9418.9323.7725.18

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: All1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X70140210280350SE +/- 0.38, N = 3271.97304.22269.98304.23304.47320.94212.74267.23

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbps1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X71421283525.0129.1326.0529.3227.0925.5424.3025.22

QuadRay

Scene: 5 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.47250.9451.41751.892.3625SE +/- 0.00, N = 30.550.310.550.310.770.981.312.101. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.00, N = 31.701.081.701.082.423.064.056.531. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.00, N = 32.181.312.171.312.823.604.757.481. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X612182430SE +/- 0.00, N = 37.414.577.454.5510.3213.1117.1626.471. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 5 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X246810SE +/- 0.00, N = 32.181.232.181.233.073.885.238.381. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X714212835SE +/- 0.00, N = 38.215.168.215.1610.7513.5717.7028.601. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X612182430SE +/- 0.00, N = 36.724.216.904.219.3611.8415.7225.011. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X20406080100SE +/- 0.03, N = 327.6517.9827.9217.9540.5150.9165.90103.211. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760071421283522.2627.9322.2227.7430.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 760071421283522.4029.5522.4129.3729.58

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNet1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.07, N = 389.9694.0590.3194.38114.99133.38154.19173.85

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500M1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X510152025SE +/- 0.057, N = 319.64520.45519.59320.42915.07512.70910.7749.101

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X48121620SE +/- 0.055, N = 37.9159.0987.8999.01210.34012.04113.66311.9101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 760081624324025.1332.9325.1432.8633.15

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1530456075SE +/- 0.10, N = 331.5538.0031.6137.9337.0245.4157.1666.421. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 7600102030405030.6638.3130.7038.1841.901. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Slow1240013400Core i5 12400Core i5 13400Ryzen 5 7600112233445533.2043.3733.1243.6746.381. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Medium1240013400Core i5 12400Core i5 13400Ryzen 5 7600112233445534.4345.0234.4745.1347.881. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, Lossless1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.021, N = 313.10110.12013.16610.0789.9678.1946.7325.5331. (CXX) g++ options: -O3 -fPIC -lm

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X36912159.375937.643695.575453.63050MIN: 8.99MIN: 7.01MIN: 5.15MIN: 3.491. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.21782.43563.65344.87126.0895.412524.391063.461523.14041MIN: 5.22MIN: 3.82MIN: 3.03MIN: 2.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.23370.46740.70110.93481.16851.0386800.8107270.6174400.419833MIN: 1MIN: 0.74MIN: 0.56MIN: 0.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 61240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X3691215SE +/- 0.012, N = 39.0506.9709.1277.0116.6945.4524.1423.2161. (CXX) g++ options: -O3 -fPIC -lm

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010064.1581.6364.1781.7285.93

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.90661.81322.71983.62644.5334.029503.256392.463881.73491MIN: 3.77MIN: 2.9MIN: 2.23MIN: 1.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010068.5088.3368.6088.2690.67

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.16920.33840.50760.67680.8460.7518120.6001970.5837750.468351MIN: 0.73MIN: 0.55MIN: 0.54MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.35550.7111.06651.4221.77751.5800401.2693401.1270700.677558MIN: 1.5MIN: 1.15MIN: 1.04MIN: 0.61. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.36, N = 386.71103.9387.11103.77106.31128.87161.10174.401. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010075.6392.7175.4592.56104.231. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.26, N = 3116.98134.95117.30134.25126.65151.27185.43198.501. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76002040608010082.38107.5782.41107.50108.63

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.12330.24660.36990.49320.61650.5478450.4367350.3092790.209335MIN: 0.52MIN: 0.39MIN: 0.28MIN: 0.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.36930.73861.10791.47721.84651.6413301.5340600.6567810.433981MIN: 1.62MIN: 1.41MIN: 0.61MIN: 0.421. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.07070.14140.21210.28280.35350.3142920.2514550.1862800.129945MIN: 0.3MIN: 0.22MIN: 0.17MIN: 0.121. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4K1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X4080120160200SE +/- 0.71, N = 3123.73141.41123.34142.94135.09160.87192.69197.401. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, Lossless1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.31422.62843.94265.25686.571SE +/- 0.021, N = 35.7474.9065.8414.9834.3763.9393.5763.3971. (CXX) g++ options: -O3 -fPIC -lm

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super Fast1240013400Core i5 12400Core i5 13400Ryzen 5 760030609012015095.03119.2794.93119.64128.891. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.00152.0033.00454.0065.00754.451304.327003.176003.21319MIN: 4.36MIN: 4.15MIN: 3.12MIN: 3.171. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.58471.16941.75412.33882.92352.598672.499821.528281.54188MIN: 2.52MIN: 2.28MIN: 1.45MIN: 1.451. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.22410.44820.67230.89641.12050.9960050.9514690.3617760.370900MIN: 0.93MIN: 0.85MIN: 0.34MIN: 0.321. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra Fast1240013400Core i5 12400Core i5 13400Ryzen 5 76004080120160200127.36165.29127.53164.90172.401. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468107.377727.651345.698085.59919MIN: 7.29MIN: 7.22MIN: 5.61MIN: 5.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X2468107.072997.325015.209565.19324MIN: 7MIN: 6.99MIN: 5.13MIN: 5.141. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.75571.51142.26713.02283.77853.251993.358701.844061.75749MIN: 3.19MIN: 3.09MIN: 1.78MIN: 1.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X150300450600750SE +/- 3.43, N = 3447.69502.96453.39500.43523.71609.39685.38578.981. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080p1240013400Core i5 12400Core i5 13400Ryzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X160320480640800SE +/- 2.55, N = 3497.22537.89497.71533.94577.57664.22739.03518.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X1.20452.4093.61354.8186.02255.353143.940373.391072.34460MIN: 5.3MIN: 3.73MIN: 3.3MIN: 2.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.74161.48322.22482.96643.7083.296072.523062.131391.40804MIN: 3.13MIN: 2.34MIN: 2.04MIN: 1.361. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPURyzen 5 7600Ryzen 7 7700Ryzen 9 7900Ryzen 9 7950X0.30360.60720.91081.21441.5181.3495401.0011900.8632190.582188MIN: 1.29MIN: 0.9MIN: 0.82MIN: 0.571. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Phoronix Test Suite v10.8.5