AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpus

Benchmarks for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/2301151-PTS-EO2022BE21&rdt&gru.

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)AMD Device 14d832GB2000GB Samsung SSD 980 PRO 2TB + 257GB Flash DriveAMD Radeon RX 6750 XT 12GB (2880/1124MHz)AMD Navi 21 HDMI AudioASUS MG28UIntel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411Ubuntu 22.046.0.0-060000rc1daily20220820-generic (x86_64)GNOME Shell 42.2X Server 1.21.1.3 + Wayland4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48)1.3.224GCC 12.0.1 20220319ext43840x2160AMD Ryzen 9 7900 12-Core @ 5.48GHz (12 Cores / 24 Threads)2000GB Samsung SSD 980 PRO 2TBAMD Ryzen 7 7700 8-Core @ 5.39GHz (8 Cores / 16 Threads)2000GB Samsung SSD 980 PRO 2TB + 2000GBAMD Radeon RX 6800 XT 16GB (2575/1000MHz)AMD Ryzen 5 7600 6-Core @ 5.17GHz (6 Cores / 12 Threads)2000GB Samsung SSD 980 PRO 2TBIntel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads)ASUS PRIME Z790-P WIFI (0602 BIOS)Intel Device 7a27AMD Radeon RX 6700 XT 12GB (2855/1000MHz)Realtek ALC897ASUS VP28UIntel Device 7a70Intel Core i5-13400 @ 3.40GHz (10 Cores / 16 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Ryzen 9 7950X: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 9 7900: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 7 7700: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Ryzen 5 7600: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa601203- Core i5 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 12400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25 - Thermald 2.4.9- 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25- Core i5 13400: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x25Python Details- Python 3.10.4Security Details- Ryzen 9 7950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 9 7900: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 7 7700: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Ryzen 5 7600: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- Core i5 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 12400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected- Core i5 13400: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

AMD Ryzen Non-X vs. Intel Alder Lake/Raptor Lake benchmarks new cpusminibude: OpenMP - BM1nekrs: TurboPipe Periodicquadray: 1 - 4Kquadray: 2 - 4Kquadray: 3 - 4Kquadray: 5 - 4Kquadray: 1 - 1080pquadray: 2 - 1080pquadray: 3 - 1080pquadray: 5 - 1080popenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080puvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 1080p - Ultra Fastkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastminibude: OpenMP - BM1xmrig: Monero - 1Mxmrig: Wownero - 1Mtensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - AlexNettensorflow: CPU - 64 - AlexNettensorflow: CPU - 16 - GoogLeNettensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 32 - ResNet-50tensorflow: CPU - 64 - GoogLeNettensorflow: CPU - 64 - ResNet-50openvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalardeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamjpegxl: PNG - 80jpegxl: PNG - 90jpegxl: JPEG - 80jpegxl: JPEG - 90jpegxl: PNG - 100jpegxl: JPEG - 100jpegxl-decode: 1jpegxl-decode: Allcockroach: MoVR - 128cockroach: MoVR - 256cockroach: MoVR - 512cockroach: MoVR - 1024cockroach: KV, 10% Reads - 128cockroach: KV, 10% Reads - 256cockroach: KV, 10% Reads - 512cockroach: KV, 50% Reads - 128cockroach: KV, 50% Reads - 256cockroach: KV, 50% Reads - 512cockroach: KV, 60% Reads - 128cockroach: KV, 60% Reads - 256cockroach: KV, 60% Reads - 512cockroach: KV, 95% Reads - 128cockroach: KV, 95% Reads - 256cockroach: KV, 95% Reads - 512cockroach: KV, 10% Reads - 1024cockroach: KV, 50% Reads - 1024cockroach: KV, 60% Reads - 1024cockroach: KV, 95% Reads - 1024clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runstargate: 44100 - 512stargate: 96000 - 512stargate: 192000 - 512stargate: 44100 - 1024stargate: 480000 - 512stargate: 96000 - 1024stargate: 192000 - 1024stargate: 480000 - 1024nginx: 20nginx: 100nginx: 200nginx: 500nginx: 1000nginx: 4000spacy: en_core_web_lgspacy: en_core_web_trfbrl-cad: VGR Performance Metriconednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containeravifenc: 0avifenc: 2avifenc: 6avifenc: 6, Losslessavifenc: 10, Losslessbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigy-cruncher: 1By-cruncher: 500Mblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyencodec: 3 kbpsencodec: 6 kbpsencodec: 24 kbpsencodec: 1.5 kbpsRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340056.8637131420000026.477.486.532.1103.2128.625.018.3814.367.67.59762.1628.271851.751446.82134.332903.281703.8944954.5926078.965.12866.416198.497197.39711.91174.404578.976518.1751421.57813104.320480.9173.85260.05344.54143.3242.65145.5944.24143.444.5934417512.538411.635997.80164.7364115.004478.0988295.1781203.3551182.3955113.110294.953460.089812.560111.632512.1712.0211.911.640.990.9270.45267.23122.8122.8122.2122.86757.613554.145991.31199724264.266871.114664.630094.374346.9109601.2129868.6117739.265240.283215.691613.2114820.87.7808744.1886772.1894498.4110547.5203495.8870843.8086427.590926197728.82194668.2177431.3149355.731980018061.734913.213190.4683510.37090.6775581.541885.599193.140412.34465.193240.4198330.5821881132.89576.3691141.291.757493.63051.40804577.9040.4339811138.44584.2740.1299450.209335554.951045.761048.9510.49282.774.315.5259.515.514.690.350.61635.508285.936381.770815.441769.443412.794227.08984.912343.84738.836984.237816.6375633.81585.962122.570834162.8275688.154.98165.963.18286.1972.09537.7253.2165.5333.39743.41516.25519.6479.10149.54130.3364.4470.3159.2126.07326.34530.44825.21736.5996660100000017.164.754.051.3165.917.715.725.239.345.245.25683.318.311180.3931.5299.461858.441119.5527745.5616732.884.51157.162185.429192.68913.663161.1685.384739.028914.9641327914345.3154.19217.93273.82117.7436.92118.9737.78117.3537.692781358.65288.046682.239954.991186.973565.0078204.9837133.2117128.588493.192363.246747.4018.67078.047212.8812.7112.5712.361.020.9374.17212.74125.9125.5125.81267076.914338.943498.712631.325105.657623.614938.530313.764464.394461.695980.393584.755906.268221.771172.686491.75.2127993.7110852.4220285.3711735.0270593.9013512.5987025.268366131511.71129714.87124644.27116337.681949613932.463883.1760.5837750.3617761.127071.528285.698083.461523.391075.209560.617440.8632191659.31844.7351657.571.844065.575452.13139843.7570.6567811654.84845.7320.186280.309279640.671140.441137.548.77327.195.086.4460.286.455.350.430.71693.0702124.270772.930618.179568.936815.374129.24967.501646.646410.725994.815321.0925691.4685124.262326.423261175.06572104.2869.19201.8484.43351.0693.7246.2874.1426.7323.57658.295731.36223.04710.77476.34200.2698.99713.99245.3725.46925.3729.12624.29627.0455546120000013.113.63.060.9850.9113.5711.843.886.883.893.93492.613.6878.34686.881.21366.98815.5421216.5312465.673.66345.412151.27160.86812.041128.872609.385664.223676.1167820.910175.5133.38178.79211.4897.0232.3295.8832.2194.3931.9206986.13246.093557.337858.58561.677854.6068145.7601123.618791.753780.127545.71639.98846.12716.092611.7111.5211.4211.240.930.8967.98320.94126.6125.8126125.96681.113882.337644.811773.924135.451227.614780.930242.857896.58377481006.575589.847874.555451.258030.368924.14.1679813.0031911.9580334.3093784.0510683.1114222.0792774.1998588942.43101913.0499945.5194196.1589489.3387991.411940710593.256394.3270.6001970.9514691.269342.499827.651344.391063.940377.325010.8107271.001192292.791153.922284.923.35877.643692.523061153.651.534062286.061151.660.2514550.436735580.851026.041013.268.11293.724.555.8249.245.854.90.370.64652.214164.101469.747517.062664.81718.303327.43058.083443.584412.475587.485525.0016652.4324164.126931.599213254.92801127.3285.14260.88127.81504.92117.10856.2865.4528.1943.93978.9621022.51328.01112.709103.86273.02134.71987.28334.8726.9192731.22425.54320.7944909970000010.322.822.420.7740.5110.759.363.075.323.073.01370.0710.36684.78527.7860.191054.54701.4216542.879515.293.03537.023126.653135.09310.34106.311523.708577.56929.5833.1585.9390.67108.635.876.6119.5120.7825.1846.3847.88104.23128.89172.49.459.6524.4930.5641.9519.857111.37963.2114.99148.41170.3580.0127.4579.1527.2878.3627.04163774.74984.717748.614245.658649.289342.936113.641685.183871.407763.77835.512432.18254.74744.723211.1410.9510.8410.630.960.7966.41304.47125.8125.8125.8125.36588.713607.432015.211791.723677.244990.415076.829982.14958166158.564003.957478.43860344158.44574854217.32.9641162.1616871.4321063.0386442.9014532.2295541.489762.97038268924.1981219.4279667.0874959.9871972.1271632.48188748481736894.02954.45130.7518120.9960051.580042.598677.377725.412525.353147.072991.038681.349542897.041451.112894.83.251999.375933.296071452.021.641332899.281444.740.3142920.547845747.161299.351319.710.8386.145.847.5766.425.695.70.360.63631.5967211.961661.695821.895560.829423.282926.386511.733242.002115.675384.454931.0687631.9121211.71535.667484275.4576140.23104.87316.73154.84576.5142.82367.8616.6949.9674.37696.351287.71733.17915.075134.76357.43173.741287.74433.0528.41128.35132.94727.09210.217569268000007.452.171.70.5527.928.216.92.181.91.321.32205.527.93390.02207.4925.49788.77318.636329.926963.172.40531.611117.296123.3387.89987.111453.392497.71222.4125.1464.1768.682.414.485.0614.4415.4918.9333.1234.4775.4594.93127.536.937.1317.7922.2230.7255.4354585.36231.790.31102.4109.5747.9918.749.2919.2849.9419.71146756.03385.789426.839823.601138.706534.759878.752467.906949.746245.132825.052522.8066.03365.77769.148.938.878.680.840.8355.74269.98125.3124.9125.4125.86631.213343.230654.111841.823659.641073.514590.129557.243959.359000.657642.856455.536820.541950.844079.655187.6180.38200.59202.902.5900081.8162991.1681832.7280482.5118931.9426771.2826592.6417621590715351495982098.293016.233026.3919.45503.5910.2528.91156.757.612.550.940.86497.1534172.7264111.749242.364177.417828.761738.083714.721960.296622.1538119.729743.8448497.2002173.0775178.37112.09333.39195.38644.83180.89682.8349.12713.1665.841122.0391597.04542.6619.593154.16445.12217.841728.2536.6627.08327.19531.17926.04710.221565383000007.412.181.70.5527.658.216.722.181.91.331.33205.797.95390.03209.0225.57790.35316.136317.976960.142.40831.553116.983123.7347.91586.714447.691497.21722.425.1364.1568.582.384.495.0614.4715.518.9233.234.4375.6395.03127.366.947.1217.8422.2630.66255.53445906201.589.96102.84109.3548.0918.7349.1719.3249.9719.72147756.01975.734626.748923.351639.250934.762778.563668.093548.823143.808924.68521.92795.96665.71229.259.089.098.920.840.8356.88271.97125.3124.9124.9124.8662213478.130683.911716.523631.140974.914628.729540.24398159140.65747056109.536894.841862.444239.555093.5185.00199.01201.102.5895811.8114171.1786182.721682.5034361.9454861.2846952.6503671588515571495512094.063012.863010.5619.43503.1110.2528.7156.317.5812.650.940.86498.3122174.3773112.128342.816676.373328.757838.173714.681661.436722.8233121.512645.6008501.9394175.0597178.13111.92333.43195.67644.8180.65282.4249.0513.1015.747121.3581592.6342.76619.645154.3444.9216.931726.29535.4726.14326.20629.90125.0137.412435492000004.571.311.080.3117.985.164.211.232.521.71.7249.839.26460.22181.1932.08684.893775970.936606.332.87337.998134.946141.4119.098103.929502.961537.88629.5532.9381.6388.33107.575.586.318.2919.5323.9443.3745.0292.71119.27165.298.678.922.2127.9338.31185.2935168.47122.994.05108.31117.4354.7418.9456.0018.9257.5119.47175936.50686.193228.669722.705142.076035.054886.357268.484254.512946.687526.930223.22326.47796.19619.889.719.759.590.880.8657.99304.22124.2124.3124.4124.46690.813657.034012.012043.823946.245770.214829.229512.350477.069633.968318.567125.842546.149206.751715.565255.6212.37228.27225.553.7119772.5455321.6426013.9834383.5796662.8216041.8585523.8689271645910402050781583.072328.12330.8716429.898.6855.1124.6214.5310.61.661.51764.8044161.4642173.503644.0366118.513028.520757.802814.597791.479121.4160184.542843.0572765.8951161.3888242.52165.13387.78292.59796.75140.71565.7236.97010.1204.90695.9321243.63843.36820.455119.20348.77171.621359.5418.1830.30531.03634.69129.1277.434434782000004.551.311.080.3117.955.164.211.232.511.71.7249.219.17458.38179.6932694.55376.186046.326605.862.88937.934134.252142.9419.012103.774500.426533.94129.3732.8681.7288.26107.55.576.2918.2519.4423.7743.6745.1392.56119.64164.98.678.8822.1127.7438.18185.8485164.37156.994.38107.89117.1454.7218.9755.9518.9457.519.43176936.49296.184428.704222.746642.74535.043486.878668.449954.575147.303526.814223.17266.52956.18299.879.729.779.610.880.8657.91304.23124.8124.9124.6124.66770.51370434253.812118.224114.245816.514961.329664.750413.569900.268289.166905.64255149201.151692.865146.2209.34222.15224.483.6753622.5248471.6202423.9734043.5639792.8142641.8500663.858651663210342047331584.912334.052341.3916.04432.138.7255.61124.9314.3410.621.651.51765.8308161.6931173.132943.9558116.534228.5357.509114.605391.495921.1371185.088743.1512761.8269161.7337239.47164.84388.7291.76785.44140.47465.4257.01110.0784.98396.7781245.07143.6120.429119.15348.54171.281365.21419.630.42530.82235.27829.318OpenBenchmarking.org

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001326395265SE +/- 0.027, N = 356.86336.59927.04520.79410.21710.2217.4127.4341. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe PeriodicRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340015000M30000M45000M60000M75000MSE +/- 42366535.54, N = 371314200000666010000005546120000049099700000569268000005653830000043549200000434782000001. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

QuadRay

Scene: 1 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400612182430SE +/- 0.00, N = 326.4717.1613.1110.327.457.414.574.551. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 37.484.753.602.822.172.181.311.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 36.534.053.062.421.701.701.081.081. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 5 - Resolution: 4K

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.47250.9451.41751.892.3625SE +/- 0.00, N = 32.101.310.980.770.550.550.310.311. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 1 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 1 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.03, N = 3103.2165.9050.9140.5127.9227.6517.9817.951. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 2 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 2 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400714212835SE +/- 0.00, N = 328.6017.7013.5710.758.218.215.165.161. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 3 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 3 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400612182430SE +/- 0.00, N = 325.0115.7211.849.366.906.724.214.211. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

QuadRay

Scene: 5 - Resolution: 1080p

OpenBenchmarking.orgFPS, More Is BetterQuadRay 2022.05.25Scene: 5 - Resolution: 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.00, N = 38.385.233.883.072.182.181.231.231. (CXX) g++ options: -O3 -pthread -lm -lstdc++ -lX11 -lXext -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004812162014.369.346.885.321.901.902.522.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134002468107.605.243.893.071.321.331.701.701. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134002468107.595.253.933.011.321.331.701.701. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400160320480640800762.16683.30492.60370.07205.52205.79249.83249.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340071421283528.2718.3113.6010.367.937.959.269.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004008001200160020001851.751180.30878.34684.78390.02390.03460.22458.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400300600900120015001446.82931.52686.80527.78207.49209.02181.19179.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150134.3399.4681.2060.1925.4925.5732.0832.001. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340060012001800240030002903.281858.441366.981054.54788.77790.35684.89694.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004008001200160020001703.891119.55815.54701.42318.63316.13377.00376.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340010K20K30K40K50K44954.5927745.5621216.5316542.876329.926317.975970.936046.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134006K12K18K24K30K26078.9616732.8812465.679515.296963.176960.146606.336605.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001.15382.30763.46144.61525.769SE +/- 0.004, N = 35.1284.5113.6633.0352.4052.4082.8732.8891. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001530456075SE +/- 0.10, N = 366.4257.1645.4137.0231.6131.5538.0037.931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.26, N = 3198.50185.43151.27126.65117.30116.98134.95134.251. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.71, N = 3197.40192.69160.87135.09123.34123.73141.41142.941. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340048121620SE +/- 0.055, N = 311.91013.66312.04110.3407.8997.9159.0989.0121. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 8 - Input: Bosphorus 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.36, N = 3174.40161.10128.87106.3187.1186.71103.93103.771. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400150300450600750SE +/- 3.43, N = 3578.98685.38609.39523.71453.39447.69502.96500.431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 1080pRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400160320480640800SE +/- 2.55, N = 3518.18739.03664.22577.57497.71497.22537.89533.941. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowRyzen 5 7600Core i5 124001240013400Core i5 1340071421283529.5822.4122.4029.5529.37

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumRyzen 5 7600Core i5 124001240013400Core i5 1340081624324033.1525.1425.1332.9332.86

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastRyzen 5 7600Core i5 124001240013400Core i5 134002040608010085.9364.1764.1581.6381.72

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastRyzen 5 7600Core i5 124001240013400Core i5 134002040608010090.6768.6068.5088.3388.26

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastRyzen 5 7600Core i5 124001240013400Core i5 1340020406080100108.6382.4182.38107.57107.50

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowRyzen 5 7600Core i5 124001240013400Core i5 134001.32082.64163.96245.28326.6045.874.484.495.585.57

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumRyzen 5 7600Core i5 124001240013400Core i5 134002468106.615.065.066.306.29

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastRyzen 5 7600Core i5 124001240013400Core i5 1340051015202519.5114.4414.4718.2918.25

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastRyzen 5 7600Core i5 124001240013400Core i5 1340051015202520.7815.4915.5019.5319.44

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastRyzen 5 7600Core i5 124001240013400Core i5 1340061218243025.1818.9318.9223.9423.77

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowRyzen 5 7600Core i5 124001240013400Core i5 13400112233445546.3833.1233.2043.3743.671. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumRyzen 5 7600Core i5 124001240013400Core i5 13400112233445547.8834.4734.4345.0245.131. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastRyzen 5 7600Core i5 124001240013400Core i5 1340020406080100104.2375.4575.6392.7192.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastRyzen 5 7600Core i5 124001240013400Core i5 13400306090120150128.8994.9395.03119.27119.641. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastRyzen 5 7600Core i5 124001240013400Core i5 134004080120160200172.40127.53127.36165.29164.901. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowRyzen 5 7600Core i5 124001240013400Core i5 1340036912159.456.936.948.678.671. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumRyzen 5 7600Core i5 124001240013400Core i5 1340036912159.657.137.128.908.881. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastRyzen 5 7600Core i5 124001240013400Core i5 1340061218243024.4917.7917.8422.2122.111. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastRyzen 5 7600Core i5 124001240013400Core i5 1340071421283530.5622.2222.2627.9327.741. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastRyzen 5 7600Core i5 124001240013400Core i5 13400102030405041.9030.7030.6638.3138.181. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340030060090012001500SE +/- 0.67, N = 31421.58914.96676.12519.85255.44255.53185.29185.851. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1MRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 5.44, N = 313104.313279.07820.97111.34585.34590.05168.45164.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004K8K12K16K20KSE +/- 15.59, N = 320480.914345.310175.57963.26231.76201.57122.97156.91. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.07, N = 3173.85154.19133.38114.9990.3189.9694.0594.38

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: AlexNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340060120180240300SE +/- 0.40, N = 3260.05217.93178.79148.41102.40102.84108.31107.89

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: AlexNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340070140210280350SE +/- 0.25, N = 3344.54273.82211.48170.35109.57109.35117.43117.14

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.11, N = 3143.32117.7497.0280.0147.9948.0954.7454.72

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.01, N = 342.6536.9232.3227.4518.7018.7318.9418.97

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: GoogLeNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.07, N = 3145.59118.9795.8879.1549.2949.1756.0055.95

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 32 - Model: ResNet-50Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.02, N = 344.2437.7832.2127.2819.2819.3218.9218.94

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: GoogLeNetRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.13, N = 3143.40117.3594.3978.3649.9449.9757.5157.50

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 64 - Model: ResNet-50Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.02, N = 344.5937.6931.9027.0419.7119.7219.4719.43

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340070140210280350SE +/- 0.58, N = 3344278206163146147175176MIN: 55 / MAX: 2868MIN: 38 / MAX: 3234MIN: 27 / MAX: 2543MIN: 21 / MAX: 2129MIN: 15 / MAX: 2301MIN: 15 / MAX: 2299MIN: 18 / MAX: 2713MIN: 19 / MAX: 2712

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ScalarRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.00, N = 3175135987775759393MIN: 19 / MAX: 2252MIN: 13 / MAX: 2264MIN: 9 / MAX: 1750MIN: 7 / MAX: 1390MIN: 7 / MAX: 1382MIN: 7 / MAX: 1385MIN: 9 / MAX: 1775MIN: 9 / MAX: 1779

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.0278, N = 312.53848.65286.13244.74986.03386.01976.50686.4929

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.0006, N = 311.63598.04666.09354.71775.78945.73466.19326.1844

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.10, N = 397.8082.2457.3448.6126.8426.7528.6728.70

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001428425670SE +/- 0.06, N = 364.7454.9958.5945.6623.6023.3522.7122.75

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.17, N = 3115.0086.9761.6849.2938.7139.2542.0842.75

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.06, N = 378.1065.0154.6142.9434.7634.7635.0535.04

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340060120180240300SE +/- 0.33, N = 3295.18204.98145.76113.6478.7578.5686.3686.88

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.04, N = 3203.36133.21123.6285.1867.9168.0968.4868.45

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.05, N = 3182.40128.5991.7571.4149.7548.8254.5154.58

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.09, N = 3113.1193.1980.1363.7845.1343.8146.6947.30

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.07, N = 394.9563.2545.7235.5125.0524.6926.9326.81

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001326395265SE +/- 0.02, N = 360.0947.4039.9932.1822.8121.9323.2223.17

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.0214, N = 312.56018.67076.12714.74746.03365.96666.47796.5295

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.0097, N = 311.63258.04726.09264.72325.77765.71226.19616.1829

JPEG XL libjxl

Input: PNG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 80Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.01, N = 312.1712.8811.7111.149.149.259.889.871. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.01, N = 312.0212.7111.5210.958.939.089.719.721. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 80

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 80Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.00, N = 311.9012.5711.4210.848.879.099.759.771. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.01, N = 311.6412.3611.2410.638.688.929.599.611. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 100Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.22950.4590.68850.9181.1475SE +/- 0.00, N = 30.991.020.930.960.840.840.880.881. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.20930.41860.62790.83721.0465SE +/- 0.00, N = 30.920.930.890.790.830.830.860.861. (CXX) g++ options: -fno-rtti -funwind-tables -O3 -O2 -fPIE -pie -lm -latomic

JPEG XL Decoding libjxl

CPU Threads: 1

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: 1Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001632486480SE +/- 0.12, N = 370.4574.1767.9866.4155.7456.8857.9957.91

JPEG XL Decoding libjxl

CPU Threads: All

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL Decoding libjxl 0.7CPU Threads: AllRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340070140210280350SE +/- 0.38, N = 3267.23212.74320.94304.47269.98271.97304.22304.23

CockroachDB

Workload: MoVR - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 128Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.07, N = 3122.8125.9126.6125.8125.3125.3124.2124.8

CockroachDB

Workload: MoVR - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 256Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.00, N = 3122.8125.5125.8125.8124.9124.9124.3124.9

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.10, N = 3122.2125.8126.0125.8125.4124.9124.4124.6

CockroachDB

Workload: MoVR - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.07, N = 3122.8126.0125.9125.3125.8124.8124.4124.6

CockroachDB

Workload: KV, 10% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 128Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340015003000450060007500SE +/- 28.90, N = 36757.67076.96681.16588.76631.26622.06690.86770.5

CockroachDB

Workload: KV, 10% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 256Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 57.49, N = 313554.114338.913882.313607.413343.213478.113657.013704.0

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340010K20K30K40K50KSE +/- 56.87, N = 345991.343498.737644.832015.230654.130683.934012.034253.8

CockroachDB

Workload: KV, 50% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 128Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 141.12, N = 311997.012631.311773.911791.711841.811716.512043.812118.2

CockroachDB

Workload: KV, 50% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 256Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134005K10K15K20K25KSE +/- 42.71, N = 324264.225105.624135.423677.223659.623631.123946.224114.2

CockroachDB

Workload: KV, 50% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340014K28K42K56K70KSE +/- 45.17, N = 366871.157623.651227.644990.441073.540974.945770.245816.5

CockroachDB

Workload: KV, 60% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 128Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003K6K9K12K15KSE +/- 39.43, N = 314664.614938.514780.915076.814590.114628.714829.214961.3

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134006K12K18K24K30KSE +/- 213.65, N = 330094.330313.730242.829982.129557.229540.229512.329664.7

CockroachDB

Workload: KV, 60% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340016K32K48K64K80KSE +/- 42.65, N = 374346.964464.357896.549581.043959.343981.050477.050413.5

CockroachDB

Workload: KV, 95% Reads - Concurrency: 128

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 128Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020K40K60K80K100KSE +/- 104.96, N = 3109601.294461.683774.066158.559000.659140.669633.969900.2

CockroachDB

Workload: KV, 95% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 256Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340030K60K90K120K150KSE +/- 126.38, N = 3129868.695980.381006.564003.957642.857470.068318.568289.1

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340030K60K90K120K150KSE +/- 241.43, N = 3117739.293584.775589.857478.456455.556109.567125.866905.6

CockroachDB

Workload: KV, 10% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340014K28K42K56K70KSE +/- 24.23, N = 365240.255906.247874.538603.036820.536894.842546.142551.0

CockroachDB

Workload: KV, 50% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 50% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020K40K60K80K100KSE +/- 93.19, N = 383215.668221.755451.244158.441950.841862.449206.749201.1

CockroachDB

Workload: KV, 60% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020K40K60K80K100KSE +/- 106.59, N = 391613.271172.658030.345748.044079.644239.551715.551692.8

CockroachDB

Workload: KV, 95% Reads - Concurrency: 1024

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020K40K60K80K100KSE +/- 72.44, N = 3114820.886491.768924.154217.355187.655093.565255.665146.2

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cache12400Core i5 1240013400Core i5 1340050100150200250185.39180.38212.37209.34MIN: 6.57 / MAX: 6666.67MIN: 6.59 / MAX: 6666.67MIN: 9.19 / MAX: 7500MIN: 9.46 / MAX: 7500

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Run12400Core i5 1240013400Core i5 1340050100150200250194.52200.59228.27222.15MIN: 6.8 / MAX: 7500MIN: 6.72 / MAX: 7500MIN: 9.34 / MAX: 8571.43MIN: 9.54 / MAX: 7500

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Run12400Core i5 1240013400Core i5 1340050100150200250196.91202.90225.55224.48MIN: 6.79 / MAX: 7500MIN: 6.79 / MAX: 8571.43MIN: 9.32 / MAX: 7500MIN: 9.15 / MAX: 7500

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.000973, N = 37.7808745.2127994.1679812.9641162.5900082.5895813.7119773.6753621. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.94251.8852.82753.774.7125SE +/- 0.001647, N = 34.1886773.7110853.0031912.1616871.8162991.8114172.5455322.5248471. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.5451.091.6352.182.725SE +/- 0.000398, N = 32.1894492.4220281.9580331.4321061.1681831.1786181.6426011.6202421. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 44100 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 44100 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.002717, N = 38.4110545.3711734.3093783.0386442.7280482.7216803.9834383.9734041. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 512

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 512Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.001049, N = 37.5203495.0270594.0510682.9014532.5118932.5034363.5796663.5639791. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 96000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 96000 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001.32462.64923.97385.29846.623SE +/- 0.000675, N = 35.8870843.9013513.1114222.2295541.9426771.9454862.8216042.8142641. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.85691.71382.57073.42764.2845SE +/- 0.000775, N = 33.8086422.5987022.0792771.4897601.2826591.2846951.8585521.8500661. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Stargate Digital Audio Workstation

Sample Rate: 480000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 480000 - Buffer Size: 1024Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400246810SE +/- 0.003281, N = 37.5909265.2683664.1998502.9703822.6417622.6503673.8689273.8586501. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

nginx

Connections: 20

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 20Ryzen 7 7700Ryzen 5 760020K40K60K80K100K88942.4368924.191. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 100Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760040K80K120K160K200K197728.82131511.71101913.0481219.421. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 200

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 200Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760040K80K120K160K200K194668.20129714.8799945.5179667.081. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760040K80K120K160K200K177431.30124644.2794196.1574959.981. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030K60K90K120K150K149355.73116337.6889489.3371972.121. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

nginx

Connections: 4000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 4000Ryzen 7 7700Ryzen 5 760020K40K60K80K100K87991.4171632.481. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004K8K12K16K20KSE +/- 53.42, N = 31980019496194071887415907158851645916632

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400400800120016002000SE +/- 2.60, N = 31806139310598481535155710401034

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance MetricRyzen 5 7600Core i5 124001240013400Core i5 1340040K80K120K160K200K1736891495981495512050782047331. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.90661.81322.71983.62644.5331.734912.463883.256394.02950MIN: 1.55MIN: 2.23MIN: 2.9MIN: 3.771. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76001.00152.0033.00454.0065.00753.213193.176004.327004.45130MIN: 3.17MIN: 3.12MIN: 4.15MIN: 4.361. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.16920.33840.50760.67680.8460.4683510.5837750.6001970.751812MIN: 0.38MIN: 0.54MIN: 0.55MIN: 0.731. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.22410.44820.67230.89641.12050.3709000.3617760.9514690.996005MIN: 0.32MIN: 0.34MIN: 0.85MIN: 0.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.35550.7111.06651.4221.77750.6775581.1270701.2693401.580040MIN: 0.6MIN: 1.04MIN: 1.15MIN: 1.51. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.58471.16941.75412.33882.92351.541881.528282.499822.59867MIN: 1.45MIN: 1.45MIN: 2.28MIN: 2.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76002468105.599195.698087.651347.37772MIN: 5.53MIN: 5.61MIN: 7.22MIN: 7.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76001.21782.43563.65344.87126.0893.140413.461524.391065.41252MIN: 2.52MIN: 3.03MIN: 3.82MIN: 5.221. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76001.20452.4093.61354.8186.02252.344603.391073.940375.35314MIN: 2.29MIN: 3.3MIN: 3.73MIN: 5.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76002468105.193245.209567.325017.07299MIN: 5.14MIN: 5.13MIN: 6.99MIN: 71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.23370.46740.70110.93481.16850.4198330.6174400.8107271.038680MIN: 0.4MIN: 0.56MIN: 0.74MIN: 11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.30360.60720.91081.21441.5180.5821880.8632191.0011901.349540MIN: 0.57MIN: 0.82MIN: 0.9MIN: 1.291. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060012001800240030001132.891659.312292.792897.04MIN: 1126.66MIN: 1653.28MIN: 2263.98MIN: 2894.581. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030060090012001500576.37844.741153.921451.11MIN: 571.99MIN: 841.12MIN: 1131.1MIN: 1446.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060012001800240030001141.291657.572284.922894.80MIN: 1136.34MIN: 1652.65MIN: 2256.32MIN: 2890.451. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.75571.51142.26713.02283.77851.757491.844063.358703.25199MIN: 1.68MIN: 1.78MIN: 3.09MIN: 3.191. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760036912153.630505.575457.643699.37593MIN: 3.49MIN: 5.15MIN: 7.01MIN: 8.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.74161.48322.22482.96643.7081.408042.131392.523063.29607MIN: 1.36MIN: 2.04MIN: 2.34MIN: 3.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030060090012001500577.90843.761153.651452.02MIN: 572.8MIN: 839.84MIN: 1128.34MIN: 1449.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.36930.73861.10791.47721.84650.4339810.6567811.5340601.641330MIN: 0.42MIN: 0.61MIN: 1.41MIN: 1.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060012001800240030001138.441654.842286.062899.28MIN: 1134.81MIN: 1650.57MIN: 2264.7MIN: 2894.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760030060090012001500584.27845.731151.661444.74MIN: 578.68MIN: 841.79MIN: 1129.92MIN: 1431.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.07070.14140.21210.28280.35350.1299450.1862800.2514550.314292MIN: 0.12MIN: 0.17MIN: 0.22MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 76000.12330.24660.36990.49320.61650.2093350.3092790.4367350.547845MIN: 0.2MIN: 0.28MIN: 0.39MIN: 0.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134005001000150020002500554.95640.67580.85747.162098.292094.061583.071584.91MIN: 524.6 / MAX: 612.36MIN: 582.42 / MAX: 667.21MIN: 540.23 / MAX: 609.84MIN: 702.8 / MAX: 764.81MIN: 2052.06 / MAX: 2136.02MIN: 2054 / MAX: 2144.08MIN: 1477.42 / MAX: 1887.76MIN: 1427.31 / MAX: 1889.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340060012001800240030001045.761140.441026.041299.353016.233012.862328.102334.05MIN: 892.85 / MAX: 1274.02MIN: 761.08 / MAX: 1262.9MIN: 926.38 / MAX: 1134.19MIN: 1211.98 / MAX: 1428.07MIN: 2973.48 / MAX: 3071.33MIN: 2985.99 / MAX: 3074.98MIN: 2104.47 / MAX: 2986.35MIN: 2135.53 / MAX: 3065.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340060012001800240030001048.951137.541013.261319.703026.393010.562330.872341.39MIN: 661.91 / MAX: 1252.57MIN: 906.91 / MAX: 1301.86MIN: 678.12 / MAX: 1133.16MIN: 748.58 / MAX: 1432.8MIN: 2963.75 / MAX: 3245.44MIN: 2966.05 / MAX: 3058.2MIN: 2130.11 / MAX: 3008.71MIN: 2163.53 / MAX: 3007.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340051015202510.498.778.1110.8019.4519.4316.0016.04MIN: 4.87 / MAX: 19.49MIN: 7.17 / MAX: 17.28MIN: 4.87 / MAX: 21.23MIN: 5.27 / MAX: 12.56MIN: 18.39 / MAX: 25.47MIN: 18.46 / MAX: 26.18MIN: 14.09 / MAX: 25.84MIN: 13.66 / MAX: 25.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400110220330440550282.77327.19293.72386.14503.59503.11429.89432.13MIN: 272.65 / MAX: 321.95MIN: 305.59 / MAX: 336.37MIN: 175.59 / MAX: 313.02MIN: 369.36 / MAX: 391.28MIN: 492.41 / MAX: 512.07MIN: 498.88 / MAX: 511.99MIN: 339.29 / MAX: 913.71MIN: 360.39 / MAX: 940.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340036912154.315.084.555.8410.2510.258.688.72MIN: 2.7 / MAX: 13.22MIN: 3.14 / MAX: 13.29MIN: 3.21 / MAX: 16.73MIN: 3.64 / MAX: 14.42MIN: 10.08 / MAX: 16.3MIN: 10.11 / MAX: 17.66MIN: 7.54 / MAX: 17.41MIN: 7.54 / MAX: 22.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340012243648605.526.445.827.5728.9128.7055.1055.61MIN: 2.89 / MAX: 13.87MIN: 3.32 / MAX: 13.96MIN: 3.04 / MAX: 18.04MIN: 6.66 / MAX: 10.78MIN: 28.13 / MAX: 34.69MIN: 28.15 / MAX: 35.06MIN: 43.43 / MAX: 57.02MIN: 41.77 / MAX: 68.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340030609012015059.5160.2849.2466.42156.75156.31124.62124.93MIN: 30.43 / MAX: 93.61MIN: 49.85 / MAX: 73.62MIN: 28.96 / MAX: 62.2MIN: 32.92 / MAX: 70.79MIN: 149.92 / MAX: 175.47MIN: 149.83 / MAX: 167MIN: 111.98 / MAX: 178.7MIN: 111.3 / MAX: 183.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400481216205.516.455.855.697.607.5814.5314.34MIN: 3.02 / MAX: 13.92MIN: 3.63 / MAX: 14.04MIN: 3.19 / MAX: 18.82MIN: 3.01 / MAX: 14.04MIN: 7.46 / MAX: 12.65MIN: 7.47 / MAX: 33.92MIN: 8.16 / MAX: 18.15MIN: 11.11 / MAX: 15.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340036912154.695.354.905.7012.5512.6510.6010.62MIN: 3.81 / MAX: 10.73MIN: 3.97 / MAX: 8.07MIN: 3.95 / MAX: 17.52MIN: 4.69 / MAX: 7.25MIN: 12.23 / MAX: 20.14MIN: 12.01 / MAX: 18.99MIN: 9.52 / MAX: 16.08MIN: 9.14 / MAX: 16.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.37350.7471.12051.4941.86750.350.430.370.360.940.941.661.65MIN: 0.22 / MAX: 8.03MIN: 0.25 / MAX: 8.27MIN: 0.23 / MAX: 12.52MIN: 0.22 / MAX: 2.91MIN: 0.9 / MAX: 6.47MIN: 0.91 / MAX: 6.48MIN: 0.97 / MAX: 2.79MIN: 1.27 / MAX: 2.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPURyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134000.33980.67961.01941.35921.6990.610.710.640.630.860.861.511.51MIN: 0.35 / MAX: 8.79MIN: 0.38 / MAX: 8.93MIN: 0.36 / MAX: 12.08MIN: 0.35 / MAX: 8.21MIN: 0.84 / MAX: 6.54MIN: 0.83 / MAX: 6.58MIN: 1.14 / MAX: 2.14MIN: 1.11 / MAX: 1.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400170340510680850SE +/- 2.15, N = 3635.51693.07652.21631.60497.15498.31764.80765.83

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340050100150200250SE +/- 0.02, N = 385.94124.27164.10211.96172.73174.38161.46161.69

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.65, N = 381.7772.9369.7561.70111.75112.13173.50173.13

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.11, N = 315.4418.1817.0621.9042.3642.8244.0443.96

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.50, N = 369.4468.9464.8260.8377.4276.37118.51116.53

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400714212835SE +/- 0.05, N = 312.7915.3718.3023.2828.7628.7628.5228.53

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001326395265SE +/- 0.22, N = 327.0929.2527.4326.3938.0838.1757.8057.51

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340048121620SE +/- 0.0097, N = 34.91237.50168.083411.733214.721914.681614.597714.6053

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.08, N = 343.8546.6543.5842.0060.3061.4491.4891.50

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400510152025SE +/- 0.0418, N = 38.836910.725912.475515.675322.153822.823321.416021.1371

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.37, N = 384.2494.8287.4984.45119.73121.51184.54185.09

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.05, N = 316.6421.0925.0031.0743.8445.6043.0643.15

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400170340510680850SE +/- 1.42, N = 3633.82691.47652.43631.91497.20501.94765.90761.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340050100150200250SE +/- 0.25, N = 385.96124.26164.13211.72173.08175.06161.39161.73

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760081624324022.5726.4231.6035.671. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 760060120180240300162.83175.07254.93275.461. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper BeamRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340050100150200250SE +/- 2.21, N = 388.10104.28127.32140.23178.37178.13242.52239.47

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Cell Phone Drop TestRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 1.12, N = 354.9869.1985.14104.87112.09111.92165.13164.84

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340080160240320400SE +/- 1.87, N = 3165.90201.84260.88316.73333.39333.43387.78388.70

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal InstallationRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340060120180240300SE +/- 0.41, N = 363.1884.43127.81154.84195.38195.67292.59291.76

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: INIVOL and Fluid Structure Interaction Drop ContainerRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134002004006008001000SE +/- 3.17, N = 3286.19351.06504.92576.50644.83644.80796.75785.44

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134004080120160200SE +/- 0.36, N = 372.1093.72117.11142.82180.90180.65140.72140.471. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340020406080100SE +/- 0.04, N = 337.7346.2956.2967.8682.8382.4265.7265.431. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6Ryzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.012, N = 33.2164.1425.4526.6949.1279.0506.9707.0111. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6, LosslessRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134003691215SE +/- 0.021, N = 35.5336.7328.1949.96713.16613.10110.12010.0781. (CXX) g++ options: -O3 -fPIC -lm

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 10, LosslessRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001.31422.62843.94265.25686.571SE +/- 0.021, N = 33.3973.5763.9394.3765.8415.7474.9064.9831. (CXX) g++ options: -O3 -fPIC -lm

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.34, N = 343.4158.3078.9696.35122.04121.3695.9396.78

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340030060090012001500SE +/- 0.19, N = 3516.26731.361022.511287.721597.051592.631243.641245.07

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 1BRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 134001020304050SE +/- 0.13, N = 319.6523.0528.0133.1842.6642.7743.3743.61

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.7.10.9513Pi Digits To Calculate: 500MRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400510152025SE +/- 0.057, N = 39.10110.77412.70915.07519.59319.64520.45520.429

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400306090120150SE +/- 0.02, N = 349.5476.34103.86134.76154.16154.30119.20119.15

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400100200300400500SE +/- 0.14, N = 3130.33200.26273.02357.43445.12444.90348.77348.54

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340050100150200250SE +/- 0.17, N = 364.4098.99134.71173.74217.84216.93171.62171.28

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400400800120016002000470.30713.99987.281287.741728.201726.291359.501365.21

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-OnlyRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 13400120240360480600159.21245.37334.87433.05536.66535.47418.18419.60

EnCodec

Target Bandwidth: 3 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 3 kbpsRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340071421283526.0725.4726.9228.4127.0826.1430.3130.43

EnCodec

Target Bandwidth: 6 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 6 kbpsRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340071421283526.3525.3727.0028.3527.2026.2131.0430.82

EnCodec

Target Bandwidth: 24 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 24 kbpsRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340081624324030.4529.1331.2232.9531.1829.9034.6935.28

EnCodec

Target Bandwidth: 1.5 kbps

OpenBenchmarking.orgSeconds, Fewer Is BetterEnCodec 0.1.1Target Bandwidth: 1.5 kbpsRyzen 9 7950XRyzen 9 7900Ryzen 7 7700Ryzen 5 7600Core i5 124001240013400Core i5 1340071421283525.2224.3025.5427.0926.0525.0129.1329.32

Phoronix Test Suite v10.8.5