extra cpu tests ARMv8 Neoverse-N1 testing with a GIGABYTE MP32-AR2-00 v01000100 (F31h SCP: 2.10.20220531 BIOS) and ASPEED 15GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2209073-NE-2209065NE39&grt&sro .
extra cpu tests Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution Display Driver OpenCL Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X AMD 5950X gzcm001cpu AMD Ryzen 7 5700G @ 4.67GHz (8 Cores / 16 Threads) ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS) AMD Renoir/Cezanne 32GB 2000GB Samsung SSD 980 PRO 2TB + 2000GB AMD Radeon RX 6800 XT 16GB (2575/1000MHz) AMD Navi 21 HDMI Audio ASUS MG28U Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 22.04 6.0.0-060000rc1daily20220820-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48) 1.3.224 GCC 12.0.1 20220319 ext4 3840x2160 AMD Ryzen 7 5800X 8-Core @ 3.80GHz (8 Cores / 16 Threads) AMD Starship/Matisse AMD Ryzen 9 3900X 12-Core @ 3.80GHz (12 Cores / 24 Threads) AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads) AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores) GIGABYTE MP32-AR2-00 v01000100 (F31h SCP: 2.10.20220531 BIOS) Ampere Computing LLC Device e100 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x 960GB SAMSUNG MZ1L2960HCJR-00A07 + 4 x 960GB MZILT960HBHQ/007 ASPEED 15GB Q2790 2 x Intel I350 Ubuntu 20.04 5.4.0-125-generic (aarch64) NVIDIA OpenCL 3.0 CUDA 11.7.89 1.3.205 GCC 9.4.0 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - Ryzen 7 5700G, Ryzen 7 5800X, Ryzen 9 3900X, Ryzen 9 3950X, Ryzen 9 5950X, AMD 5950X: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" Compiler Details - Ryzen 7 5700G: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 7 5800X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 3900X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 3950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 5950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - AMD 5950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - gzcm001cpu: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details - Ryzen 7 5700G: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa50000c - Ryzen 7 5800X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - Ryzen 9 3900X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x8701021 - Ryzen 9 3950X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x8701021 - Ryzen 9 5950X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - AMD 5950X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - gzcm001cpu: Scaling Governor: cppc_cpufreq ondemand Python Details - Ryzen 7 5700G: Python 3.10.4 - Ryzen 7 5800X: Python 3.10.4 - Ryzen 9 3900X: Python 3.10.4 - Ryzen 9 3950X: Python 3.10.4 - Ryzen 9 5950X: Python 3.10.4 - AMD 5950X: Python 3.10.4 - gzcm001cpu: Python 3.8.10 Security Details - Ryzen 7 5700G: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 7 5800X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 3900X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 3950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 5950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - AMD 5950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - gzcm001cpu: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected
extra cpu tests compress-7zip: Compression Rating compress-7zip: Decompression Rating couchdb: 100 - 1000 - 30 brl-cad: VGR Performance Metric rocksdb: Rand Read rocksdb: Read While Writing rocksdb: Read Rand Write Rand rocksdb: Update Rand mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 natron: Spaceship openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU build-php: Time To Compile Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X AMD 5950X gzcm001cpu 70302 72228 8.826 1.130 2.532 23.264 4.760 2.439 2.347 29.664 2.9 2.00 1992.30 5.47 730.58 6674.80 1.19 12657.33 0.62 1.43 2775.38 1.43 2765.95 536.55 14.90 229.37 17.42 306.65 13.03 138.98 28.75 307.90 12.97 23.11 172.93 70.357 79090 77462 6.626 0.883 2.031 18.118 3.865 1.724 1.595 22.553 3.4 2.38 1668.03 6.08 657.33 9100.45 0.88 14815.54 0.54 1.80 2206.44 1.78 2228.90 590.52 13.54 279.63 14.29 412.78 9.68 196.76 20.32 420.26 9.51 28.67 139.43 57.418 86775 85973 15.842 2.375 4.606 35.904 6.985 4.826 5.801 33.278 1.8 2.95 2017.29 4.25 1406.22 10039.39 1.19 12874.87 0.93 2.07 2872.19 2.05 2887.44 421.77 28.44 321.06 18.67 355.68 16.86 175.55 34.15 363.51 16.49 29.73 201.66 57.476 91757 122633 84.603 249203 75585720 3293680 2269855 618421 15.03 2.246 4.343 31.532 6.997 5 3.237 34.483 3.1 3.35 2346.05 5.84 1362.52 12887.19 1.23 17110.58 0.93 2.35 3345.24 2.37 3335.63 582.29 27.47 390.89 20.45 494.84 16.16 206.46 38.71 543.33 14.7 37.57 212.69 52.154 94478 142257 266752 10.933 1.982 2.915 21.829 5.089 3.129 2.472 25.787 3.7 3.73 2126.71 9.72 819.44 13205.42 1.21 24162.82 0.66 2.49 3177.96 2.45 3230.15 954.66 16.75 439.51 18.19 677.86 11.79 236.05 33.85 619.79 12.89 38.8 206.08 44.864 94252 141750 69.372 264948 103048882 4033021 2764908 764612 11.693 1.925 3.226 22.352 5.259 3.431 2.502 26.01 3.8 3.69 2145.24 9.74 820.04 13202.07 1.21 24180.33 0.66 2.48 3177.65 2.41 3267.99 957.1 16.71 439.51 18.19 676.45 11.82 235.54 33.92 617.73 12.94 36.13 221.12 45.039 318687 532837 213.472 464637145 7919672 457226 231659 9.421 1.498 2.280 18.331 4.992 2.930 1.717 23.518 139.948 OpenBenchmarking.org
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 70K 140K 210K 280K 350K SE +/- 72.13, N = 3 SE +/- 72.51, N = 3 SE +/- 164.88, N = 3 SE +/- 2389.02, N = 3 94252 70302 79090 86775 91757 94478 318687 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 110K 220K 330K 440K 550K SE +/- 179.27, N = 3 SE +/- 194.98, N = 3 SE +/- 341.93, N = 3 SE +/- 702.08, N = 3 141750 72228 77462 85973 122633 142257 532837 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS Per Watt, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 300 600 900 1200 1500 1118.13 1355.40 854.52 818.80 1111.34 1136.91
7-Zip Compression CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 126.8 145.6 Ryzen 7 5700G 1.2 53.3 69.8 Ryzen 7 5800X 23.8 90.7 113.5 Ryzen 9 3900X 19.8 105.0 130.3 Ryzen 9 3950X 16.6 110.3 145.6 Ryzen 9 5950X 30.0 125.1 145.6 OpenBenchmarking.org Watts, Fewer Is Better 7-Zip Compression 22.01 CPU Power Consumption Monitor 40 80 120 160 200
Apache CouchDB Bulk Size: 100 - Inserts: 1000 - Rounds: 30 OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.2.2 Bulk Size: 100 - Inserts: 1000 - Rounds: 30 AMD 5950X Ryzen 9 3950X gzcm001cpu 50 100 150 200 250 SE +/- 0.72, N = 3 69.37 84.60 213.47 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 112.0 130.4 Ryzen 9 3950X 16.0 74.1 85.8 OpenBenchmarking.org Watts, Fewer Is Better Apache CouchDB 3.2.2 CPU Power Consumption Monitor 40 80 120 160 200
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.32.6 VGR Performance Metric AMD 5950X Ryzen 9 3950X Ryzen 9 5950X 60K 120K 180K 240K 300K 264948 249203 266752 1. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -ldl -lm
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric Per Watt, More Is Better BRL-CAD 7.32.6 VGR Performance Metric AMD 5950X Ryzen 9 3950X Ryzen 9 5950X 400 800 1200 1600 2000 1981.96 1751.27 2000.65
BRL-CAD CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.1 133.7 139.3 Ryzen 9 3950X 16.6 142.3 146.8 Ryzen 9 5950X 30.2 133.3 140.2 OpenBenchmarking.org Watts, Fewer Is Better BRL-CAD 7.32.6 CPU Power Consumption Monitor 40 80 120 160 200
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X 30 60 90 120 150 Min: 26.67 / Avg: 113.2 / Max: 146.12 Min: 0.19 / Avg: 46.1 / Max: 82.67 Min: 5.58 / Avg: 115.26 / Max: 146.87 Min: 19.42 / Avg: 117.82 / Max: 146.8 Min: 15.22 / Avg: 107.77 / Max: 146.79
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Random Read AMD 5950X Ryzen 9 3950X gzcm001cpu 100M 200M 300M 400M 500M SE +/- 3869856.69, N = 3 103048882 75585720 464637145 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Random Read AMD 5950X Ryzen 9 3950X 200K 400K 600K 800K 1000K 808898.63 553062.24
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 29.9 127.4 134.8 Ryzen 9 3950X 16.4 136.7 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Read While Writing AMD 5950X Ryzen 9 3950X gzcm001cpu 2M 4M 6M 8M 10M SE +/- 58777.69, N = 3 4033021 3293680 7919672 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Read While Writing OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Read While Writing AMD 5950X Ryzen 9 3950X 6K 12K 18K 24K 30K 29449.46 24269.49
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 136.9 145.6 Ryzen 9 3950X 16.4 135.7 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Read Random Write Random AMD 5950X Ryzen 9 3950X gzcm001cpu 600K 1200K 1800K 2400K 3000K SE +/- 1598.84, N = 3 2764908 2269855 457226 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Read Random Write Random AMD 5950X Ryzen 9 3950X 4K 8K 12K 16K 20K 20226.72 16594.26
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 29.9 136.7 145.7 Ryzen 9 3950X 16.2 136.8 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Update Random AMD 5950X Ryzen 9 3950X gzcm001cpu 160K 320K 480K 640K 800K SE +/- 3114.60, N = 3 764612 618421 231659 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Update Random OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Update Random AMD 5950X Ryzen 9 3950X 1200 2400 3600 4800 6000 5550.25 4554.49
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 137.8 145.6 Ryzen 9 3950X 16.5 135.8 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Meta Performance Per Watts Performance Per Watts OpenBenchmarking.org Performance Per Watts, More Is Better Meta Performance Per Watts Performance Per Watts AMD 5950X Ryzen 9 3950X 60K 120K 180K 240K 300K 277082.43 229081.17
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 4 8 12 16 20 SE +/- 0.109, N = 3 SE +/- 0.048, N = 3 SE +/- 0.161, N = 6 SE +/- 0.016, N = 3 11.693 8.826 6.626 15.842 15.030 10.933 9.421 -march=native - MIN: 11.35 / MAX: 20.19 -march=native - MIN: 8.52 / MAX: 21.27 -march=native - MIN: 6.48 / MAX: 7.43 -march=native - MIN: 13.21 / MAX: 143.35 -march=native - MIN: 14.83 / MAX: 22.29 -march=native - MIN: 10.69 / MAX: 11.64 MIN: 9.35 / MAX: 14.82 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 0.5344 1.0688 1.6032 2.1376 2.672 SE +/- 0.009, N = 3 SE +/- 0.008, N = 3 SE +/- 0.015, N = 6 SE +/- 0.000, N = 3 1.925 1.130 0.883 2.375 2.246 1.982 1.498 -march=native - MIN: 1.81 / MAX: 2.33 -march=native - MIN: 1.09 / MAX: 10.93 -march=native - MIN: 0.86 / MAX: 4.6 -march=native - MIN: 2.06 / MAX: 89.53 -march=native - MIN: 2.21 / MAX: 3.08 -march=native - MIN: 1.7 / MAX: 28.92 MIN: 1.48 / MAX: 1.67 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 1.0364 2.0728 3.1092 4.1456 5.182 SE +/- 0.022, N = 3 SE +/- 0.016, N = 3 SE +/- 0.068, N = 6 SE +/- 0.002, N = 3 3.226 2.532 2.031 4.606 4.343 2.915 2.280 -march=native - MIN: 3.16 / MAX: 3.37 -march=native - MIN: 2.41 / MAX: 13.37 -march=native - MIN: 1.98 / MAX: 2.5 -march=native - MIN: 3.85 / MAX: 74.81 -march=native - MIN: 4.25 / MAX: 12.46 -march=native - MIN: 2.87 / MAX: 3.97 MIN: 2.25 / MAX: 2.6 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 8 16 24 32 40 SE +/- 0.18, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 6 SE +/- 0.01, N = 3 22.35 23.26 18.12 35.90 31.53 21.83 18.33 -march=native - MIN: 21.91 / MAX: 28.8 -march=native - MIN: 22.08 / MAX: 79.53 -march=native - MIN: 17.75 / MAX: 27.22 -march=native - MIN: 30.4 / MAX: 162.87 -march=native - MIN: 29.78 / MAX: 38.82 -march=native - MIN: 21.52 / MAX: 28.17 MIN: 18.19 / MAX: 18.8 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 2 4 6 8 10 SE +/- 0.059, N = 3 SE +/- 0.004, N = 3 SE +/- 0.059, N = 6 SE +/- 0.066, N = 3 5.259 4.760 3.865 6.985 6.997 5.089 4.992 -march=native - MIN: 5.19 / MAX: 5.95 -march=native - MIN: 4.54 / MAX: 16.4 -march=native - MIN: 3.81 / MAX: 4.63 -march=native - MIN: 5.86 / MAX: 101.13 -march=native - MIN: 6.81 / MAX: 7.6 -march=native - MIN: 5.02 / MAX: 13.04 MIN: 4.89 / MAX: 5.41 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 1.125 2.25 3.375 4.5 5.625 SE +/- 0.041, N = 3 SE +/- 0.018, N = 3 SE +/- 0.055, N = 6 SE +/- 0.002, N = 3 3.431 2.439 1.724 4.826 5.000 3.129 2.930 -march=native - MIN: 3.36 / MAX: 4.29 -march=native - MIN: 2.31 / MAX: 14.01 -march=native - MIN: 1.67 / MAX: 2.22 -march=native - MIN: 4.15 / MAX: 118.91 -march=native - MIN: 4.84 / MAX: 5.79 -march=native - MIN: 3.1 / MAX: 3.85 MIN: 2.88 / MAX: 3.19 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 1.3052 2.6104 3.9156 5.2208 6.526 SE +/- 0.015, N = 3 SE +/- 0.007, N = 3 SE +/- 0.039, N = 6 SE +/- 0.004, N = 3 2.502 2.347 1.595 5.801 3.237 2.472 1.717 -march=native - MIN: 2.47 / MAX: 3.22 -march=native - MIN: 2.22 / MAX: 13.86 -march=native - MIN: 1.57 / MAX: 2.03 -march=native - MIN: 4.6 / MAX: 116.95 -march=native - MIN: 3.16 / MAX: 4.09 -march=native - MIN: 2.44 / MAX: 2.6 MIN: 1.69 / MAX: 2.09 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 8 16 24 32 40 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 SE +/- 0.19, N = 6 SE +/- 0.14, N = 3 26.01 29.66 22.55 33.28 34.48 25.79 23.52 -march=native - MIN: 25.72 / MAX: 30.52 -march=native - MIN: 28.81 / MAX: 42.55 -march=native - MIN: 22.23 / MAX: 33.17 -march=native - MIN: 28.54 / MAX: 154.79 -march=native - MIN: 33.34 / MAX: 42.31 -march=native - MIN: 25.32 / MAX: 32.81 MIN: 23.28 / MAX: 33.7 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network CPU Power Consumption Monitor Min Avg Max AMD 5950X 29.8 137.1 144.8 Ryzen 7 5700G 4.9 44.0 63.8 Ryzen 7 5800X 24.2 134.2 146.8 Ryzen 9 3900X 20.1 138.7 146.8 Ryzen 9 3950X 16.6 141.5 145.7 Ryzen 9 5950X 29.8 135.9 143.9 OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor 40 80 120 160 200
Natron Input: Spaceship OpenBenchmarking.org FPS, More Is Better Natron 2.4.3 Input: Spaceship AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.855 1.71 2.565 3.42 4.275 SE +/- 0.02, N = 9 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 3.8 2.9 3.4 1.8 3.1 3.7
Natron Input: Spaceship OpenBenchmarking.org FPS Per Watt, More Is Better Natron 2.4.3 Input: Spaceship AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.0106 0.0212 0.0318 0.0424 0.053 0.031 0.047 0.033 0.017 0.031 0.031
Natron CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.2 121.7 145.7 Ryzen 7 5700G 0.2 61.3 82.7 Ryzen 7 5800X 24.2 101.5 133.8 Ryzen 9 3900X 20.0 106.9 140.6 Ryzen 9 3950X 16.0 101.0 142.2 Ryzen 9 5950X 30.0 121.1 145.7 OpenBenchmarking.org Watts, Fewer Is Better Natron 2.4.3 CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.8393 1.6786 2.5179 3.3572 4.1965 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 3.69 2.00 2.38 2.95 3.35 3.73 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 500 1000 1500 2000 2500 SE +/- 30.80, N = 3 SE +/- 5.03, N = 3 SE +/- 11.74, N = 3 2145.24 1992.30 1668.03 2017.29 2346.05 2126.71 MIN: 1771.66 / MAX: 2371.66 MIN: 1698.95 / MAX: 2200.09 MIN: 1550.58 / MAX: 1755.3 MIN: 1715.21 / MAX: 2220.91 MIN: 1886.54 / MAX: 2632.54 MIN: 1706.2 / MAX: 2453.34 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 132.3 145.1 Ryzen 7 5700G 2.3 40.1 48.5 Ryzen 7 5800X 14.4 118.8 136.9 Ryzen 9 3900X 20.2 116.8 130.3 Ryzen 9 3950X 15.9 100.2 115.3 Ryzen 9 5950X 29.9 131.2 145.1 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 9.74 5.47 6.08 4.25 5.84 9.72 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 300 600 900 1200 1500 SE +/- 0.28, N = 3 SE +/- 0.42, N = 3 SE +/- 1.57, N = 3 820.04 730.58 657.33 1406.22 1362.52 819.44 MIN: 793.27 / MAX: 831.81 MIN: 492.86 / MAX: 776.15 MIN: 638.88 / MAX: 664.91 MIN: 1307.87 / MAX: 1498.4 MIN: 1339.1 / MAX: 1376.54 MIN: 733.89 / MAX: 843.65 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 122.6 132.2 Ryzen 7 5700G 1.7 70.6 77.4 Ryzen 7 5800X 15.9 136.8 146.8 Ryzen 9 3900X 20.0 121.3 132.4 Ryzen 9 3950X 16.2 134.2 145.7 Ryzen 9 5950X 30.4 122.9 131.3 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 3K 6K 9K 12K 15K SE +/- 21.83, N = 3 SE +/- 29.14, N = 3 SE +/- 27.98, N = 3 13202.07 6674.80 9100.45 10039.39 12887.19 13205.42 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.2768 0.5536 0.8304 1.1072 1.384 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.21 1.19 0.88 1.19 1.23 1.21 MIN: 0.76 / MAX: 10.99 MIN: 0.71 / MAX: 15.27 MIN: 0.58 / MAX: 10.45 MIN: 0.66 / MAX: 40 MIN: 0.74 / MAX: 11.28 MIN: 0.8 / MAX: 11.78 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 28.9 123.7 132.4 Ryzen 7 5700G 3.4 39.8 53.3 Ryzen 7 5800X 5.6 137.1 145.6 Ryzen 9 3900X 20.8 137.5 146.8 Ryzen 9 3950X 16.2 115.5 124.2 Ryzen 9 5950X 30.1 123.4 131.4 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 5K 10K 15K 20K 25K SE +/- 72.04, N = 3 SE +/- 15.98, N = 3 SE +/- 40.08, N = 3 24180.33 12657.33 14815.54 12874.87 17110.58 24162.82 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.2093 0.4186 0.6279 0.8372 1.0465 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.66 0.62 0.54 0.93 0.93 0.66 MIN: 0.39 / MAX: 9.09 MIN: 0.39 / MAX: 12.23 MIN: 0.33 / MAX: 10.16 MIN: 0.54 / MAX: 34.61 MIN: 0.56 / MAX: 9.29 MIN: 0.4 / MAX: 9.7 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.0 125.2 135.1 Ryzen 7 5700G 1.9 57.2 66.4 Ryzen 7 5800X 14.5 135.2 146.0 Ryzen 9 3900X 20.1 133.0 145.2 Ryzen 9 3950X 16.5 135.8 145.7 Ryzen 9 5950X 29.7 126.0 133.8 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.5603 1.1206 1.6809 2.2412 2.8015 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.48 1.43 1.80 2.07 2.35 2.49 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 700 1400 2100 2800 3500 SE +/- 6.13, N = 3 SE +/- 5.93, N = 3 SE +/- 4.91, N = 3 3177.65 2775.38 2206.44 2872.19 3345.24 3177.96 MIN: 2198.09 / MAX: 3770.21 MIN: 1785.91 / MAX: 3104.21 MIN: 1950 / MAX: 2464.9 MIN: 2247.77 / MAX: 3169.97 MIN: 2326.56 / MAX: 3765.68 MIN: 2488.17 / MAX: 3743.21 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.3 131.7 144.4 Ryzen 7 5700G 3.1 44.2 51.7 Ryzen 7 5800X 6.5 127.5 144.1 Ryzen 9 3900X 19.4 123.7 138.4 Ryzen 9 3950X 16.4 106.9 122.2 Ryzen 9 5950X 29.9 131.1 143.3 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 0.5513 1.1026 1.6539 2.2052 2.7565 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.41 1.43 1.78 2.05 2.37 2.45 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 700 1400 2100 2800 3500 SE +/- 14.80, N = 3 SE +/- 4.19, N = 3 SE +/- 21.39, N = 3 3267.99 2765.95 2228.90 2887.44 3335.63 3230.15 MIN: 2219.86 / MAX: 3776.07 MIN: 1842.04 / MAX: 3083.75 MIN: 1559.98 / MAX: 2479.16 MIN: 1479.87 / MAX: 3243.66 MIN: 2730.21 / MAX: 3819.11 MIN: 1558.47 / MAX: 3791.92 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.2 131.0 144.2 Ryzen 7 5700G 3.8 46.4 53.8 Ryzen 7 5800X 7.9 126.9 142.7 Ryzen 9 3900X 19.8 127.9 142.1 Ryzen 9 3950X 16.7 109.7 124.7 Ryzen 9 5950X 30.0 130.9 142.9 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 200 400 600 800 1000 SE +/- 0.36, N = 3 SE +/- 0.42, N = 3 SE +/- 0.21, N = 3 957.10 536.55 590.52 421.77 582.29 954.66 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 16.71 14.90 13.54 28.44 27.47 16.75 MIN: 8.06 / MAX: 24.96 MIN: 7.33 / MAX: 25.89 MIN: 7.08 / MAX: 22.51 MIN: 14.9 / MAX: 78.52 MIN: 18.76 / MAX: 35.74 MIN: 11.09 / MAX: 21.33 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.2 123.1 131.7 Ryzen 7 5700G 4.5 70.5 76.4 Ryzen 7 5800X 24.3 137.3 146.8 Ryzen 9 3900X 20.2 123.2 131.9 Ryzen 9 3950X 16.8 135.6 146.8 Ryzen 9 5950X 30.3 123.2 132.2 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 100 200 300 400 500 SE +/- 0.03, N = 3 SE +/- 0.44, N = 3 SE +/- 0.67, N = 3 439.51 229.37 279.63 321.06 390.89 439.51 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 18.19 17.42 14.29 18.67 20.45 18.19 MIN: 8.69 / MAX: 26.01 MIN: 9.07 / MAX: 30.09 MIN: 7.5 / MAX: 24.54 MIN: 13.72 / MAX: 70.89 MIN: 11.74 / MAX: 39.16 MIN: 9.4 / MAX: 28.56 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.4 126.0 133.4 Ryzen 7 5700G 4.0 46.3 50.1 Ryzen 7 5800X 8.8 134.6 145.6 Ryzen 9 3900X 20.2 123.2 132.2 Ryzen 9 3950X 16.3 105.0 113.4 Ryzen 9 5950X 30.3 126.1 133.6 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 150 300 450 600 750 SE +/- 3.62, N = 3 SE +/- 0.90, N = 3 SE +/- 0.10, N = 3 676.45 306.65 412.78 355.68 494.84 677.86 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 4 8 12 16 20 SE +/- 0.15, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 11.82 13.03 9.68 16.86 16.16 11.79 MIN: 6.54 / MAX: 21.16 MIN: 6.64 / MAX: 25.26 MIN: 5.23 / MAX: 19.09 MIN: 10.76 / MAX: 72.48 MIN: 9.15 / MAX: 68.05 MIN: 7.87 / MAX: 21.31 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.2 125.2 133.5 Ryzen 7 5700G 2.6 59.4 74.5 Ryzen 7 5800X 24.3 137.7 145.7 Ryzen 9 3900X 20.0 131.5 142.5 Ryzen 9 3950X 16.5 137.0 146.8 Ryzen 9 5950X 30.2 124.7 133.2 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 50 100 150 200 250 SE +/- 0.59, N = 3 SE +/- 1.21, N = 3 SE +/- 0.32, N = 3 235.54 138.98 196.76 175.55 206.46 236.05 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 9 18 27 36 45 SE +/- 0.12, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 33.92 28.75 20.32 34.15 38.71 33.85 MIN: 20.26 / MAX: 49.04 MIN: 10.6 / MAX: 50.31 MIN: 12.41 / MAX: 37.85 MIN: 12.29 / MAX: 77.76 MIN: 13.3 / MAX: 56.5 MIN: 24.98 / MAX: 49.81 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.1 124.9 134.7 Ryzen 7 5700G 2.2 34.7 40.3 Ryzen 7 5800X 24.3 120.8 135.6 Ryzen 9 3900X 19.9 116.2 127.2 Ryzen 9 3950X 16.3 87.1 99.0 Ryzen 9 5950X 30.4 124.8 134.8 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 130 260 390 520 650 SE +/- 1.36, N = 3 SE +/- 0.78, N = 3 SE +/- 0.84, N = 3 617.73 307.90 420.26 363.51 543.33 619.79 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 12.94 12.97 9.51 16.49 14.70 12.89 MIN: 10.73 / MAX: 18.83 MIN: 7.48 / MAX: 28.4 MIN: 7.04 / MAX: 20.4 MIN: 8.83 / MAX: 60.21 MIN: 12.18 / MAX: 25.15 MIN: 6.96 / MAX: 19.37 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.1 130.1 138.5 Ryzen 7 5700G 4.4 39.8 47.4 Ryzen 7 5800X 16.2 137.3 146.9 Ryzen 9 3900X 20.7 124.0 135.8 Ryzen 9 3950X 16.5 101.9 109.9 Ryzen 9 5950X 30.2 129.3 138.7 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 9 18 27 36 45 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 36.13 23.11 28.67 29.73 37.57 38.80 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X 50 100 150 200 250 SE +/- 0.84, N = 3 SE +/- 0.34, N = 3 SE +/- 0.54, N = 3 221.12 172.93 139.43 201.66 212.69 206.08 MIN: 158.14 / MAX: 257.35 MIN: 85.04 / MAX: 215.98 MIN: 115.02 / MAX: 161.07 MIN: 112.84 / MAX: 328.9 MIN: 170.16 / MAX: 263.41 MIN: 119.55 / MAX: 247.84 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max AMD 5950X 30.3 127.5 140.4 Ryzen 7 5700G 4.8 40.1 45.3 Ryzen 7 5800X 10.0 127.7 140.2 Ryzen 9 3900X 20.1 116.2 127.2 Ryzen 9 3950X 16.3 97.5 109.2 Ryzen 9 5950X 30.1 130.2 143.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.1.9 Time To Compile AMD 5950X Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X gzcm001cpu 30 60 90 120 150 SE +/- 0.13, N = 3 SE +/- 0.16, N = 3 SE +/- 0.28, N = 3 SE +/- 1.45, N = 3 45.04 70.36 57.42 57.48 52.15 44.86 139.95
Timed PHP Compilation CPU Power Consumption Monitor Min Avg Max AMD 5950X 29.1 96.1 145.7 Ryzen 7 5700G 4.2 46.2 76.1 Ryzen 7 5800X 24.3 86.8 127.7 Ryzen 9 3900X 20.0 91.2 145.6 Ryzen 9 3950X 16.9 76.7 145.6 Ryzen 9 5950X 30.0 95.9 145.6 OpenBenchmarking.org Watts, Fewer Is Better Timed PHP Compilation 8.1.9 CPU Power Consumption Monitor 40 80 120 160 200
Phoronix Test Suite v10.8.4