extra cpu tests ARMv8 Neoverse-N1 testing with a GIGABYTE MP32-AR2-00 v01000100 (F31h SCP: 2.10.20220531 BIOS) and ASPEED 15GB on Ubuntu 20.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2209073-NE-2209065NE39&sor .
extra cpu tests Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution Display Driver OpenCL Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X AMD 5950X gzcm001cpu AMD Ryzen 7 5700G @ 4.67GHz (8 Cores / 16 Threads) ASUS ROG CROSSHAIR VIII HERO (WI-FI) (4006 BIOS) AMD Renoir/Cezanne 32GB 2000GB Samsung SSD 980 PRO 2TB + 2000GB AMD Radeon RX 6800 XT 16GB (2575/1000MHz) AMD Navi 21 HDMI Audio ASUS MG28U Realtek RTL8125 2.5GbE + Intel I211 + Intel Wi-Fi 6 AX200 Ubuntu 22.04 6.0.0-060000rc1daily20220820-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.3.0-devel (git-4685385 2022-08-23 jammy-oibaf-ppa) (LLVM 14.0.6 DRM 3.48) 1.3.224 GCC 12.0.1 20220319 ext4 3840x2160 AMD Ryzen 7 5800X 8-Core @ 3.80GHz (8 Cores / 16 Threads) AMD Starship/Matisse AMD Ryzen 9 3900X 12-Core @ 3.80GHz (12 Cores / 24 Threads) AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores / 32 Threads) AMD Ryzen 9 5950X 16-Core @ 3.40GHz (16 Cores / 32 Threads) ARMv8 Neoverse-N1 @ 3.00GHz (128 Cores) GIGABYTE MP32-AR2-00 v01000100 (F31h SCP: 2.10.20220531 BIOS) Ampere Computing LLC Device e100 8 x 64 GB DDR4-3200MT/s Samsung M393A8G40AB2-CWE 2 x 960GB SAMSUNG MZ1L2960HCJR-00A07 + 4 x 960GB MZILT960HBHQ/007 ASPEED 15GB Q2790 2 x Intel I350 Ubuntu 20.04 5.4.0-125-generic (aarch64) NVIDIA OpenCL 3.0 CUDA 11.7.89 1.3.205 GCC 9.4.0 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Environment Details - Ryzen 7 5700G, Ryzen 7 5800X, Ryzen 9 3900X, Ryzen 9 3950X, Ryzen 9 5950X, AMD 5950X: CXXFLAGS="-O3 -march=native" CFLAGS="-O3 -march=native" Compiler Details - Ryzen 7 5700G: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 7 5800X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 3900X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 3950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Ryzen 9 5950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - AMD 5950X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-OcsLtf/gcc-12-12-20220319/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - gzcm001cpu: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v Processor Details - Ryzen 7 5700G: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa50000c - Ryzen 7 5800X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - Ryzen 9 3900X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x8701021 - Ryzen 9 3950X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0x8701021 - Ryzen 9 5950X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - AMD 5950X: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa201016 - gzcm001cpu: Scaling Governor: cppc_cpufreq ondemand Python Details - Ryzen 7 5700G: Python 3.10.4 - Ryzen 7 5800X: Python 3.10.4 - Ryzen 9 3900X: Python 3.10.4 - Ryzen 9 3950X: Python 3.10.4 - Ryzen 9 5950X: Python 3.10.4 - AMD 5950X: Python 3.10.4 - gzcm001cpu: Python 3.8.10 Security Details - Ryzen 7 5700G: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 7 5800X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 3900X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 3950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - Ryzen 9 5950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - AMD 5950X: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - gzcm001cpu: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected
extra cpu tests build-php: Time To Compile compress-7zip: Compression Rating compress-7zip: Decompression Rating mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 natron: Spaceship openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU brl-cad: VGR Performance Metric couchdb: 100 - 1000 - 30 rocksdb: Rand Read rocksdb: Read While Writing rocksdb: Read Rand Write Rand rocksdb: Update Rand Ryzen 7 5700G Ryzen 7 5800X Ryzen 9 3900X Ryzen 9 3950X Ryzen 9 5950X AMD 5950X gzcm001cpu 70.357 70302 72228 8.826 1.130 2.532 23.264 4.760 2.439 2.347 29.664 2.9 2.00 1992.30 5.47 730.58 6674.80 1.19 12657.33 0.62 1.43 2775.38 1.43 2765.95 536.55 14.90 229.37 17.42 306.65 13.03 138.98 28.75 307.90 12.97 23.11 172.93 57.418 79090 77462 6.626 0.883 2.031 18.118 3.865 1.724 1.595 22.553 3.4 2.38 1668.03 6.08 657.33 9100.45 0.88 14815.54 0.54 1.80 2206.44 1.78 2228.90 590.52 13.54 279.63 14.29 412.78 9.68 196.76 20.32 420.26 9.51 28.67 139.43 57.476 86775 85973 15.842 2.375 4.606 35.904 6.985 4.826 5.801 33.278 1.8 2.95 2017.29 4.25 1406.22 10039.39 1.19 12874.87 0.93 2.07 2872.19 2.05 2887.44 421.77 28.44 321.06 18.67 355.68 16.86 175.55 34.15 363.51 16.49 29.73 201.66 52.154 91757 122633 15.03 2.246 4.343 31.532 6.997 5 3.237 34.483 3.1 3.35 2346.05 5.84 1362.52 12887.19 1.23 17110.58 0.93 2.35 3345.24 2.37 3335.63 582.29 27.47 390.89 20.45 494.84 16.16 206.46 38.71 543.33 14.7 37.57 212.69 249203 84.603 75585720 3293680 2269855 618421 44.864 94478 142257 10.933 1.982 2.915 21.829 5.089 3.129 2.472 25.787 3.7 3.73 2126.71 9.72 819.44 13205.42 1.21 24162.82 0.66 2.49 3177.96 2.45 3230.15 954.66 16.75 439.51 18.19 677.86 11.79 236.05 33.85 619.79 12.89 38.8 206.08 266752 45.039 94252 141750 11.693 1.925 3.226 22.352 5.259 3.431 2.502 26.01 3.8 3.69 2145.24 9.74 820.04 13202.07 1.21 24180.33 0.66 2.48 3177.65 2.41 3267.99 957.1 16.71 439.51 18.19 676.45 11.82 235.54 33.92 617.73 12.94 36.13 221.12 264948 69.372 103048882 4033021 2764908 764612 139.948 318687 532837 9.421 1.498 2.280 18.331 4.992 2.930 1.717 23.518 213.472 464637145 7919672 457226 231659 OpenBenchmarking.org
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.1.9 Time To Compile Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 7 5800X Ryzen 9 3900X Ryzen 7 5700G gzcm001cpu 30 60 90 120 150 SE +/- 0.16, N = 3 SE +/- 0.28, N = 3 SE +/- 0.13, N = 3 SE +/- 1.45, N = 3 44.86 45.04 52.15 57.42 57.48 70.36 139.95
Timed PHP Compilation CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 4.2 46.2 76.1 Ryzen 9 3950X 16.9 76.7 145.6 Ryzen 7 5800X 24.3 86.8 127.7 Ryzen 9 3900X 20.0 91.2 145.6 Ryzen 9 5950X 30.0 95.9 145.6 AMD 5950X 29.1 96.1 145.7 OpenBenchmarking.org Watts, Fewer Is Better Timed PHP Compilation 8.1.9 CPU Power Consumption Monitor 40 80 120 160 200
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 70K 140K 210K 280K 350K SE +/- 2389.02, N = 3 SE +/- 164.88, N = 3 SE +/- 72.51, N = 3 SE +/- 72.13, N = 3 318687 94478 94252 91757 86775 79090 70302 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 110K 220K 330K 440K 550K SE +/- 702.08, N = 3 SE +/- 341.93, N = 3 SE +/- 194.98, N = 3 SE +/- 179.27, N = 3 532837 142257 141750 122633 85973 77462 72228 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS Per Watt, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 7 5800X Ryzen 9 3900X 300 600 900 1200 1500 1355.40 1136.91 1118.13 1111.34 854.52 818.80
7-Zip Compression CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 1.2 53.3 69.8 Ryzen 7 5800X 23.8 90.7 113.5 Ryzen 9 3900X 19.8 105.0 130.3 Ryzen 9 3950X 16.6 110.3 145.6 Ryzen 9 5950X 30.0 125.1 145.6 AMD 5950X 30.0 126.8 145.6 OpenBenchmarking.org Watts, Fewer Is Better 7-Zip Compression 22.01 CPU Power Consumption Monitor 40 80 120 160 200
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet Ryzen 7 5800X Ryzen 7 5700G gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X 4 8 12 16 20 SE +/- 0.048, N = 3 SE +/- 0.109, N = 3 SE +/- 0.016, N = 3 SE +/- 0.161, N = 6 6.626 8.826 9.421 10.933 11.693 15.030 15.842 -march=native - MIN: 6.48 / MAX: 7.43 -march=native - MIN: 8.52 / MAX: 21.27 MIN: 9.35 / MAX: 14.82 -march=native - MIN: 10.69 / MAX: 11.64 -march=native - MIN: 11.35 / MAX: 20.19 -march=native - MIN: 14.83 / MAX: 22.29 -march=native - MIN: 13.21 / MAX: 143.35 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 Ryzen 7 5800X Ryzen 7 5700G gzcm001cpu AMD 5950X Ryzen 9 5950X Ryzen 9 3950X Ryzen 9 3900X 0.5344 1.0688 1.6032 2.1376 2.672 SE +/- 0.008, N = 3 SE +/- 0.009, N = 3 SE +/- 0.000, N = 3 SE +/- 0.015, N = 6 0.883 1.130 1.498 1.925 1.982 2.246 2.375 -march=native - MIN: 0.86 / MAX: 4.6 -march=native - MIN: 1.09 / MAX: 10.93 MIN: 1.48 / MAX: 1.67 -march=native - MIN: 1.81 / MAX: 2.33 -march=native - MIN: 1.7 / MAX: 28.92 -march=native - MIN: 2.21 / MAX: 3.08 -march=native - MIN: 2.06 / MAX: 89.53 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 Ryzen 7 5800X gzcm001cpu Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X 1.0364 2.0728 3.1092 4.1456 5.182 SE +/- 0.016, N = 3 SE +/- 0.002, N = 3 SE +/- 0.022, N = 3 SE +/- 0.068, N = 6 2.031 2.280 2.532 2.915 3.226 4.343 4.606 -march=native - MIN: 1.98 / MAX: 2.5 MIN: 2.25 / MAX: 2.6 -march=native - MIN: 2.41 / MAX: 13.37 -march=native - MIN: 2.87 / MAX: 3.97 -march=native - MIN: 3.16 / MAX: 3.37 -march=native - MIN: 4.25 / MAX: 12.46 -march=native - MIN: 3.85 / MAX: 74.81 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 Ryzen 7 5800X gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 7 5700G Ryzen 9 3950X Ryzen 9 3900X 8 16 24 32 40 SE +/- 0.12, N = 3 SE +/- 0.01, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 6 18.12 18.33 21.83 22.35 23.26 31.53 35.90 -march=native - MIN: 17.75 / MAX: 27.22 MIN: 18.19 / MAX: 18.8 -march=native - MIN: 21.52 / MAX: 28.17 -march=native - MIN: 21.91 / MAX: 28.8 -march=native - MIN: 22.08 / MAX: 79.53 -march=native - MIN: 29.78 / MAX: 38.82 -march=native - MIN: 30.4 / MAX: 162.87 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 Ryzen 7 5800X Ryzen 7 5700G gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 9 3900X Ryzen 9 3950X 2 4 6 8 10 SE +/- 0.004, N = 3 SE +/- 0.059, N = 3 SE +/- 0.066, N = 3 SE +/- 0.059, N = 6 3.865 4.760 4.992 5.089 5.259 6.985 6.997 -march=native - MIN: 3.81 / MAX: 4.63 -march=native - MIN: 4.54 / MAX: 16.4 MIN: 4.89 / MAX: 5.41 -march=native - MIN: 5.02 / MAX: 13.04 -march=native - MIN: 5.19 / MAX: 5.95 -march=native - MIN: 5.86 / MAX: 101.13 -march=native - MIN: 6.81 / MAX: 7.6 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 Ryzen 7 5800X Ryzen 7 5700G gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 9 3900X Ryzen 9 3950X 1.125 2.25 3.375 4.5 5.625 SE +/- 0.018, N = 3 SE +/- 0.041, N = 3 SE +/- 0.002, N = 3 SE +/- 0.055, N = 6 1.724 2.439 2.930 3.129 3.431 4.826 5.000 -march=native - MIN: 1.67 / MAX: 2.22 -march=native - MIN: 2.31 / MAX: 14.01 MIN: 2.88 / MAX: 3.19 -march=native - MIN: 3.1 / MAX: 3.85 -march=native - MIN: 3.36 / MAX: 4.29 -march=native - MIN: 4.15 / MAX: 118.91 -march=native - MIN: 4.84 / MAX: 5.79 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 Ryzen 7 5800X gzcm001cpu Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X 1.3052 2.6104 3.9156 5.2208 6.526 SE +/- 0.007, N = 3 SE +/- 0.004, N = 3 SE +/- 0.015, N = 3 SE +/- 0.039, N = 6 1.595 1.717 2.347 2.472 2.502 3.237 5.801 -march=native - MIN: 1.57 / MAX: 2.03 MIN: 1.69 / MAX: 2.09 -march=native - MIN: 2.22 / MAX: 13.86 -march=native - MIN: 2.44 / MAX: 2.6 -march=native - MIN: 2.47 / MAX: 3.22 -march=native - MIN: 3.16 / MAX: 4.09 -march=native - MIN: 4.6 / MAX: 116.95 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 Ryzen 7 5800X gzcm001cpu Ryzen 9 5950X AMD 5950X Ryzen 7 5700G Ryzen 9 3900X Ryzen 9 3950X 8 16 24 32 40 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.19, N = 6 22.55 23.52 25.79 26.01 29.66 33.28 34.48 -march=native - MIN: 22.23 / MAX: 33.17 MIN: 23.28 / MAX: 33.7 -march=native - MIN: 25.32 / MAX: 32.81 -march=native - MIN: 25.72 / MAX: 30.52 -march=native - MIN: 28.81 / MAX: 42.55 -march=native - MIN: 28.54 / MAX: 154.79 -march=native - MIN: 33.34 / MAX: 42.31 1. (CXX) g++ options: -O3 -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 4.9 44.0 63.8 Ryzen 7 5800X 24.2 134.2 146.8 Ryzen 9 5950X 29.8 135.9 143.9 AMD 5950X 29.8 137.1 144.8 Ryzen 9 3900X 20.1 138.7 146.8 Ryzen 9 3950X 16.6 141.5 145.7 OpenBenchmarking.org Watts, Fewer Is Better Mobile Neural Network 2.1 CPU Power Consumption Monitor 40 80 120 160 200
Natron Input: Spaceship OpenBenchmarking.org FPS, More Is Better Natron 2.4.3 Input: Spaceship AMD 5950X Ryzen 9 5950X Ryzen 7 5800X Ryzen 9 3950X Ryzen 7 5700G Ryzen 9 3900X 0.855 1.71 2.565 3.42 4.275 SE +/- 0.03, N = 3 SE +/- 0.02, N = 9 SE +/- 0.00, N = 3 3.8 3.7 3.4 3.1 2.9 1.8
Natron Input: Spaceship OpenBenchmarking.org FPS Per Watt, More Is Better Natron 2.4.3 Input: Spaceship Ryzen 7 5700G Ryzen 7 5800X AMD 5950X Ryzen 9 5950X Ryzen 9 3950X Ryzen 9 3900X 0.0106 0.0212 0.0318 0.0424 0.053 0.047 0.033 0.031 0.031 0.031 0.017
Natron CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 0.2 61.3 82.7 Ryzen 9 3950X 16.0 101.0 142.2 Ryzen 7 5800X 24.2 101.5 133.8 Ryzen 9 3900X 20.0 106.9 140.6 Ryzen 9 5950X 30.0 121.1 145.7 AMD 5950X 30.2 121.7 145.7 OpenBenchmarking.org Watts, Fewer Is Better Natron 2.4.3 CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 0.8393 1.6786 2.5179 3.3572 4.1965 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 3.73 3.69 3.35 2.95 2.38 2.00 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 3900X Ryzen 9 5950X AMD 5950X Ryzen 9 3950X 500 1000 1500 2000 2500 SE +/- 5.03, N = 3 SE +/- 30.80, N = 3 SE +/- 11.74, N = 3 1668.03 1992.30 2017.29 2126.71 2145.24 2346.05 MIN: 1550.58 / MAX: 1755.3 MIN: 1698.95 / MAX: 2200.09 MIN: 1715.21 / MAX: 2220.91 MIN: 1706.2 / MAX: 2453.34 MIN: 1771.66 / MAX: 2371.66 MIN: 1886.54 / MAX: 2632.54 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 2.3 40.1 48.5 Ryzen 9 3950X 15.9 100.2 115.3 Ryzen 9 3900X 20.2 116.8 130.3 Ryzen 7 5800X 14.4 118.8 136.9 Ryzen 9 5950X 29.9 131.2 145.1 AMD 5950X 30.0 132.3 145.1 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 9 5950X Ryzen 7 5800X Ryzen 9 3950X Ryzen 7 5700G Ryzen 9 3900X 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 9.74 9.72 6.08 5.84 5.47 4.25 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X 300 600 900 1200 1500 SE +/- 0.42, N = 3 SE +/- 0.28, N = 3 SE +/- 1.57, N = 3 657.33 730.58 819.44 820.04 1362.52 1406.22 MIN: 638.88 / MAX: 664.91 MIN: 492.86 / MAX: 776.15 MIN: 733.89 / MAX: 843.65 MIN: 793.27 / MAX: 831.81 MIN: 1339.1 / MAX: 1376.54 MIN: 1307.87 / MAX: 1498.4 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 1.7 70.6 77.4 Ryzen 9 3900X 20.0 121.3 132.4 AMD 5950X 30.0 122.6 132.2 Ryzen 9 5950X 30.4 122.9 131.3 Ryzen 9 3950X 16.2 134.2 145.7 Ryzen 7 5800X 15.9 136.8 146.8 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 3K 6K 9K 12K 15K SE +/- 27.98, N = 3 SE +/- 29.14, N = 3 SE +/- 21.83, N = 3 13205.42 13202.07 12887.19 10039.39 9100.45 6674.80 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 3900X Ryzen 9 5950X AMD 5950X Ryzen 9 3950X 0.2768 0.5536 0.8304 1.1072 1.384 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.88 1.19 1.19 1.21 1.21 1.23 MIN: 0.58 / MAX: 10.45 MIN: 0.71 / MAX: 15.27 MIN: 0.66 / MAX: 40 MIN: 0.8 / MAX: 11.78 MIN: 0.76 / MAX: 10.99 MIN: 0.74 / MAX: 11.28 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 3.4 39.8 53.3 Ryzen 9 3950X 16.2 115.5 124.2 Ryzen 9 5950X 30.1 123.4 131.4 AMD 5950X 28.9 123.7 132.4 Ryzen 7 5800X 5.6 137.1 145.6 Ryzen 9 3900X 20.8 137.5 146.8 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AMD 5950X Ryzen 9 5950X Ryzen 9 3950X Ryzen 7 5800X Ryzen 9 3900X Ryzen 7 5700G 5K 10K 15K 20K 25K SE +/- 15.98, N = 3 SE +/- 40.08, N = 3 SE +/- 72.04, N = 3 24180.33 24162.82 17110.58 14815.54 12874.87 12657.33 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3900X Ryzen 9 3950X 0.2093 0.4186 0.6279 0.8372 1.0465 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.54 0.62 0.66 0.66 0.93 0.93 MIN: 0.33 / MAX: 10.16 MIN: 0.39 / MAX: 12.23 MIN: 0.4 / MAX: 9.7 MIN: 0.39 / MAX: 9.09 MIN: 0.54 / MAX: 34.61 MIN: 0.56 / MAX: 9.29 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 1.9 57.2 66.4 AMD 5950X 30.0 125.2 135.1 Ryzen 9 5950X 29.7 126.0 133.8 Ryzen 9 3900X 20.1 133.0 145.2 Ryzen 7 5800X 14.5 135.2 146.0 Ryzen 9 3950X 16.5 135.8 145.7 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 0.5603 1.1206 1.6809 2.2412 2.8015 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.49 2.48 2.35 2.07 1.80 1.43 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 3900X AMD 5950X Ryzen 9 5950X Ryzen 9 3950X 700 1400 2100 2800 3500 SE +/- 5.93, N = 3 SE +/- 6.13, N = 3 SE +/- 4.91, N = 3 2206.44 2775.38 2872.19 3177.65 3177.96 3345.24 MIN: 1950 / MAX: 2464.9 MIN: 1785.91 / MAX: 3104.21 MIN: 2247.77 / MAX: 3169.97 MIN: 2198.09 / MAX: 3770.21 MIN: 2488.17 / MAX: 3743.21 MIN: 2326.56 / MAX: 3765.68 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 3.1 44.2 51.7 Ryzen 9 3950X 16.4 106.9 122.2 Ryzen 9 3900X 19.4 123.7 138.4 Ryzen 7 5800X 6.5 127.5 144.1 Ryzen 9 5950X 29.9 131.1 143.3 AMD 5950X 30.3 131.7 144.4 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 0.5513 1.1026 1.6539 2.2052 2.7565 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 2.45 2.41 2.37 2.05 1.78 1.43 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 3900X Ryzen 9 5950X AMD 5950X Ryzen 9 3950X 700 1400 2100 2800 3500 SE +/- 4.19, N = 3 SE +/- 14.80, N = 3 SE +/- 21.39, N = 3 2228.90 2765.95 2887.44 3230.15 3267.99 3335.63 MIN: 1559.98 / MAX: 2479.16 MIN: 1842.04 / MAX: 3083.75 MIN: 1479.87 / MAX: 3243.66 MIN: 1558.47 / MAX: 3791.92 MIN: 2219.86 / MAX: 3776.07 MIN: 2730.21 / MAX: 3819.11 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 3.8 46.4 53.8 Ryzen 9 3950X 16.7 109.7 124.7 Ryzen 7 5800X 7.9 126.9 142.7 Ryzen 9 3900X 19.8 127.9 142.1 Ryzen 9 5950X 30.0 130.9 142.9 AMD 5950X 30.2 131.0 144.2 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU AMD 5950X Ryzen 9 5950X Ryzen 7 5800X Ryzen 9 3950X Ryzen 7 5700G Ryzen 9 3900X 200 400 600 800 1000 SE +/- 0.42, N = 3 SE +/- 0.36, N = 3 SE +/- 0.21, N = 3 957.10 954.66 590.52 582.29 536.55 421.77 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G AMD 5950X Ryzen 9 5950X Ryzen 9 3950X Ryzen 9 3900X 7 14 21 28 35 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 13.54 14.90 16.71 16.75 27.47 28.44 MIN: 7.08 / MAX: 22.51 MIN: 7.33 / MAX: 25.89 MIN: 8.06 / MAX: 24.96 MIN: 11.09 / MAX: 21.33 MIN: 18.76 / MAX: 35.74 MIN: 14.9 / MAX: 78.52 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 4.5 70.5 76.4 AMD 5950X 30.2 123.1 131.7 Ryzen 9 3900X 20.2 123.2 131.9 Ryzen 9 5950X 30.3 123.2 132.2 Ryzen 9 3950X 16.8 135.6 146.8 Ryzen 7 5800X 24.3 137.3 146.8 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU AMD 5950X Ryzen 9 5950X Ryzen 9 3950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 100 200 300 400 500 SE +/- 0.67, N = 3 SE +/- 0.44, N = 3 SE +/- 0.03, N = 3 439.51 439.51 390.89 321.06 279.63 229.37 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3900X Ryzen 9 3950X 5 10 15 20 25 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 14.29 17.42 18.19 18.19 18.67 20.45 MIN: 7.5 / MAX: 24.54 MIN: 9.07 / MAX: 30.09 MIN: 9.4 / MAX: 28.56 MIN: 8.69 / MAX: 26.01 MIN: 13.72 / MAX: 70.89 MIN: 11.74 / MAX: 39.16 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 4.0 46.3 50.1 Ryzen 9 3950X 16.3 105.0 113.4 Ryzen 9 3900X 20.2 123.2 132.2 AMD 5950X 30.4 126.0 133.4 Ryzen 9 5950X 30.3 126.1 133.6 Ryzen 7 5800X 8.8 134.6 145.6 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 7 5800X Ryzen 9 3900X Ryzen 7 5700G 150 300 450 600 750 SE +/- 0.90, N = 3 SE +/- 0.10, N = 3 SE +/- 3.62, N = 3 677.86 676.45 494.84 412.78 355.68 306.65 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Ryzen 7 5800X Ryzen 9 5950X AMD 5950X Ryzen 7 5700G Ryzen 9 3950X Ryzen 9 3900X 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.01, N = 3 9.68 11.79 11.82 13.03 16.16 16.86 MIN: 5.23 / MAX: 19.09 MIN: 7.87 / MAX: 21.31 MIN: 6.54 / MAX: 21.16 MIN: 6.64 / MAX: 25.26 MIN: 9.15 / MAX: 68.05 MIN: 10.76 / MAX: 72.48 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 2.6 59.4 74.5 Ryzen 9 5950X 30.2 124.7 133.2 AMD 5950X 30.2 125.2 133.5 Ryzen 9 3900X 20.0 131.5 142.5 Ryzen 9 3950X 16.5 137.0 146.8 Ryzen 7 5800X 24.3 137.7 145.7 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 7 5800X Ryzen 9 3900X Ryzen 7 5700G 50 100 150 200 250 SE +/- 1.21, N = 3 SE +/- 0.32, N = 3 SE +/- 0.59, N = 3 236.05 235.54 206.46 196.76 175.55 138.98 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 5950X AMD 5950X Ryzen 9 3900X Ryzen 9 3950X 9 18 27 36 45 SE +/- 0.13, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 20.32 28.75 33.85 33.92 34.15 38.71 MIN: 12.41 / MAX: 37.85 MIN: 10.6 / MAX: 50.31 MIN: 24.98 / MAX: 49.81 MIN: 20.26 / MAX: 49.04 MIN: 12.29 / MAX: 77.76 MIN: 13.3 / MAX: 56.5 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 2.2 34.7 40.3 Ryzen 9 3950X 16.3 87.1 99.0 Ryzen 9 3900X 19.9 116.2 127.2 Ryzen 7 5800X 24.3 120.8 135.6 Ryzen 9 5950X 30.4 124.8 134.8 AMD 5950X 30.1 124.9 134.7 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Ryzen 9 5950X AMD 5950X Ryzen 9 3950X Ryzen 7 5800X Ryzen 9 3900X Ryzen 7 5700G 130 260 390 520 650 SE +/- 0.78, N = 3 SE +/- 0.84, N = 3 SE +/- 1.36, N = 3 619.79 617.73 543.33 420.26 363.51 307.90 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Ryzen 7 5800X Ryzen 9 5950X AMD 5950X Ryzen 7 5700G Ryzen 9 3950X Ryzen 9 3900X 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 SE +/- 0.04, N = 3 9.51 12.89 12.94 12.97 14.70 16.49 MIN: 7.04 / MAX: 20.4 MIN: 6.96 / MAX: 19.37 MIN: 10.73 / MAX: 18.83 MIN: 7.48 / MAX: 28.4 MIN: 12.18 / MAX: 25.15 MIN: 8.83 / MAX: 60.21 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 4.4 39.8 47.4 Ryzen 9 3950X 16.5 101.9 109.9 Ryzen 9 3900X 20.7 124.0 135.8 Ryzen 9 5950X 30.2 129.3 138.7 AMD 5950X 30.1 130.1 138.5 Ryzen 7 5800X 16.2 137.3 146.9 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Ryzen 9 5950X Ryzen 9 3950X AMD 5950X Ryzen 9 3900X Ryzen 7 5800X Ryzen 7 5700G 9 18 27 36 45 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.11, N = 3 38.80 37.57 36.13 29.73 28.67 23.11 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Ryzen 7 5800X Ryzen 7 5700G Ryzen 9 3900X Ryzen 9 5950X Ryzen 9 3950X AMD 5950X 50 100 150 200 250 SE +/- 0.34, N = 3 SE +/- 0.84, N = 3 SE +/- 0.54, N = 3 139.43 172.93 201.66 206.08 212.69 221.12 MIN: 115.02 / MAX: 161.07 MIN: 85.04 / MAX: 215.98 MIN: 112.84 / MAX: 328.9 MIN: 119.55 / MAX: 247.84 MIN: 170.16 / MAX: 263.41 MIN: 158.14 / MAX: 257.35 1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 5700G 4.8 40.1 45.3 Ryzen 9 3950X 16.3 97.5 109.2 Ryzen 9 3900X 20.1 116.2 127.2 AMD 5950X 30.3 127.5 140.4 Ryzen 7 5800X 10.0 127.7 140.2 Ryzen 9 5950X 30.1 130.2 143.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2022.2.dev CPU Power Consumption Monitor 40 80 120 160 200
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Ryzen 7 5700G Ryzen 9 3950X AMD 5950X Ryzen 7 5800X Ryzen 9 3900X 30 60 90 120 150 Min: 0.19 / Avg: 46.1 / Max: 82.67 Min: 15.22 / Avg: 107.77 / Max: 146.79 Min: 26.67 / Avg: 113.2 / Max: 146.12 Min: 5.58 / Avg: 115.26 / Max: 146.87 Min: 19.42 / Avg: 117.82 / Max: 146.8
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.32.6 VGR Performance Metric Ryzen 9 5950X AMD 5950X Ryzen 9 3950X 60K 120K 180K 240K 300K 266752 264948 249203 1. (CXX) g++ options: -std=c++11 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -pedantic -ldl -lm
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric Per Watt, More Is Better BRL-CAD 7.32.6 VGR Performance Metric Ryzen 9 5950X AMD 5950X Ryzen 9 3950X 400 800 1200 1600 2000 2000.65 1981.96 1751.27
BRL-CAD CPU Power Consumption Monitor Min Avg Max Ryzen 9 5950X 30.2 133.3 140.2 AMD 5950X 30.1 133.7 139.3 Ryzen 9 3950X 16.6 142.3 146.8 OpenBenchmarking.org Watts, Fewer Is Better BRL-CAD 7.32.6 CPU Power Consumption Monitor 40 80 120 160 200
Apache CouchDB Bulk Size: 100 - Inserts: 1000 - Rounds: 30 OpenBenchmarking.org Seconds, Fewer Is Better Apache CouchDB 3.2.2 Bulk Size: 100 - Inserts: 1000 - Rounds: 30 AMD 5950X Ryzen 9 3950X gzcm001cpu 50 100 150 200 250 SE +/- 0.72, N = 3 69.37 84.60 213.47 1. (CXX) g++ options: -std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD
Apache CouchDB CPU Power Consumption Monitor Min Avg Max Ryzen 9 3950X 16.0 74.1 85.8 AMD 5950X 30.0 112.0 130.4 OpenBenchmarking.org Watts, Fewer Is Better Apache CouchDB 3.2.2 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Random Read gzcm001cpu AMD 5950X Ryzen 9 3950X 100M 200M 300M 400M 500M SE +/- 3869856.69, N = 3 464637145 103048882 75585720 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Random Read OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Random Read AMD 5950X Ryzen 9 3950X 200K 400K 600K 800K 1000K 808898.63 553062.24
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 29.9 127.4 134.8 Ryzen 9 3950X 16.4 136.7 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Read While Writing gzcm001cpu AMD 5950X Ryzen 9 3950X 2M 4M 6M 8M 10M SE +/- 58777.69, N = 3 7919672 4033021 3293680 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Read While Writing OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Read While Writing AMD 5950X Ryzen 9 3950X 6K 12K 18K 24K 30K 29449.46 24269.49
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max Ryzen 9 3950X 16.4 135.7 145.6 AMD 5950X 30.0 136.9 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Read Random Write Random AMD 5950X Ryzen 9 3950X gzcm001cpu 600K 1200K 1800K 2400K 3000K SE +/- 1598.84, N = 3 2764908 2269855 457226 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Read Random Write Random AMD 5950X Ryzen 9 3950X 4K 8K 12K 16K 20K 20226.72 16594.26
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max AMD 5950X 29.9 136.7 145.7 Ryzen 9 3950X 16.2 136.8 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Facebook RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better Facebook RocksDB 7.5.3 Test: Update Random AMD 5950X Ryzen 9 3950X gzcm001cpu 160K 320K 480K 640K 800K SE +/- 3114.60, N = 3 764612 618421 231659 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Facebook RocksDB Test: Update Random OpenBenchmarking.org Op/s Per Watt, More Is Better Facebook RocksDB 7.5.3 Test: Update Random AMD 5950X Ryzen 9 3950X 1200 2400 3600 4800 6000 5550.25 4554.49
Facebook RocksDB CPU Power Consumption Monitor Min Avg Max Ryzen 9 3950X 16.5 135.8 145.6 AMD 5950X 30.0 137.8 145.6 OpenBenchmarking.org Watts, Fewer Is Better Facebook RocksDB 7.5.3 CPU Power Consumption Monitor 40 80 120 160 200
Meta Performance Per Watts Performance Per Watts OpenBenchmarking.org Performance Per Watts, More Is Better Meta Performance Per Watts Performance Per Watts AMD 5950X Ryzen 9 3950X 60K 120K 180K 240K 300K 277082.43 229081.17
Phoronix Test Suite v10.8.4