3950X Sep AMD Ryzen 9 3950X 16-Core testing with a ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS) and Sapphire AMD Radeon RX 470 4GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2209044-NE-3950XSEP507&grw&sro .
3950X Sep Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Vulkan Compiler File-System Screen Resolution A B C D E AMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores) ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS) AMD Starship/Matisse 16GB Samsung SSD 970 EVO 250GB Sapphire AMD Radeon RX 470 4GB (1260/1750MHz) AMD Ellesmere HDMI Audio DELL S2409W Intel I211 + Realtek RTL8822BE 802.11a/b/g/n/ac Ubuntu 22.04 5.19.0-051900daily20220813-generic (x86_64) GNOME Shell 42.2 X Server + Wayland 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.48) 1.3.204 GCC 11.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details - NONE / errors=remount-ro,relatime,rw / Block Size: 4096 Processor Details - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8701021 Python Details - Python 3.10.4 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of IBPB + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: always-on STIBP: forced RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
3950X Sep mnn: nasnet mnn: mobilenetV3 mnn: squeezenetv1.1 mnn: resnet-v2-50 mnn: SqueezeNetV1.0 mnn: MobileNetV2_224 mnn: mobilenet-v1-1.0 mnn: inception-v3 openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU compress-7zip: Compression Rating compress-7zip: Decompression Rating build-php: Time To Compile graphics-magick: Swirl graphics-magick: Rotate graphics-magick: Sharpen graphics-magick: Enhanced graphics-magick: Resizing graphics-magick: Noise-Gaussian graphics-magick: HWB Color Space natron: Spaceship build-python: Default build-python: Released Build, PGO + LTO Optimized build-erlang: Time To Compile build-nodejs: Time To Compile build-wasmer: Time To Compile blosc: blosclz shuffle blosc: blosclz bitshuffle etcd: PUT - 50 - 100 etcd: PUT - 50 - 100 - Average Latency etcd: PUT - 100 - 100 etcd: PUT - 100 - 100 - Average Latency etcd: PUT - 50 - 1000 etcd: PUT - 50 - 1000 - Average Latency etcd: PUT - 500 - 100 etcd: PUT - 500 - 100 - Average Latency etcd: PUT - 100 - 1000 etcd: PUT - 100 - 1000 - Average Latency etcd: PUT - 500 - 1000 etcd: PUT - 500 - 1000 - Average Latency etcd: RANGE - 50 - 100 etcd: RANGE - 50 - 100 - Average Latency etcd: RANGE - 100 - 100 etcd: RANGE - 100 - 100 - Average Latency etcd: RANGE - 50 - 1000 etcd: RANGE - 50 - 1000 - Average Latency etcd: RANGE - 500 - 100 etcd: RANGE - 500 - 100 - Average Latency unpack-linux: linux-5.19.tar.xz etcd: RANGE - 100 - 1000 etcd: RANGE - 100 - 1000 - Average Latency etcd: RANGE - 500 - 1000 etcd: RANGE - 500 - 1000 - Average Latency A B C D E 12.978 2.013 3.379 20.177 5.421 3.592 2.698 27.847 3.16 1258.34 2.37 1668.85 2.39 1659.89 351.33 11.37 5.74 695.52 437.73 9.13 321.78 12.41 36.32 110.01 570.81 28.01 504.46 7.92 10973.67 1.44 15767.85 1.01 84205 75100 60.378 659 468 251 364 1688 290 729 3.3 18.361 272.578 111.939 497.19 57.352 14794.4 10091.1 30093.3858 3.3 29893.4342 3.3 90351.7306 11 29940.6161 3.3 85435.5111 11.6 66273.0768 14.7 30099.5813 3.3 26866.5759 3.7 90098.1995 11 18991.5239 5.3 7.698 84607.3437 11.7 65917.2412 14.8 13.061 2.006 3.374 20.064 5.566 3.571 2.692 27.608 3.16 1255.92 2.38 1661.53 2.42 1637.81 343.85 11.61 5.76 693.78 439 9.1 321.18 12.43 36.04 110.92 572.41 27.92 503.24 7.93 11065.96 1.43 15826.05 1 82350 74832 60.627 657 463 251 363 1674 289 722 3.4 18.414 272.358 112.06 497.081 57.317 14622.1 10039.2 16614.8535 6 16572.2801 6 89723.1316 11.1 16446.3786 6.1 84546.0612 11.7 65970.6099 14.8 16178.249 6.2 16165.5907 6.2 89816.4119 11 16096.4741 6.2 7.682 84592.9072 11.7 65709.4541 14.8 12.798 1.971 3.279 20.321 5.401 3.542 2.7 27.76 3.14 1271.04 2.39 1663.26 2.41 1641.56 344.15 11.6 5.77 692.6 439.42 9.09 321.38 12.42 36.06 110.84 572.84 27.91 504.03 7.92 11106.24 1.43 15841.7 1 83291 75045 60.57 658 461 251 364 1684 289 722 3.3 18.379 272.803 112.666 495.674 57.32 14763.6 10074.1 15974.8552 6.3 15915.4645 6.3 89853.168 11 15901.9526 6.3 84943.43 11.6 65829.2852 14.8 15954.5557 6.3 16010.0146 6.2 89932.6944 11 15859.1248 6.3 7.653 84946.7854 11.6 65751.5752 14.8 13.057 2.014 3.37 20.069 5.541 3.508 2.69 27.825 3.13 1274.45 2.41 1645.1 2.42 1643.31 344.26 11.6 5.76 693.83 438.99 9.1 321.99 12.4 36.15 110.55 572.19 27.94 504.36 7.92 11031.84 1.44 15834.93 1 84096 74994 60.49 657 462 251 363 1673 289 723 3.4 18.366 272.489 113.131 496.204 57.618 14684.2 10053.4 15721.3132 6.4 15687.9816 6.4 89674.3612 11.1 15561.3594 6.4 84669.7892 11.7 65753.4823 14.8 15613.6585 6.4 15511.5642 6.4 90539.5988 11 15521.4251 6.4 7.675 84795.2544 11.7 65750.6546 14.8 12.810 1.972 3.312 20.032 5.380 3.506 2.683 27.527 3.14 1269.03 2.39 1654.29 2.39 1661.55 340.86 11.71 5.74 696.40 436.56 9.15 320.41 12.46 35.75 111.79 569.25 28.08 503.15 7.94 11013.08 1.44 15751.27 1.01 83473 74898 60.039 653 461 249 362 1666 289 720 3.3 18.387 274.585 112.594 496.366 57.353 14626.6 10021.8 15591.5835 6.4 15439.5777 6.5 72969.6471 13.7 15135.4651 6.6 62573.1546 16.0 52164.5114 18.8 13528.9582 7.4 13662.1831 7.3 57913.1768 17.5 12552.8291 8.0 7.648 55692.0084 18.1 47997.9506 20.5 OpenBenchmarking.org
Mobile Neural Network Model: nasnet OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: nasnet A B C D E 3 6 9 12 15 SE +/- 0.02, N = 3 12.98 13.06 12.80 13.06 12.81 MIN: 12.88 / MAX: 19.14 MIN: 12.97 / MAX: 19.07 MIN: 12.68 / MAX: 19.17 MIN: 12.94 / MAX: 19.32 MIN: 12.68 / MAX: 30.81 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenetV3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenetV3 A B C D E 0.4532 0.9064 1.3596 1.8128 2.266 SE +/- 0.009, N = 3 2.013 2.006 1.971 2.014 1.972 MIN: 1.99 / MAX: 3.11 MIN: 1.98 / MAX: 2.75 MIN: 1.94 / MAX: 3.07 MIN: 1.99 / MAX: 2.25 MIN: 1.93 / MAX: 3.06 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: squeezenetv1.1 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: squeezenetv1.1 A B C D E 0.7603 1.5206 2.2809 3.0412 3.8015 SE +/- 0.008, N = 3 3.379 3.374 3.279 3.370 3.312 MIN: 3.34 / MAX: 4.37 MIN: 3.33 / MAX: 4.48 MIN: 3.24 / MAX: 4.29 MIN: 3.32 / MAX: 4.47 MIN: 3.26 / MAX: 4.42 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: resnet-v2-50 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: resnet-v2-50 A B C D E 5 10 15 20 25 SE +/- 0.07, N = 3 20.18 20.06 20.32 20.07 20.03 MIN: 19.89 / MAX: 26.06 MIN: 19.82 / MAX: 36.51 MIN: 20.04 / MAX: 36.83 MIN: 19.84 / MAX: 34.96 MIN: 19.6 / MAX: 34.6 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: SqueezeNetV1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: SqueezeNetV1.0 A B C D E 1.2524 2.5048 3.7572 5.0096 6.262 SE +/- 0.019, N = 3 5.421 5.566 5.401 5.541 5.380 MIN: 5.35 / MAX: 21.72 MIN: 5.51 / MAX: 6.67 MIN: 5.35 / MAX: 6.22 MIN: 5.49 / MAX: 6.76 MIN: 5.3 / MAX: 6.52 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: MobileNetV2_224 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: MobileNetV2_224 A B C D E 0.8082 1.6164 2.4246 3.2328 4.041 SE +/- 0.022, N = 3 3.592 3.571 3.542 3.508 3.506 MIN: 3.55 / MAX: 6.84 MIN: 3.53 / MAX: 4.69 MIN: 3.5 / MAX: 5.07 MIN: 3.47 / MAX: 4.6 MIN: 3.44 / MAX: 9.59 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: mobilenet-v1-1.0 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 A B C D E 0.6075 1.215 1.8225 2.43 3.0375 SE +/- 0.024, N = 3 2.698 2.692 2.700 2.690 2.683 MIN: 2.66 / MAX: 3.73 MIN: 2.65 / MAX: 3.77 MIN: 2.66 / MAX: 3.68 MIN: 2.65 / MAX: 3.76 MIN: 2.61 / MAX: 3.75 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
Mobile Neural Network Model: inception-v3 OpenBenchmarking.org ms, Fewer Is Better Mobile Neural Network 2.1 Model: inception-v3 A B C D E 7 14 21 28 35 SE +/- 0.09, N = 3 27.85 27.61 27.76 27.83 27.53 MIN: 27.42 / MAX: 33.72 MIN: 27.19 / MAX: 34.67 MIN: 27.3 / MAX: 72.79 MIN: 27.33 / MAX: 33.14 MIN: 27.08 / MAX: 47.12 1. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU A B C D E 0.711 1.422 2.133 2.844 3.555 SE +/- 0.00, N = 3 3.16 3.16 3.14 3.13 3.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU A B C D E 300 600 900 1200 1500 SE +/- 1.95, N = 3 1258.34 1255.92 1271.04 1274.45 1269.03 MIN: 1201.93 / MAX: 1341.23 MIN: 1206.49 / MAX: 1356.42 MIN: 1241.13 / MAX: 1380.49 MIN: 1226.87 / MAX: 1355.68 MIN: 1210.75 / MAX: 1378.29 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU A B C D E 0.5423 1.0846 1.6269 2.1692 2.7115 SE +/- 0.01, N = 3 2.37 2.38 2.39 2.41 2.39 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU A B C D E 400 800 1200 1600 2000 SE +/- 9.27, N = 3 1668.85 1661.53 1663.26 1645.10 1654.29 MIN: 1447.91 / MAX: 1780.07 MIN: 1480.92 / MAX: 1803.33 MIN: 1482.48 / MAX: 1805.04 MIN: 1489.68 / MAX: 1839.49 MIN: 1481.86 / MAX: 1868.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU A B C D E 0.5445 1.089 1.6335 2.178 2.7225 SE +/- 0.02, N = 3 2.39 2.42 2.41 2.42 2.39 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU A B C D E 400 800 1200 1600 2000 SE +/- 11.54, N = 3 1659.89 1637.81 1641.56 1643.31 1661.55 MIN: 1461.24 / MAX: 1823.91 MIN: 1490.45 / MAX: 1850.31 MIN: 1477.93 / MAX: 1797.33 MIN: 1495.03 / MAX: 1843.12 MIN: 1464.72 / MAX: 1861.45 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU A B C D E 80 160 240 320 400 SE +/- 2.43, N = 3 351.33 343.85 344.15 344.26 340.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU A B C D E 3 6 9 12 15 SE +/- 0.08, N = 3 11.37 11.61 11.60 11.60 11.71 MIN: 10.52 / MAX: 21.67 MIN: 10.6 / MAX: 28.3 MIN: 10.53 / MAX: 23.08 MIN: 10.66 / MAX: 22.12 MIN: 10.26 / MAX: 21.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU A B C D E 1.2983 2.5966 3.8949 5.1932 6.4915 SE +/- 0.00, N = 3 5.74 5.76 5.77 5.76 5.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU A B C D E 150 300 450 600 750 SE +/- 0.32, N = 3 695.52 693.78 692.60 693.83 696.40 MIN: 691.3 / MAX: 708.41 MIN: 686.88 / MAX: 717.7 MIN: 686.95 / MAX: 699.35 MIN: 684.96 / MAX: 701.04 MIN: 688.69 / MAX: 721.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU A B C D E 100 200 300 400 500 SE +/- 0.31, N = 3 437.73 439.00 439.42 438.99 436.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU A B C D E 3 6 9 12 15 SE +/- 0.01, N = 3 9.13 9.10 9.09 9.10 9.15 MIN: 8.85 / MAX: 16.16 MIN: 8.83 / MAX: 15.74 MIN: 8.83 / MAX: 25.56 MIN: 8.85 / MAX: 25.66 MIN: 8.87 / MAX: 26.46 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU A B C D E 70 140 210 280 350 SE +/- 0.08, N = 3 321.78 321.18 321.38 321.99 320.41 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU A B C D E 3 6 9 12 15 SE +/- 0.00, N = 3 12.41 12.43 12.42 12.40 12.46 MIN: 10.44 / MAX: 22.3 MIN: 10.42 / MAX: 17.91 MIN: 10.48 / MAX: 15.98 MIN: 10.39 / MAX: 18.88 MIN: 10.39 / MAX: 27.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU A B C D E 8 16 24 32 40 SE +/- 0.10, N = 3 36.32 36.04 36.06 36.15 35.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU A B C D E 30 60 90 120 150 SE +/- 0.33, N = 3 110.01 110.92 110.84 110.55 111.79 MIN: 85.11 / MAX: 135.51 MIN: 92.03 / MAX: 133.28 MIN: 84.72 / MAX: 133.04 MIN: 89.56 / MAX: 138.28 MIN: 86.68 / MAX: 133.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU A B C D E 120 240 360 480 600 SE +/- 0.37, N = 3 570.81 572.41 572.84 572.19 569.25 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU A B C D E 7 14 21 28 35 SE +/- 0.02, N = 3 28.01 27.92 27.91 27.94 28.08 MIN: 27.19 / MAX: 33.76 MIN: 27.09 / MAX: 44.07 MIN: 27.1 / MAX: 34.12 MIN: 27.08 / MAX: 44.05 MIN: 27.25 / MAX: 44.19 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU A B C D E 110 220 330 440 550 SE +/- 0.63, N = 3 504.46 503.24 504.03 504.36 503.15 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU A B C D E 2 4 6 8 10 SE +/- 0.01, N = 3 7.92 7.93 7.92 7.92 7.94 MIN: 7.59 / MAX: 24.31 MIN: 7.45 / MAX: 12.66 MIN: 7.6 / MAX: 12.54 MIN: 7.52 / MAX: 15.54 MIN: 7.58 / MAX: 38.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU A B C D E 2K 4K 6K 8K 10K SE +/- 33.81, N = 3 10973.67 11065.96 11106.24 11031.84 11013.08 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU A B C D E 0.324 0.648 0.972 1.296 1.62 SE +/- 0.00, N = 3 1.44 1.43 1.43 1.44 1.44 MIN: 1.23 / MAX: 17.9 MIN: 1.27 / MAX: 18.12 MIN: 1.25 / MAX: 17.38 MIN: 1.27 / MAX: 18.07 MIN: 1.26 / MAX: 17.8 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU A B C D E 3K 6K 9K 12K 15K SE +/- 1.59, N = 3 15767.85 15826.05 15841.70 15834.93 15751.27 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU A B C D E 0.2273 0.4546 0.6819 0.9092 1.1365 SE +/- 0.00, N = 3 1.01 1.00 1.00 1.00 1.01 MIN: 0.95 / MAX: 7.42 MIN: 0.95 / MAX: 7.42 MIN: 0.95 / MAX: 7.16 MIN: 0.95 / MAX: 5.25 MIN: 0.95 / MAX: 17.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating A B C D E 20K 40K 60K 80K 100K SE +/- 30.72, N = 3 84205 82350 83291 84096 83473 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating A B C D E 16K 32K 48K 64K 80K SE +/- 23.02, N = 3 75100 74832 75045 74994 74898 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.1.9 Time To Compile A B C D E 14 28 42 56 70 SE +/- 0.22, N = 3 60.38 60.63 60.57 60.49 60.04
GraphicsMagick Operation: Swirl OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Swirl A B C D E 140 280 420 560 700 SE +/- 1.20, N = 3 659 657 658 657 653 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
GraphicsMagick Operation: Rotate OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Rotate A B C D E 100 200 300 400 500 SE +/- 0.33, N = 3 468 463 461 462 461 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
GraphicsMagick Operation: Sharpen OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Sharpen A B C D E 50 100 150 200 250 SE +/- 0.67, N = 3 251 251 251 251 249 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Enhanced A B C D E 80 160 240 320 400 SE +/- 0.33, N = 3 364 363 364 363 362 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
GraphicsMagick Operation: Resizing OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Resizing A B C D E 400 800 1200 1600 2000 SE +/- 3.67, N = 3 1688 1674 1684 1673 1666 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
GraphicsMagick Operation: Noise-Gaussian OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Noise-Gaussian A B C D E 60 120 180 240 300 SE +/- 0.33, N = 3 290 289 289 289 289 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
GraphicsMagick Operation: HWB Color Space OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: HWB Color Space A B C D E 160 320 480 640 800 SE +/- 0.58, N = 3 729 722 722 723 720 1. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread
Natron Input: Spaceship OpenBenchmarking.org FPS, More Is Better Natron 2.4.3 Input: Spaceship A B C D E 0.765 1.53 2.295 3.06 3.825 SE +/- 0.06, N = 12 3.3 3.4 3.3 3.4 3.3
Timed CPython Compilation Build Configuration: Default OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Default A B C D E 5 10 15 20 25 18.36 18.41 18.38 18.37 18.39
Timed CPython Compilation Build Configuration: Released Build, PGO + LTO Optimized OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Released Build, PGO + LTO Optimized A B C D E 60 120 180 240 300 272.58 272.36 272.80 272.49 274.59
Timed Erlang/OTP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Erlang/OTP Compilation 25.0 Time To Compile A B C D E 30 60 90 120 150 SE +/- 0.20, N = 3 111.94 112.06 112.67 113.13 112.59
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile A B C D E 110 220 330 440 550 SE +/- 0.12, N = 3 497.19 497.08 495.67 496.20 496.37
Timed Wasmer Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Time To Compile A B C D E 13 26 39 52 65 SE +/- 0.11, N = 3 57.35 57.32 57.32 57.62 57.35 1. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
C-Blosc Test: blosclz shuffle OpenBenchmarking.org MB/s, More Is Better C-Blosc 2.3 Test: blosclz shuffle A B C D E 3K 6K 9K 12K 15K SE +/- 39.75, N = 3 14794.4 14622.1 14763.6 14684.2 14626.6 1. (CC) gcc options: -std=gnu99 -O3 -lrt -lm
C-Blosc Test: blosclz bitshuffle OpenBenchmarking.org MB/s, More Is Better C-Blosc 2.3 Test: blosclz bitshuffle A B C D E 2K 4K 6K 8K 10K SE +/- 4.68, N = 3 10091.1 10039.2 10074.1 10053.4 10021.8 1. (CC) gcc options: -std=gnu99 -O3 -lrt -lm
etcd Test: PUT - Connections: 50 - Clients: 100 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: PUT - Connections: 50 - Clients: 100 A B C D E 6K 12K 18K 24K 30K SE +/- 9.73, N = 3 30093.39 16614.85 15974.86 15721.31 15591.58
etcd Test: PUT - Connections: 50 - Clients: 100 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: PUT - Connections: 50 - Clients: 100 - Average Latency A B C D E 2 4 6 8 10 SE +/- 0.00, N = 3 3.3 6.0 6.3 6.4 6.4
etcd Test: PUT - Connections: 100 - Clients: 100 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: PUT - Connections: 100 - Clients: 100 A B C D E 6K 12K 18K 24K 30K SE +/- 18.08, N = 3 29893.43 16572.28 15915.46 15687.98 15439.58
etcd Test: PUT - Connections: 100 - Clients: 100 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: PUT - Connections: 100 - Clients: 100 - Average Latency A B C D E 2 4 6 8 10 SE +/- 0.00, N = 3 3.3 6.0 6.3 6.4 6.5
etcd Test: PUT - Connections: 50 - Clients: 1000 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: PUT - Connections: 50 - Clients: 1000 A B C D E 20K 40K 60K 80K 100K SE +/- 1306.71, N = 15 90351.73 89723.13 89853.17 89674.36 72969.65
etcd Test: PUT - Connections: 50 - Clients: 1000 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: PUT - Connections: 50 - Clients: 1000 - Average Latency A B C D E 4 8 12 16 20 SE +/- 0.21, N = 15 11.0 11.1 11.0 11.1 13.7
etcd Test: PUT - Connections: 500 - Clients: 100 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: PUT - Connections: 500 - Clients: 100 A B C D E 6K 12K 18K 24K 30K SE +/- 148.13, N = 6 29940.62 16446.38 15901.95 15561.36 15135.47
etcd Test: PUT - Connections: 500 - Clients: 100 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: PUT - Connections: 500 - Clients: 100 - Average Latency A B C D E 2 4 6 8 10 SE +/- 0.07, N = 6 3.3 6.1 6.3 6.4 6.6
etcd Test: PUT - Connections: 100 - Clients: 1000 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: PUT - Connections: 100 - Clients: 1000 A B C D E 20K 40K 60K 80K 100K SE +/- 1719.86, N = 15 85435.51 84546.06 84943.43 84669.79 62573.15
etcd Test: PUT - Connections: 100 - Clients: 1000 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: PUT - Connections: 100 - Clients: 1000 - Average Latency A B C D E 4 8 12 16 20 SE +/- 0.35, N = 15 11.6 11.7 11.6 11.7 16.0
etcd Test: PUT - Connections: 500 - Clients: 1000 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: PUT - Connections: 500 - Clients: 1000 A B C D E 14K 28K 42K 56K 70K SE +/- 625.45, N = 15 66273.08 65970.61 65829.29 65753.48 52164.51
etcd Test: PUT - Connections: 500 - Clients: 1000 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: PUT - Connections: 500 - Clients: 1000 - Average Latency A B C D E 5 10 15 20 25 SE +/- 0.21, N = 15 14.7 14.8 14.8 14.8 18.8
etcd Test: RANGE - Connections: 50 - Clients: 100 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: RANGE - Connections: 50 - Clients: 100 A B C D E 6K 12K 18K 24K 30K SE +/- 119.86, N = 7 30099.58 16178.25 15954.56 15613.66 13528.96
etcd Test: RANGE - Connections: 50 - Clients: 100 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: RANGE - Connections: 50 - Clients: 100 - Average Latency A B C D E 2 4 6 8 10 SE +/- 0.07, N = 7 3.3 6.2 6.3 6.4 7.4
etcd Test: RANGE - Connections: 100 - Clients: 100 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: RANGE - Connections: 100 - Clients: 100 A B C D E 6K 12K 18K 24K 30K SE +/- 215.62, N = 9 26866.58 16165.59 16010.01 15511.56 13662.18
etcd Test: RANGE - Connections: 100 - Clients: 100 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: RANGE - Connections: 100 - Clients: 100 - Average Latency A B C D E 2 4 6 8 10 SE +/- 0.11, N = 9 3.7 6.2 6.2 6.4 7.3
etcd Test: RANGE - Connections: 50 - Clients: 1000 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: RANGE - Connections: 50 - Clients: 1000 A B C D E 20K 40K 60K 80K 100K SE +/- 2395.30, N = 15 90098.20 89816.41 89932.69 90539.60 57913.18
etcd Test: RANGE - Connections: 50 - Clients: 1000 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: RANGE - Connections: 50 - Clients: 1000 - Average Latency A B C D E 4 8 12 16 20 SE +/- 0.51, N = 15 11.0 11.0 11.0 11.0 17.5
etcd Test: RANGE - Connections: 500 - Clients: 100 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: RANGE - Connections: 500 - Clients: 100 A B C D E 4K 8K 12K 16K 20K SE +/- 112.68, N = 7 18991.52 16096.47 15859.12 15521.43 12552.83
etcd Test: RANGE - Connections: 500 - Clients: 100 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: RANGE - Connections: 500 - Clients: 100 - Average Latency A B C D E 2 4 6 8 10 SE +/- 0.08, N = 7 5.3 6.2 6.3 6.4 8.0
Unpacking The Linux Kernel linux-5.19.tar.xz OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel 5.19 linux-5.19.tar.xz A B C D E 2 4 6 8 10 SE +/- 0.009, N = 4 7.698 7.682 7.653 7.675 7.648
etcd Test: RANGE - Connections: 100 - Clients: 1000 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: RANGE - Connections: 100 - Clients: 1000 A B C D E 20K 40K 60K 80K 100K SE +/- 1989.42, N = 15 84607.34 84592.91 84946.79 84795.25 55692.01
etcd Test: RANGE - Connections: 100 - Clients: 1000 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: RANGE - Connections: 100 - Clients: 1000 - Average Latency A B C D E 4 8 12 16 20 SE +/- 0.46, N = 15 11.7 11.7 11.6 11.7 18.1
etcd Test: RANGE - Connections: 500 - Clients: 1000 OpenBenchmarking.org Requests/sec, More Is Better etcd 3.5.4 Test: RANGE - Connections: 500 - Clients: 1000 A B C D E 14K 28K 42K 56K 70K SE +/- 337.08, N = 15 65917.24 65709.45 65751.58 65750.65 47997.95
etcd Test: RANGE - Connections: 500 - Clients: 1000 - Average Latency OpenBenchmarking.org ms, Fewer Is Better etcd 3.5.4 Test: RANGE - Connections: 500 - Clients: 1000 - Average Latency A B C D E 5 10 15 20 25 SE +/- 0.14, N = 15 14.8 14.8 14.8 14.8 20.5
Phoronix Test Suite v10.8.5