3950X Sep

AMD Ryzen 9 3950X 16-Core testing with a ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS) and Sapphire AMD Radeon RX 470 4GB on Ubuntu 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2209044-NE-3950XSEP507&sro.

3950X SepProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionABCDEAMD Ryzen 9 3950X 16-Core @ 3.50GHz (16 Cores)ASUS ROG CROSSHAIR VII HERO (WI-FI) (3103 BIOS)AMD Starship/Matisse16GBSamsung SSD 970 EVO 250GBSapphire AMD Radeon RX 470 4GB (1260/1750MHz)AMD Ellesmere HDMI AudioDELL S2409WIntel I211 + Realtek RTL8822BE 802.11a/b/g/n/acUbuntu 22.045.19.0-051900daily20220813-generic (x86_64)GNOME Shell 42.2X Server + Wayland4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.48)1.3.204GCC 11.2.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8701021 Python Details- Python 3.10.4Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of IBPB + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: always-on STIBP: forced RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

3950X Sepunpack-linux: linux-5.19.tar.xzblosc: blosclz shuffleblosc: blosclz bitshufflegraphics-magick: Swirlgraphics-magick: Rotategraphics-magick: Sharpengraphics-magick: Enhancedgraphics-magick: Resizinggraphics-magick: Noise-Gaussiangraphics-magick: HWB Color Spacecompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingbuild-nodejs: Time To Compilebuild-php: Time To Compilebuild-python: Defaultbuild-python: Released Build, PGO + LTO Optimizedbuild-erlang: Time To Compilebuild-wasmer: Time To Compileetcd: PUT - 50 - 100etcd: PUT - 50 - 100 - Average Latencyetcd: PUT - 100 - 100etcd: PUT - 100 - 100 - Average Latencyetcd: PUT - 50 - 1000etcd: PUT - 50 - 1000 - Average Latencyetcd: PUT - 500 - 100etcd: PUT - 500 - 100 - Average Latencyetcd: PUT - 100 - 1000etcd: PUT - 100 - 1000 - Average Latencyetcd: PUT - 500 - 1000etcd: PUT - 500 - 1000 - Average Latencyetcd: RANGE - 50 - 100etcd: RANGE - 50 - 100 - Average Latencyetcd: RANGE - 100 - 100etcd: RANGE - 100 - 100 - Average Latencyetcd: RANGE - 50 - 1000etcd: RANGE - 50 - 1000 - Average Latencyetcd: RANGE - 500 - 100etcd: RANGE - 500 - 100 - Average Latencyetcd: RANGE - 100 - 1000etcd: RANGE - 100 - 1000 - Average Latencyetcd: RANGE - 500 - 1000etcd: RANGE - 500 - 1000 - Average Latencymnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUnatron: SpaceshipABCDE7.69814794.410091.165946825136416882907298420575100497.1960.37818.361272.578111.93957.35230093.38583.329893.43423.390351.73061129940.61613.385435.511111.666273.076814.730099.58133.326866.57593.790098.19951118991.52395.384607.343711.765917.241214.812.9782.0133.37920.1775.4213.5922.69827.8473.161258.342.371668.852.391659.89351.3311.375.74695.52437.739.13321.7812.4136.32110.01570.8128.01504.467.9210973.671.4415767.851.013.37.68214622.110039.265746325136316742897228235074832497.08160.62718.414272.358112.0657.31716614.8535616572.2801689723.131611.116446.37866.184546.061211.765970.609914.816178.2496.216165.59076.289816.41191116096.47416.284592.907211.765709.454114.813.0612.0063.37420.0645.5663.5712.69227.6083.161255.922.381661.532.421637.81343.8511.615.76693.784399.1321.1812.4336.04110.92572.4127.92503.247.9311065.961.4315826.0513.47.65314763.610074.165846125136416842897228329175045495.67460.5718.379272.803112.66657.3215974.85526.315915.46456.389853.1681115901.95266.384943.4311.665829.285214.815954.55576.316010.01466.289932.69441115859.12486.384946.785411.665751.575214.812.7981.9713.27920.3215.4013.5422.727.763.141271.042.391663.262.411641.56344.1511.65.77692.6439.429.09321.3812.4236.06110.84572.8427.91504.037.9211106.241.4315841.713.37.67514684.210053.465746225136316732897238409674994496.20460.4918.366272.489113.13157.61815721.31326.415687.98166.489674.361211.115561.35946.484669.789211.765753.482314.815613.65856.415511.56426.490539.59881115521.42516.484795.254411.765750.654614.813.0572.0143.3720.0695.5413.5082.6927.8253.131274.452.411645.12.421643.31344.2611.65.76693.83438.999.1321.9912.436.15110.55572.1927.94504.367.9211031.841.4415834.9313.47.64814626.610021.865346124936216662897208347374898496.36660.03918.387274.585112.59457.35315591.58356.415439.57776.572969.647113.715135.46516.662573.154616.052164.511418.813528.95827.413662.18317.357913.176817.512552.82918.055692.008418.147997.950620.512.8101.9723.31220.0325.3803.5062.68327.5273.141269.032.391654.292.391661.55340.8611.715.74696.40436.569.15320.4112.4635.75111.79569.2528.08503.157.9411013.081.4415751.271.013.3OpenBenchmarking.org

Unpacking The Linux Kernel

linux-5.19.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernel 5.19linux-5.19.tar.xzABCDE246810SE +/- 0.009, N = 47.6987.6827.6537.6757.648

C-Blosc

Test: blosclz shuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleABCDE3K6K9K12K15KSE +/- 39.75, N = 314794.414622.114763.614684.214626.61. (CC) gcc options: -std=gnu99 -O3 -lrt -lm

C-Blosc

Test: blosclz bitshuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleABCDE2K4K6K8K10KSE +/- 4.68, N = 310091.110039.210074.110053.410021.81. (CC) gcc options: -std=gnu99 -O3 -lrt -lm

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlABCDE140280420560700SE +/- 1.20, N = 36596576586576531. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateABCDE100200300400500SE +/- 0.33, N = 34684634614624611. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenABCDE50100150200250SE +/- 0.67, N = 32512512512512491. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedABCDE80160240320400SE +/- 0.33, N = 33643633643633621. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingABCDE400800120016002000SE +/- 3.67, N = 3168816741684167316661. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianABCDE60120180240300SE +/- 0.33, N = 32902892892892891. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceABCDE160320480640800SE +/- 0.58, N = 37297227227237201. (CC) gcc options: -fopenmp -O2 -ljbig -ltiff -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -llzma -lbz2 -lxml2 -lz -lm -lpthread

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingABCDE20K40K60K80K100KSE +/- 30.72, N = 384205823508329184096834731. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingABCDE16K32K48K64K80KSE +/- 23.02, N = 375100748327504574994748981. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To CompileABCDE110220330440550SE +/- 0.12, N = 3497.19497.08495.67496.20496.37

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 8.1.9Time To CompileABCDE1428425670SE +/- 0.22, N = 360.3860.6360.5760.4960.04

Timed CPython Compilation

Build Configuration: Default

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: DefaultABCDE51015202518.3618.4118.3818.3718.39

Timed CPython Compilation

Build Configuration: Released Build, PGO + LTO Optimized

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed CPython Compilation 3.10.6Build Configuration: Released Build, PGO + LTO OptimizedABCDE60120180240300272.58272.36272.80272.49274.59

Timed Erlang/OTP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Erlang/OTP Compilation 25.0Time To CompileABCDE306090120150SE +/- 0.20, N = 3111.94112.06112.67113.13112.59

Timed Wasmer Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Wasmer Compilation 2.3Time To CompileABCDE1326395265SE +/- 0.11, N = 357.3557.3257.3257.6257.351. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs

etcd

Test: PUT - Connections: 50 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 100ABCDE6K12K18K24K30KSE +/- 9.73, N = 330093.3916614.8515974.8615721.3115591.58

etcd

Test: PUT - Connections: 50 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 100 - Average LatencyABCDE246810SE +/- 0.00, N = 33.36.06.36.46.4

etcd

Test: PUT - Connections: 100 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100ABCDE6K12K18K24K30KSE +/- 18.08, N = 329893.4316572.2815915.4615687.9815439.58

etcd

Test: PUT - Connections: 100 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 100 - Average LatencyABCDE246810SE +/- 0.00, N = 33.36.06.36.46.5

etcd

Test: PUT - Connections: 50 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 1000ABCDE20K40K60K80K100KSE +/- 1306.71, N = 1590351.7389723.1389853.1789674.3672969.65

etcd

Test: PUT - Connections: 50 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 50 - Clients: 1000 - Average LatencyABCDE48121620SE +/- 0.21, N = 1511.011.111.011.113.7

etcd

Test: PUT - Connections: 500 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100ABCDE6K12K18K24K30KSE +/- 148.13, N = 629940.6216446.3815901.9515561.3615135.47

etcd

Test: PUT - Connections: 500 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 100 - Average LatencyABCDE246810SE +/- 0.07, N = 63.36.16.36.46.6

etcd

Test: PUT - Connections: 100 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000ABCDE20K40K60K80K100KSE +/- 1719.86, N = 1585435.5184546.0684943.4384669.7962573.15

etcd

Test: PUT - Connections: 100 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 100 - Clients: 1000 - Average LatencyABCDE48121620SE +/- 0.35, N = 1511.611.711.611.716.0

etcd

Test: PUT - Connections: 500 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000ABCDE14K28K42K56K70KSE +/- 625.45, N = 1566273.0865970.6165829.2965753.4852164.51

etcd

Test: PUT - Connections: 500 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: PUT - Connections: 500 - Clients: 1000 - Average LatencyABCDE510152025SE +/- 0.21, N = 1514.714.814.814.818.8

etcd

Test: RANGE - Connections: 50 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 100ABCDE6K12K18K24K30KSE +/- 119.86, N = 730099.5816178.2515954.5615613.6613528.96

etcd

Test: RANGE - Connections: 50 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 100 - Average LatencyABCDE246810SE +/- 0.07, N = 73.36.26.36.47.4

etcd

Test: RANGE - Connections: 100 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100ABCDE6K12K18K24K30KSE +/- 215.62, N = 926866.5816165.5916010.0115511.5613662.18

etcd

Test: RANGE - Connections: 100 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 100 - Average LatencyABCDE246810SE +/- 0.11, N = 93.76.26.26.47.3

etcd

Test: RANGE - Connections: 50 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 1000ABCDE20K40K60K80K100KSE +/- 2395.30, N = 1590098.2089816.4189932.6990539.6057913.18

etcd

Test: RANGE - Connections: 50 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 50 - Clients: 1000 - Average LatencyABCDE48121620SE +/- 0.51, N = 1511.011.011.011.017.5

etcd

Test: RANGE - Connections: 500 - Clients: 100

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100ABCDE4K8K12K16K20KSE +/- 112.68, N = 718991.5216096.4715859.1215521.4312552.83

etcd

Test: RANGE - Connections: 500 - Clients: 100 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 100 - Average LatencyABCDE246810SE +/- 0.08, N = 75.36.26.36.48.0

etcd

Test: RANGE - Connections: 100 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000ABCDE20K40K60K80K100KSE +/- 1989.42, N = 1584607.3484592.9184946.7984795.2555692.01

etcd

Test: RANGE - Connections: 100 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 100 - Clients: 1000 - Average LatencyABCDE48121620SE +/- 0.46, N = 1511.711.711.611.718.1

etcd

Test: RANGE - Connections: 500 - Clients: 1000

OpenBenchmarking.orgRequests/sec, More Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000ABCDE14K28K42K56K70KSE +/- 337.08, N = 1565917.2465709.4565751.5865750.6547997.95

etcd

Test: RANGE - Connections: 500 - Clients: 1000 - Average Latency

OpenBenchmarking.orgms, Fewer Is Betteretcd 3.5.4Test: RANGE - Connections: 500 - Clients: 1000 - Average LatencyABCDE510152025SE +/- 0.14, N = 1514.814.814.814.820.5

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetABCDE3691215SE +/- 0.02, N = 312.9813.0612.8013.0612.81MIN: 12.88 / MAX: 19.14MIN: 12.97 / MAX: 19.07MIN: 12.68 / MAX: 19.17MIN: 12.94 / MAX: 19.32MIN: 12.68 / MAX: 30.811. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3ABCDE0.45320.90641.35961.81282.266SE +/- 0.009, N = 32.0132.0061.9712.0141.972MIN: 1.99 / MAX: 3.11MIN: 1.98 / MAX: 2.75MIN: 1.94 / MAX: 3.07MIN: 1.99 / MAX: 2.25MIN: 1.93 / MAX: 3.061. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1ABCDE0.76031.52062.28093.04123.8015SE +/- 0.008, N = 33.3793.3743.2793.3703.312MIN: 3.34 / MAX: 4.37MIN: 3.33 / MAX: 4.48MIN: 3.24 / MAX: 4.29MIN: 3.32 / MAX: 4.47MIN: 3.26 / MAX: 4.421. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50ABCDE510152025SE +/- 0.07, N = 320.1820.0620.3220.0720.03MIN: 19.89 / MAX: 26.06MIN: 19.82 / MAX: 36.51MIN: 20.04 / MAX: 36.83MIN: 19.84 / MAX: 34.96MIN: 19.6 / MAX: 34.61. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0ABCDE1.25242.50483.75725.00966.262SE +/- 0.019, N = 35.4215.5665.4015.5415.380MIN: 5.35 / MAX: 21.72MIN: 5.51 / MAX: 6.67MIN: 5.35 / MAX: 6.22MIN: 5.49 / MAX: 6.76MIN: 5.3 / MAX: 6.521. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224ABCDE0.80821.61642.42463.23284.041SE +/- 0.022, N = 33.5923.5713.5423.5083.506MIN: 3.55 / MAX: 6.84MIN: 3.53 / MAX: 4.69MIN: 3.5 / MAX: 5.07MIN: 3.47 / MAX: 4.6MIN: 3.44 / MAX: 9.591. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0ABCDE0.60751.2151.82252.433.0375SE +/- 0.024, N = 32.6982.6922.7002.6902.683MIN: 2.66 / MAX: 3.73MIN: 2.65 / MAX: 3.77MIN: 2.66 / MAX: 3.68MIN: 2.65 / MAX: 3.76MIN: 2.61 / MAX: 3.751. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3ABCDE714212835SE +/- 0.09, N = 327.8527.6127.7627.8327.53MIN: 27.42 / MAX: 33.72MIN: 27.19 / MAX: 34.67MIN: 27.3 / MAX: 72.79MIN: 27.33 / MAX: 33.14MIN: 27.08 / MAX: 47.121. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUABCDE0.7111.4222.1332.8443.555SE +/- 0.00, N = 33.163.163.143.133.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUABCDE30060090012001500SE +/- 1.95, N = 31258.341255.921271.041274.451269.03MIN: 1201.93 / MAX: 1341.23MIN: 1206.49 / MAX: 1356.42MIN: 1241.13 / MAX: 1380.49MIN: 1226.87 / MAX: 1355.68MIN: 1210.75 / MAX: 1378.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUABCDE0.54231.08461.62692.16922.7115SE +/- 0.01, N = 32.372.382.392.412.391. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUABCDE400800120016002000SE +/- 9.27, N = 31668.851661.531663.261645.101654.29MIN: 1447.91 / MAX: 1780.07MIN: 1480.92 / MAX: 1803.33MIN: 1482.48 / MAX: 1805.04MIN: 1489.68 / MAX: 1839.49MIN: 1481.86 / MAX: 1868.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUABCDE0.54451.0891.63352.1782.7225SE +/- 0.02, N = 32.392.422.412.422.391. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUABCDE400800120016002000SE +/- 11.54, N = 31659.891637.811641.561643.311661.55MIN: 1461.24 / MAX: 1823.91MIN: 1490.45 / MAX: 1850.31MIN: 1477.93 / MAX: 1797.33MIN: 1495.03 / MAX: 1843.12MIN: 1464.72 / MAX: 1861.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUABCDE80160240320400SE +/- 2.43, N = 3351.33343.85344.15344.26340.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUABCDE3691215SE +/- 0.08, N = 311.3711.6111.6011.6011.71MIN: 10.52 / MAX: 21.67MIN: 10.6 / MAX: 28.3MIN: 10.53 / MAX: 23.08MIN: 10.66 / MAX: 22.12MIN: 10.26 / MAX: 21.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUABCDE1.29832.59663.89495.19326.4915SE +/- 0.00, N = 35.745.765.775.765.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUABCDE150300450600750SE +/- 0.32, N = 3695.52693.78692.60693.83696.40MIN: 691.3 / MAX: 708.41MIN: 686.88 / MAX: 717.7MIN: 686.95 / MAX: 699.35MIN: 684.96 / MAX: 701.04MIN: 688.69 / MAX: 721.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUABCDE100200300400500SE +/- 0.31, N = 3437.73439.00439.42438.99436.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUABCDE3691215SE +/- 0.01, N = 39.139.109.099.109.15MIN: 8.85 / MAX: 16.16MIN: 8.83 / MAX: 15.74MIN: 8.83 / MAX: 25.56MIN: 8.85 / MAX: 25.66MIN: 8.87 / MAX: 26.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUABCDE70140210280350SE +/- 0.08, N = 3321.78321.18321.38321.99320.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUABCDE3691215SE +/- 0.00, N = 312.4112.4312.4212.4012.46MIN: 10.44 / MAX: 22.3MIN: 10.42 / MAX: 17.91MIN: 10.48 / MAX: 15.98MIN: 10.39 / MAX: 18.88MIN: 10.39 / MAX: 27.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUABCDE816243240SE +/- 0.10, N = 336.3236.0436.0636.1535.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUABCDE306090120150SE +/- 0.33, N = 3110.01110.92110.84110.55111.79MIN: 85.11 / MAX: 135.51MIN: 92.03 / MAX: 133.28MIN: 84.72 / MAX: 133.04MIN: 89.56 / MAX: 138.28MIN: 86.68 / MAX: 133.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUABCDE120240360480600SE +/- 0.37, N = 3570.81572.41572.84572.19569.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUABCDE714212835SE +/- 0.02, N = 328.0127.9227.9127.9428.08MIN: 27.19 / MAX: 33.76MIN: 27.09 / MAX: 44.07MIN: 27.1 / MAX: 34.12MIN: 27.08 / MAX: 44.05MIN: 27.25 / MAX: 44.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUABCDE110220330440550SE +/- 0.63, N = 3504.46503.24504.03504.36503.151. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUABCDE246810SE +/- 0.01, N = 37.927.937.927.927.94MIN: 7.59 / MAX: 24.31MIN: 7.45 / MAX: 12.66MIN: 7.6 / MAX: 12.54MIN: 7.52 / MAX: 15.54MIN: 7.58 / MAX: 38.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUABCDE2K4K6K8K10KSE +/- 33.81, N = 310973.6711065.9611106.2411031.8411013.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUABCDE0.3240.6480.9721.2961.62SE +/- 0.00, N = 31.441.431.431.441.44MIN: 1.23 / MAX: 17.9MIN: 1.27 / MAX: 18.12MIN: 1.25 / MAX: 17.38MIN: 1.27 / MAX: 18.07MIN: 1.26 / MAX: 17.81. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUABCDE3K6K9K12K15KSE +/- 1.59, N = 315767.8515826.0515841.7015834.9315751.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUABCDE0.22730.45460.68190.90921.1365SE +/- 0.00, N = 31.011.001.001.001.01MIN: 0.95 / MAX: 7.42MIN: 0.95 / MAX: 7.42MIN: 0.95 / MAX: 7.16MIN: 0.95 / MAX: 5.25MIN: 0.95 / MAX: 17.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -flto -shared

Natron

Input: Spaceship

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipABCDE0.7651.532.2953.063.825SE +/- 0.06, N = 123.33.43.33.43.3


Phoronix Test Suite v10.8.4