OpenVINO AMX Benchmarks

Benchmarks by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301160-NE-OPENVINOA07
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
AVX512_CORE_AMX
January 16 2023
  28 Minutes
AVX512_CORE_FP16
January 16 2023
  26 Minutes
AVX512_CORE_BF16
January 16 2023
  26 Minutes
AVX512_CORE_VNNI
January 16 2023
  26 Minutes
AVX512_CORE
January 16 2023
  26 Minutes
Invert Hiding All Results Option
  27 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "OpenVINO AMX Benchmarks", "last_modified": "2023-01-16 12:41:07", "description": "Benchmarks by Michael Larabel for a future article.", "systems": { "AVX512_CORE_AMX": { "identifier": "AVX512_CORE_AMX", "hardware": { "Processor": "2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores \/ 240 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)", "Chipset": "Intel Device 1bce", "Memory": "16 x 64 GB 4800MT\/s Samsung M321R8GA0BB0-CQKEG", "Disk": "2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96", "Graphics": "ASPEED", "Monitor": "VGA HDMI", "Network": "4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.1.4-060104-generic (x86_64)", "Desktop": "GNOME Shell 42.2", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.2.204", "Compiler": "GCC 11.3.0 + Clang 14.0.0-1ubuntu1", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "root", "timestamp": "2023-01-16 10:56:02", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x2b0000c0", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "AVX512_CORE_FP16": { "identifier": "AVX512_CORE_FP16", "hardware": { "Processor": "2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores \/ 240 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)", "Chipset": "Intel Device 1bce", "Memory": "16 x 64 GB 4800MT\/s Samsung M321R8GA0BB0-CQKEG", "Disk": "2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96", "Graphics": "ASPEED", "Monitor": "VGA HDMI", "Network": "4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.1.4-060104-generic (x86_64)", "Desktop": "GNOME Shell 42.2", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.2.204", "Compiler": "GCC 11.3.0 + Clang 14.0.0-1ubuntu1", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "root", "timestamp": "2023-01-16 11:18:56", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x2b0000c0", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "AVX512_CORE_BF16": { "identifier": "AVX512_CORE_BF16", "hardware": { "Processor": "2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores \/ 240 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)", "Chipset": "Intel Device 1bce", "Memory": "16 x 64 GB 4800MT\/s Samsung M321R8GA0BB0-CQKEG", "Disk": "2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96", "Graphics": "ASPEED", "Monitor": "VGA HDMI", "Network": "4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.1.4-060104-generic (x86_64)", "Desktop": "GNOME Shell 42.2", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.2.204", "Compiler": "GCC 11.3.0 + Clang 14.0.0-1ubuntu1", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "root", "timestamp": "2023-01-16 11:55:11", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x2b0000c0", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "AVX512_CORE_VNNI": { "identifier": "AVX512_CORE_VNNI", "hardware": { "Processor": "2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores \/ 240 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)", "Chipset": "Intel Device 1bce", "Memory": "16 x 64 GB 4800MT\/s Samsung M321R8GA0BB0-CQKEG", "Disk": "2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96", "Graphics": "ASPEED", "Monitor": "VGA HDMI", "Network": "4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.1.4-060104-generic (x86_64)", "Desktop": "GNOME Shell 42.2", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.2.204", "Compiler": "GCC 11.3.0 + Clang 14.0.0-1ubuntu1", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "root", "timestamp": "2023-01-16 12:10:04", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x2b0000c0", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "AVX512_CORE": { "identifier": "AVX512_CORE", "hardware": { "Processor": "2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores \/ 240 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS)", "Chipset": "Intel Device 1bce", "Memory": "16 x 64 GB 4800MT\/s Samsung M321R8GA0BB0-CQKEG", "Disk": "2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96", "Graphics": "ASPEED", "Monitor": "VGA HDMI", "Network": "4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.1.4-060104-generic (x86_64)", "Desktop": "GNOME Shell 42.2", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.2.204", "Compiler": "GCC 11.3.0 + Clang 14.0.0-1ubuntu1", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "root", "timestamp": "2023-01-16 12:25:54", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x2b0000c0", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "8dddb6db49604b765f0f59b7ac941cbca1a9bcb7": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/face-detection-0206\/FP16-INT8\/face-detection-0206.xml -d CPU", "description": "Model: Face Detection FP16-INT8 - Device: CPU", "scale": "FPS", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 282.25, "raw_values": [ 279.92000000000001591615728102624416351318359375, 279.45999999999997953636921010911464691162109375, 287.3600000000000136424205265939235687255859375 ], "test_run_times": [ 77.340000000000003410605131648480892181396484375, 77.2099999999999937472239253111183643341064453125, 77.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 146.080000000000012505552149377763271331787109375, "raw_values": [ 145.5, 146.349999999999994315658113919198513031005859375, 146.3799999999999954525264911353588104248046875 ], "test_run_times": [ 67.8299999999999982946974341757595539093017578125, 67.93000000000000682121026329696178436279296875, 67.9200000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 146.06000000000000227373675443232059478759765625, "raw_values": [ 146.31999999999999317878973670303821563720703125, 145.6200000000000045474735088646411895751953125, 146.25 ], "test_run_times": [ 67.8700000000000045474735088646411895751953125, 67.7600000000000051159076974727213382720947265625, 67.7399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 146.020000000000010231815394945442676544189453125, "raw_values": [ 146.599999999999994315658113919198513031005859375, 145.8899999999999863575794734060764312744140625, 145.580000000000012505552149377763271331787109375 ], "test_run_times": [ 67.6700000000000017053025658242404460906982421875, 67.6299999999999954525264911353588104248046875, 67.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 63.21000000000000085265128291212022304534912109375, "raw_values": [ 63.25999999999999801048033987171947956085205078125, 63.159999999999996589394868351519107818603515625, 63.2000000000000028421709430404007434844970703125 ], "test_run_times": [ 67.43999999999999772626324556767940521240234375, 67.4599999999999937472239253111183643341064453125, 68.4200000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "74d32952360b251fd74e5f1e8b147eb5e5a2b1c3": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/weld-porosity-detection-0001\/FP16-INT8\/weld-porosity-detection-0001.xml -d CPU", "description": "Model: Weld Porosity Detection FP16-INT8 - Device: CPU", "scale": "FPS", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 23066.63000000000101863406598567962646484375, "raw_values": [ 23199.139999999999417923390865325927734375, 23111.68999999999869032762944698333740234375, 22889.04999999999927240423858165740966796875 ], "test_run_times": [ 61.82000000000000028421709430404007434844970703125, 61.85000000000000142108547152020037174224853515625, 61.8299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 8897.100000000000363797880709171295166015625, "raw_values": [ 8945.559999999999490682967007160186767578125, 8866.780000000000654836185276508331298828125, 8878.969999999999345163814723491668701171875 ], "test_run_times": [ 61.280000000000001136868377216160297393798828125, 61.32000000000000028421709430404007434844970703125, 61.27000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 8918.620000000000800355337560176849365234375, "raw_values": [ 9089.190000000000509317032992839813232421875, 8823.84000000000014551915228366851806640625, 8842.84000000000014551915228366851806640625 ], "test_run_times": [ 61.28999999999999914734871708787977695465087890625, 61.28999999999999914734871708787977695465087890625, 61.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 8909.04999999999927240423858165740966796875, "raw_values": [ 9010.780000000000654836185276508331298828125, 8878.639999999999417923390865325927734375, 8837.739999999999781721271574497222900390625 ], "test_run_times": [ 61.27000000000000312638803734444081783294677734375, 61.28999999999999914734871708787977695465087890625, 61.32000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 5835.3900000000003274180926382541656494140625, "raw_values": [ 5953.59000000000014551915228366851806640625, 5687.6199999999998908606357872486114501953125, 5864.9700000000002546585164964199066162109375 ], "test_run_times": [ 60.96000000000000085265128291212022304534912109375, 60.969999999999998863131622783839702606201171875, 60.97999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "685fdd06b4fc46e92f964685aa409454c46b0d47": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/person-vehicle-bike-detection-2004\/FP16\/person-vehicle-bike-detection-2004.xml -d CPU", "description": "Model: Person Vehicle Bike Detection FP16 - Device: CPU", "scale": "FPS", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 4778.34000000000014551915228366851806640625, "raw_values": [ 4805.850000000000363797880709171295166015625, 4773.350000000000363797880709171295166015625, 4755.829999999999927240423858165740966796875 ], "test_run_times": [ 67.8799999999999954525264911353588104248046875, 67.8599999999999994315658113919198513031005859375, 67.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 2730.07000000000016370904631912708282470703125, "raw_values": [ 2750.420000000000072759576141834259033203125, 2727.8699999999998908606357872486114501953125, 2711.920000000000072759576141834259033203125 ], "test_run_times": [ 63.75, 63.75, 63.75999999999999801048033987171947956085205078125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 2767.15999999999985448084771633148193359375, "raw_values": [ 2734.01999999999998181010596454143524169921875, 2781.40999999999985448084771633148193359375, 2786.0500000000001818989403545856475830078125 ], "test_run_times": [ 63.8299999999999982946974341757595539093017578125, 63.75999999999999801048033987171947956085205078125, 63.77000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 1821.089999999999918145476840436458587646484375, "raw_values": [ 1830.80999999999994543031789362430572509765625, 1806.700000000000045474735088646411895751953125, 1825.759999999999990905052982270717620849609375 ], "test_run_times": [ 63.93999999999999772626324556767940521240234375, 64, 64.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 1820.26999999999998181010596454143524169921875, "raw_values": [ 1836.65000000000009094947017729282379150390625, 1817, 1807.15000000000009094947017729282379150390625 ], "test_run_times": [ 64, 63.96000000000000085265128291212022304534912109375, 64.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "42827eddeb97352c3142665b56da35f9c89680a1": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/machine-translation-nar-en-de-0002\/FP16\/machine-translation-nar-en-de-0002.xml -d CPU", "description": "Model: Machine Translation EN To DE FP16 - Device: CPU", "scale": "FPS", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 724.1000000000000227373675443232059478759765625, "raw_values": [ 726.700000000000045474735088646411895751953125, 731.529999999999972715158946812152862548828125, 714.05999999999994543031789362430572509765625 ], "test_run_times": [ 64.18999999999999772626324556767940521240234375, 64.2000000000000028421709430404007434844970703125, 64.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 321.279999999999972715158946812152862548828125, "raw_values": [ 321.20999999999997953636921010911464691162109375, 319.990000000000009094947017729282379150390625, 322.6499999999999772626324556767940521240234375 ], "test_run_times": [ 64.469999999999998863131622783839702606201171875, 64.3299999999999982946974341757595539093017578125, 64.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 314.6100000000000136424205265939235687255859375, "raw_values": [ 318.029999999999972715158946812152862548828125, 308.56999999999999317878973670303821563720703125, 317.220000000000027284841053187847137451171875 ], "test_run_times": [ 64.280000000000001136868377216160297393798828125, 64.409999999999996589394868351519107818603515625, 64.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 387.6200000000000045474735088646411895751953125, "raw_values": [ 391.8999999999999772626324556767940521240234375, 387.69999999999998863131622783839702606201171875, 383.259999999999990905052982270717620849609375 ], "test_run_times": [ 64.56000000000000227373675443232059478759765625, 64.469999999999998863131622783839702606201171875, 64.409999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 378.720000000000027284841053187847137451171875, "raw_values": [ 387.31000000000000227373675443232059478759765625, 369.1200000000000045474735088646411895751953125, 379.73000000000001818989403545856475830078125 ], "test_run_times": [ 64.5100000000000051159076974727213382720947265625, 65.43999999999999772626324556767940521240234375, 64.3299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "0218bdef2f6e8c0206f00aac91e233aee78e5f79": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Peak Freq (Highest CPU Core Frequency) -m models\/intel\/face-detection-0206\/FP16-INT8\/face-detection-0206.xml -d CPU", "description": "CPU Peak Freq (Highest CPU Core Frequency) Monitor", "scale": "Megahertz", "proportion": "HIB", "display_format": "LINE_GRAPH", "parent": "61b589db5aad42010567809d699fd1abd0e1a9bf", "results": { "AVX512_CORE_AMX": { "value": "3501,3500,3500,3500,3500,3500,3500,3500,3500,3493,3400,3389,3400,3491,2897,2348,2648,2886,2512,2497,2600,2163,2360,2400,2300,2300,2300,2300,2273,2300,2176,2300,2284,2300,2275,2300,2299,2200,2290,2200,2300,2145,2200,2131,2200,2199,2200,2200,2200,2167,2195,2200,2200,2200,2100,2200,2200,2200,2200,2200,2197,2158,2200,2200,2200,2298,2200,2200,2200,2200,2300,2300,2200,2194,3500,3500,3500,3500,3503,3500,3500,1900,3259,1900,1900,3500,3500,3500,3400,3403,3469,3458,3396,3402,3397,2416,2346,2678,2811,2403,2259,2597,2495,2300,2499,2304,2200,2400,2300,2399,2300,2300,2294,2300,2144,2400,2200,2200,2200,2200,2300,2200,2300,2200,2300,2200,2200,2142,2200,2200,2300,2300,2176,2174,2139,2200,2200,2200,2150,2200,2100,2200,2200,2200,2162,2200,2186,2200,2200,2179,2200,2200,2200,2189,2200,3500,3500,3506,3500,3500,3500,3477,1900,3501,3500,3500,3501,3500,3489,3507,3492,3492,3496,3398,3477,3500,2894,2271,2400,2696,2237,2404,2358,2300,2300,2307,2300,2300,2300,2300,2199,2300,2300,2299,2200,2200,2200,2200,2300,2200,2267,2200,2300,2179,2300,2223,2300,2200,2300,2206,2291,2200,2237,2300,2300,2200,2300,2300,2200,2200,2200,2197,2200,2200,2200,2274,2166,2200,2200,2200,2200,2156,2200,2200,2200,3189,3502,3500,3500,3500,3500,3502,3500" }, "AVX512_CORE_FP16": { "value": "3500,1900,3501,3501,3500,3500,3501,3500,3487,2272,2543,2100,2370,2200,2900,2358,2200,2383,2200,2200,2200,2200,2200,2200,2200,2200,2158,2200,2200,2196,2200,2200,2190,2200,2131,2200,2200,2200,2181,2200,2200,2200,2199,2200,2200,2200,2168,2200,2200,2200,2200,2200,2200,2200,2162,2200,2200,2200,2200,2200,2199,2200,2200,2200,2200,2200,2203,2200,2200,3502,3500,3500,1900,3500,1900,1900,3500,3500,3500,3500,2752,2215,2111,2200,2127,2192,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2333,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2429,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2190,2200,2186,2200,2200,3500,3500,3500,1900,1900,3500,3500,3500,3500,3508,3500,3500,2272,2300,2200,2100,2200,2398,2200,1231,2100,2200,2200,2200,2100,2200,2171,2200,2200,2200,2200,2200,2200,2200,2200,2200,2169,2200,2197,2188,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2300,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2191,2200,2200,2200,2200,2200,2600,3500,3502,3500" }, "AVX512_CORE_BF16": { "value": "3500,3500,3500,1900,3501,3500,3488,3501,3451,2437,2400,2200,2200,2193,2200,2200,2700,2181,2100,2900,2200,2200,2200,2200,2199,2200,2198,2200,2137,2200,2200,2200,2200,2200,2116,2200,2196,2200,2200,2200,2200,2200,2200,2200,2182,2200,2200,2200,2200,2200,2200,2201,2198,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,3500,3500,3501,3500,1900,3501,3500,3501,3500,3500,3500,2483,2900,1973,2346,2200,2200,2536,2200,2200,2148,2135,2182,2168,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2184,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2195,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2190,3500,3500,3500,3456,3501,3501,1900,3500,3497,3505,3500,2534,2309,2300,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2000,2200,2198,2165,2118,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2199,2200,2200,2200,2200,2200,2200,2200,2200,2200,3500,3501,3503,3500" }, "AVX512_CORE_VNNI": { "value": "3500,1900,3502,3500,3500,3500,3500,3500,3499,2232,2261,2200,2200,2200,2200,2200,2200,2200,2700,2100,2200,2200,2139,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2181,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2129,2300,2200,2200,2200,2200,2200,2200,2200,2200,3500,3500,2909,3500,1900,3500,3501,3500,3500,3500,3500,2371,2159,2228,1126,2100,2200,2100,2200,2136,2200,2200,2200,2200,2572,2200,2200,2200,2200,2200,2200,2200,2190,2200,2200,2200,2200,2200,2200,2200,2200,2200,2118,2200,2168,2200,2200,2180,2200,2146,2200,2200,2184,2200,2200,2200,2200,2200,2194,2200,2200,2200,2200,2166,2200,2194,2200,2200,2200,2200,2200,3500,3500,3512,3500,3499,3500,1900,3500,3493,3500,3500,2344,2325,2286,2200,2200,2200,2900,2100,2200,2200,2200,2100,2200,2900,2200,2900,2200,2200,2201,2200,2132,2200,2200,2200,2200,2102,2200,2200,2200,2200,2200,2188,2200,2200,2200,2143,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,2200,3500,3500,3500,3512" }, "AVX512_CORE": { "value": "3501,3500,3500,1900,3501,3500,3501,3500,3500,2706,2678,2500,2500,2500,2444,2500,2500,2500,2500,2500,2500,2400,2400,2438,2500,2500,2455,2500,2500,2480,2500,2488,2500,2500,2400,2400,2500,2500,2500,2436,2500,2500,2500,2500,2500,2500,2489,2500,2500,2400,2501,2478,2500,2500,2500,2500,2500,2499,2500,2500,2499,2461,2500,2496,2477,2500,2500,2498,3500,3500,3500,3279,3027,3500,3500,3507,3501,3500,3500,3328,2900,2700,2500,2208,2446,2500,2451,2498,2500,2427,2400,2400,2500,2500,2455,2500,2500,2500,2498,2500,2500,2500,2423,2434,2400,2493,2475,2500,2500,2500,2500,2500,2500,2500,2486,2500,2500,2487,2500,2500,2500,2471,2500,2496,2499,2500,2500,2500,2500,2495,2500,2500,2400,2500,2500,2494,2500,2500,2403,3500,3500,3500,2909,3500,3500,3500,3500,3482,3496,3500,3500,2700,2600,2500,2500,2487,2500,2500,2500,2436,2400,2400,2402,2421,2500,2500,2500,2479,2509,2500,2500,2435,2476,2500,2496,2400,2400,2500,2500,2484,2500,2668,2474,2500,2500,2500,2500,2448,2500,2413,2438,2500,2500,2500,2480,2500,2500,2494,2500,2500,2500,2500,2500,2476,2500,2500,2433,2500,2450,2500,2500,3500,3500,3515,3513" } } }, "cfcbd995dfa0941a17f33d254586f4e283389b22": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Peak Freq (Highest CPU Core Frequency) -m models\/intel\/weld-porosity-detection-0001\/FP16-INT8\/weld-porosity-detection-0001.xml -d CPU", "description": "CPU Peak Freq (Highest CPU Core Frequency) Monitor", "scale": "Megahertz", "proportion": "HIB", "display_format": "LINE_GRAPH", "parent": "9fb2dbd336b6ecf44756df5e51a5e021c87b0a75", "results": { "AVX512_CORE_AMX": { "value": "1900,3500,1900,3500,3500,2880,2769,2838,2580,2895,2893,2792,2640,2875,2873,2883,2860,2837,2876,2884,2879,2629,2878,2886,2874,2887,2890,2873,2635,2874,2842,2896,2885,2724,2881,2678,2729,2881,2882,2868,2884,2886,2894,2888,2795,2887,2889,2809,2893,2884,2620,2871,2889,2881,2877,2627,2888,2889,2527,2860,2884,2884,2867,2878,2824,3500,3490,3500,3500,3500,3494,2653,2832,2867,2790,2876,2880,2877,2592,2893,2895,2349,2888,2885,2553,2884,2887,2892,2883,2862,2890,2370,2886,2819,2880,2889,2882,2892,2886,2891,2882,2773,2896,2451,2863,2871,2374,2768,2612,2849,2886,2900,2894,2887,2891,2871,2887,2485,2872,2891,2598,2883,2752,2796,2894,2884,2756,2894,2871,2775,2850,3500,3368,3501,3500,3501,2668,2886,2824,2592,2886,2886,2898,2890,2886,2893,2877,2889,2888,2885,2891,2886,2881,2884,2885,2893,2703,2894,2823,2766,2483,2793,2886,2884,2892,2886,2892,2885,2889,2876,2801,2885,2368,2893,2880,2635,2884,2890,2324,2893,2886,2741,2855,2835,2885,2885,2886,2611,2888,2819,2861,2885,2877,2867,2634,2425,3500" }, "AVX512_CORE_FP16": { "value": "3497,3500,3488,1900,3477,2097,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2400,2900,2900,2904,2900,2900,2900,2900,2900,2900,2900,2900,2900,2903,2900,2900,2900,2900,2800,2902,2900,2900,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2800,2901,3512,3500,3501,3500,3500,3495,2900,2900,2900,2901,2901,2900,2901,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2902,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2901,2901,2900,2900,2900,2900,2900,2905,2900,2900,2900,2900,2900,2900,3500,3485,1900,3500,3501,3499,2900,2900,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2700,2900,2901,2902,2900,2900,2500,2900,2900,2900,2900,2897,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2899,2900,2900,2900,2901,2900,2900,2900,2900,2900,2903,2900,2900,2900,2901,2800,2900,2900,2900,2901,2900,2900,2900,2900,2900,3500" }, "AVX512_CORE_BF16": { "value": "3500,3501,1900,3512,2696,2326,2470,2900,2900,2801,2901,2900,2902,2900,2603,2903,2900,2900,2900,2900,2900,2901,2900,2900,2900,2902,2900,2900,2900,2700,2900,2902,2900,2901,2900,2900,2900,2900,2900,2664,2900,2900,2900,2900,2901,2900,2900,2900,2700,2900,2700,2890,2900,2900,2901,2679,2900,2900,2900,2900,2900,2900,2900,2900,3500,3500,3500,1900,1900,2267,2862,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2902,2900,2901,2903,2900,2900,2900,2900,2900,3500,3500,3500,3500,1900,2330,2900,2900,2900,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2901,2900,2900,2900,2900,2901,2900,2900,2902,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,3002" }, "AVX512_CORE_VNNI": { "value": "3501,1900,3506,3500,3507,2327,2900,2901,2900,2900,2900,2901,2900,2900,2800,2900,2900,2900,2900,2900,2900,2900,2902,2901,2900,2900,2800,2900,2900,2800,2900,2900,2900,2899,2902,2900,2901,2900,2900,2900,2900,2500,2900,2900,2900,2900,2453,2900,2900,2900,2900,2900,2900,2900,2901,2900,2900,2900,2900,2901,2900,2900,2900,2900,2700,3509,1900,1900,1900,3500,2300,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2901,2900,2900,2900,2900,2901,2900,2900,2900,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2901,2900,2902,2900,2900,2900,2900,2900,2902,2901,2901,2900,2900,2900,2900,2900,2900,2900,2900,2900,2903,2900,2900,2900,2901,2900,2901,3511,3510,3500,3501,3499,2900,2900,2902,2900,2900,2900,2900,2900,2901,2800,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2900,2902,2900,2900,2900,2900,2900,2902,2900,2903,2900,2900,2900,2900,2900,2900,2900,2902,2900,2900,2900,2900,2900,2900,2900,2902,2902,2900,2900,2904,3510" }, "AVX512_CORE": { "value": "3500,3501,3502,3500,2513,2600,2600,2500,2500,2500,2900,2500,2900,2900,2405,2474,2500,2500,2900,2643,2900,2437,2500,2500,2500,2400,2900,2500,2900,2500,2774,2900,2900,2900,2900,2508,2500,2649,2500,2900,2400,2500,2900,2500,2704,2500,2500,2400,2900,2900,2500,2900,2775,2500,2500,2900,2500,2800,2500,2500,2500,2500,2500,2465,3503,3500,3500,1900,3500,2485,2633,2900,2900,2900,2631,2900,2658,2500,2600,2400,2901,2900,2900,2659,2500,2500,2500,2400,2500,2500,2500,2900,2500,2498,2500,2900,2900,2500,2900,2901,2500,2900,2400,2500,2525,2465,2900,2900,2900,2901,2500,2580,2500,2500,2900,2900,2400,2500,2484,2500,2900,2500,2900,2900,2900,2500,2500,2654,3500,1900,1900,3500,3500,2500,2700,2800,2400,2400,2596,2500,2400,2500,2483,2688,2400,2500,2500,2500,2500,2900,2900,2700,2500,2900,2900,2900,2571,2500,2400,2600,2500,2500,2900,2900,2900,2400,2500,2500,2630,2500,2400,2500,2900,2500,2400,2440,2500,2900,2500,2500,2500,2500,2500,2500,2900,2900,2900,2500,2900,2500,2900,2900,2500" } } }, "39237e32b87f1ffb2056f9158f8797a3a85e67c6": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Peak Freq (Highest CPU Core Frequency) -m models\/intel\/person-vehicle-bike-detection-2004\/FP16\/person-vehicle-bike-detection-2004.xml -d CPU", "description": "CPU Peak Freq (Highest CPU Core Frequency) Monitor", "scale": "Megahertz", "proportion": "HIB", "display_format": "LINE_GRAPH", "parent": "837eb56d12e5c5271e059c1a290c3be29289be36", "results": { "AVX512_CORE_AMX": { "value": "3500,3500,3500,3500,3500,3500,3500,3322,2912,2889,2897,2886,2890,2897,2888,2894,2891,2887,2890,2892,2887,2896,2889,2886,2891,2887,2887,2899,2891,2886,2893,2900,2889,2896,2890,2892,2897,2895,2888,2893,2888,2894,2897,2893,2896,2887,2887,2893,2897,2892,2889,2893,2895,2898,2893,2889,2890,2893,2889,2880,2891,2853,2893,2896,2886,2893,2892,2891,3500,3500,3500,3501,3500,3500,3500,3500,3496,3437,3400,3395,2879,2881,2890,2891,2890,2896,2885,2891,2896,2886,2894,2892,2889,2896,2889,2887,2890,2900,2890,2893,2892,2863,2887,2893,2895,2896,2894,2896,2891,2900,2893,2895,2894,2896,2890,2894,2894,2891,2894,2891,2889,2894,2889,2896,2897,2889,2893,2894,2899,2894,2888,2894,2893,2896,2891,2893,2896,2895,2892,2891,3501,3500,3500,1900,3500,1900,1900,3500,3500,3485,3300,2889,2889,2898,2888,2897,2897,2888,2884,2886,2889,2891,2894,2899,2896,2898,2894,2885,2892,2896,2897,2896,2894,2900,2887,2895,2889,2891,2894,2887,2885,2894,2884,2900,2900,2888,2895,2882,2894,2892,2891,2899,2894,2893,2890,2894,2892,2889,2898,2884,2895,2892,2892,2891,2892,2892,2899,2896,2898,2890,2894,3500,3500,3500,3501" }, "AVX512_CORE_FP16": { "value": "3500,3501,3506,3500,3500,3429,2747,2538,2865,2576,2512,2894,2899,2547,2512,2900,2887,2897,2524,2554,2710,2607,2889,2744,2900,2529,2556,2541,2539,2899,2538,2545,2899,2899,2749,2537,2766,2900,2565,2610,2586,2524,2882,2556,2895,2462,2584,2516,2550,2894,2658,2886,2565,2561,2543,2579,2534,2856,2681,2697,2593,2708,2516,2584,2900,2897,3500,3366,1900,3500,3500,3500,3500,2832,2516,2598,2535,2890,2606,2899,2888,2527,2898,2761,2550,2540,2566,2530,2899,2604,2668,2880,2540,2605,2557,2478,2705,2535,2876,2590,2553,2775,2900,2899,2515,2561,2554,2561,2536,2507,2512,2657,2524,2817,2653,2605,2517,2706,2582,2897,2513,2589,2891,2703,2726,2601,2487,2677,2889,2783,2579,2539,2566,3500,2904,3402,1900,3500,3476,3503,3498,2502,2765,2619,2586,2788,2523,2887,2586,2509,2712,2891,2551,2557,2585,2869,2894,2549,2886,2719,2547,2551,2567,2892,2582,2766,2563,2533,2630,2521,2560,2587,2547,2534,2483,2541,2520,2528,2547,2436,2477,2816,2667,2885,2523,2715,2625,2534,2894,2551,2544,2500,2852,2542,2633,2856,2725,2895,2893,2889,3511,3500" }, "AVX512_CORE_BF16": { "value": "1900,3501,3501,3500,3501,3457,2513,2563,2894,2509,2807,2757,2894,2472,2518,2583,2519,2893,2898,2519,2887,2692,2889,2645,2551,2771,2629,2893,2560,2615,2860,2493,2539,2768,2851,2785,2552,2820,2514,2571,2538,2653,2893,2880,2893,2670,2535,2895,2530,2895,2684,2514,2894,2560,2523,2733,2496,2527,2898,2550,2572,2557,2890,2495,2712,2526,3500,3500,3500,3500,3500,3500,3500,3222,2511,2549,2612,2798,2532,2814,2539,2597,2882,2527,2706,2514,2824,2656,2552,2550,2532,2606,2474,2529,2547,2601,2899,2639,2738,2894,2896,2566,2900,2563,2892,2897,2599,2879,2522,2592,2625,2900,2839,2573,2528,2518,2584,2900,2671,2634,2845,2628,2893,2569,2554,2569,2491,2541,2812,2590,2531,2528,2900,3500,3500,3358,3500,3501,3500,3487,3371,2777,2568,2514,2588,2555,2799,2899,2834,2671,2675,2513,2754,2591,2523,2542,2483,2550,2894,2513,2622,2836,2572,2532,2636,2554,2595,2534,2886,2741,2506,2524,2598,2542,2613,2489,2629,2589,2573,2892,2526,2601,2898,2581,2557,2548,2577,2897,2793,2660,2553,2823,2900,2897,2734,2593,2556,2770,2884,2555,2899,3500,3513" }, "AVX512_CORE_VNNI": { "value": "1900,3500,1900,3497,3503,3246,2855,2764,2900,2899,2880,2893,2892,2897,2890,2877,2885,2889,2885,2893,2873,2875,2885,2887,2889,2862,2890,2878,2888,2865,2886,2890,2892,2890,2895,2889,2831,2800,2889,2875,2885,2882,2847,2739,2889,2888,2894,2896,2844,2885,2889,2880,2887,2810,2889,2879,2864,2889,2871,2886,2896,2871,2853,2889,2889,2855,3500,3501,3501,3501,3501,3508,3500,3503,2876,2881,2896,2889,2880,2891,2881,2892,2890,2889,2889,2876,2888,2896,2839,2859,2892,2892,2844,2894,2883,2892,2886,2886,2886,2819,2892,2843,2784,2878,2881,2897,2872,2817,2833,2890,2876,2894,2896,2895,2896,2881,2860,2895,2880,2883,2895,2881,2892,2876,2880,2898,2886,2891,2843,2889,2887,2884,2855,3500,3501,3478,3502,3500,3500,3500,3500,2891,2891,2846,2891,2890,2891,2859,2893,2896,2894,2884,2898,2882,2874,2887,2885,2897,2827,2893,2826,2883,2855,2876,2893,2876,2890,2885,2892,2853,2887,2857,2856,2891,2890,2842,2891,2859,2887,2874,2883,2856,2898,2890,2865,2871,2883,2885,2898,2887,2898,2886,2900,2886,2879,2886,2887,2885,2883,2853,2889,3500,3500" }, "AVX512_CORE": { "value": "3500,3500,3500,3500,3508,3496,3395,2881,2891,2889,2886,2874,2867,2883,2882,2882,2848,2891,2879,2883,2890,2837,2887,2890,2888,2886,2883,2880,2827,2844,2895,2893,2884,2886,2840,2891,2885,2892,2786,2885,2886,2890,2826,2885,2885,2892,2888,2866,2888,2886,2822,2873,2877,2871,2876,2882,2896,2888,2887,2873,2887,2732,2894,2828,2875,2882,3513,3500,3500,1900,3500,3500,3500,3501,2817,2873,2886,2888,2867,2878,2889,2863,2883,2888,2850,2895,2889,2886,2895,2858,2883,2861,2892,2897,2876,2851,2879,2879,2897,2844,2889,2838,2896,2868,2898,2899,2887,2889,2888,2872,2889,2868,2892,2858,2885,2885,2868,2887,2881,2856,2893,2877,2890,2886,2888,2892,2892,2893,2897,2889,2882,2893,2887,2876,3500,3500,1900,1900,1900,1900,3496,3206,2878,2826,2880,2892,2884,2894,2874,2892,2865,2890,2891,2897,2846,2881,2891,2792,2891,2856,2893,2895,2876,2832,2883,2895,2868,2878,2832,2894,2880,2834,2880,2894,2890,2893,2893,2888,2897,2883,2895,2882,2894,2882,2881,2878,2893,2891,2900,2886,2895,2891,2884,2891,2894,2872,2858,2857,2893,2877,2875,2902,3500" } } }, "078dcbb63e288a59be0b6a040bf5fc3de7ee874e": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Peak Freq (Highest CPU Core Frequency) -m models\/intel\/machine-translation-nar-en-de-0002\/FP16\/machine-translation-nar-en-de-0002.xml -d CPU", "description": "CPU Peak Freq (Highest CPU Core Frequency) Monitor", "scale": "Megahertz", "proportion": "HIB", "display_format": "LINE_GRAPH", "parent": "b3a8131fefe6128aa91a19d21376c4b9dbe300bf", "results": { "AVX512_CORE_AMX": { "value": "3500,3500,3501,3501,3500,3500,3500,2474,2453,2376,2298,2814,2814,2900,2287,2844,2804,2800,2612,2900,2605,2897,2342,2667,2601,2665,2896,2700,2404,2900,2800,2626,2876,2803,2807,2900,2664,2900,2900,2406,2457,2800,2900,2327,2311,2552,2606,2422,2508,2317,2498,2504,2800,2886,2700,2645,2900,2548,2808,2618,2900,2885,2735,2719,2265,2763,2791,3500,3500,3500,3500,3501,3501,3500,3501,2900,2317,2647,2466,2802,2807,2833,2810,2332,2800,2821,2402,2807,2806,2900,2696,2900,2815,2900,2770,2303,2900,2811,2900,2900,2642,2489,2900,2885,2892,2800,2700,2712,2586,2700,2900,2800,2405,2700,2331,2289,2899,2778,2800,2700,2700,2401,2769,2707,2900,2479,2900,2900,2900,2639,2794,2800,2688,2900,3500,3503,3500,1900,3501,3500,3500,3500,2900,2881,2387,2800,2268,2815,2808,2900,2297,2722,2807,2800,2900,2905,2866,2405,2900,2848,2800,2800,2829,2900,2898,2900,2825,2800,2466,2800,2900,2900,2900,2615,2900,2422,2442,2311,2435,2314,2465,2900,2473,2330,2787,2800,2444,2804,2809,2900,2900,2900,2293,2452,2316,2872,2900,2900,2899,2900,2800,2800,3516,3512" }, "AVX512_CORE_FP16": { "value": "3500,1900,3500,3500,3500,3500,3500,2900,2484,2617,2489,2900,2731,2407,2438,2496,2891,2631,2726,2450,2500,2304,2400,2500,2449,2857,2507,2642,2600,2444,2400,2458,2300,2400,2487,2300,2577,2437,2800,2700,2500,2509,2500,2434,2300,2400,2400,2400,2900,2696,2713,2404,2460,2820,2883,2503,2687,2800,2520,2479,2630,2678,2641,2596,2593,2805,2881,3500,3500,3500,3508,3500,3500,3501,3502,2484,2900,2452,2491,2709,2786,2592,2300,2498,2700,2900,2864,2553,2669,2613,2566,2849,2796,2419,2629,2601,2551,2494,2411,2421,2482,2405,2300,2400,2426,2486,2681,2463,2715,2800,2566,2458,2803,2600,2658,2408,2300,2400,2400,2400,2409,2407,2822,2708,2421,2200,2755,2400,2200,2451,2448,2600,2400,2600,2400,3500,3500,3462,1900,3500,3501,3501,3500,2900,2549,2548,2479,2596,2811,2400,2900,2490,2478,2616,2474,2535,2611,2453,2900,2734,2869,2797,2900,2852,2482,2456,2300,2400,2400,2400,2400,2484,2776,2485,2800,2558,2852,2844,2817,2852,2482,2664,2731,2629,2661,2300,2415,2300,2300,2453,2200,2300,2400,2569,2200,2469,2200,2406,2455,2400,2480,2523,2446,3500,3500" }, "AVX512_CORE_BF16": { "value": "3500,1900,3501,3500,3500,3500,3512,2883,2486,2460,2811,2829,2449,2743,2600,2850,2713,2822,2477,2784,2649,2802,2500,2468,2494,2731,2811,2680,2700,2581,2524,2564,2530,2849,2623,2745,2554,2789,2526,2900,2642,2900,2633,2755,2486,2873,2722,2658,2544,2531,2809,2697,2547,2504,2757,2890,2490,2750,2790,2437,2585,2500,2411,2407,2417,2300,3500,3507,3499,3501,3500,3506,3501,3500,3501,2455,2627,2448,2787,2798,2494,2458,2400,2407,2491,2801,2461,2678,2581,2400,2200,2200,2400,2400,2652,2801,2621,2900,2606,2638,2459,2537,2434,2631,2800,2457,2859,2650,2897,2524,2700,2523,2816,2700,2662,2602,2753,2479,2749,2486,2772,2542,2483,2685,2654,2401,2440,2813,2670,2422,2600,2381,2595,2300,3500,2910,3484,1900,3500,3501,3500,3500,3500,2677,2735,2518,2709,2465,2518,2831,2486,2611,2461,2900,2783,2638,2415,2858,2400,2500,2400,2400,2701,2808,2446,2817,2824,2630,2701,2400,2400,2400,2720,2508,2900,2825,2618,2789,2855,2856,2614,2500,2400,2400,2300,2400,2400,2787,2443,2806,2828,2775,2788,2821,2667,2812,2700,2400,2660,2300,2456,2253,3500,3507" }, "AVX512_CORE_VNNI": { "value": "3499,3500,1900,3500,3500,3500,3506,2102,2900,2878,2900,2200,2412,2142,2900,2152,2887,2900,2216,2900,2189,2169,2797,2612,2100,2348,2232,2844,2682,2192,2160,2449,2471,2895,2240,2896,2238,2158,2139,2010,2100,2900,2496,2864,2408,2117,2881,2383,2336,2408,2844,2661,2375,2120,2900,2146,2769,2900,2100,2585,2374,2198,2115,2895,2223,2425,2900,3500,3501,3501,3500,3500,3508,3501,3509,2900,2418,2873,2412,2900,2300,2229,2254,2255,2269,2529,2000,2793,2103,2266,2258,2489,2867,2400,2104,2283,2227,2251,2120,2090,2100,2117,2627,2690,2244,2298,2216,2900,2191,2212,2900,2900,2308,2330,2567,2228,2341,2837,2413,2700,2690,2402,2900,2170,2900,2415,2491,2768,2100,2725,2217,2151,2896,2266,2561,3502,3244,3500,3501,3500,3500,3500,3492,2900,2889,2609,2655,2900,2400,2500,2324,2690,2800,2900,2900,2100,2114,2109,2178,2213,2209,2900,2200,2380,2156,2258,2335,2087,2281,2298,2900,2542,2314,2440,2195,2219,2900,2483,2523,2276,2398,2732,2313,2106,2220,2195,2552,2900,2750,2400,2194,2367,2809,2405,2209,2569,2138,2200,2486,2890,2300,2174,2189,3500" }, "AVX512_CORE": { "value": "3500,3500,3500,1900,3506,3512,3500,3239,2884,2658,2736,2300,2396,2300,2336,2191,2643,2155,2133,2800,2709,2410,2270,2884,2248,2880,2354,2181,2544,2597,2101,2900,2449,2066,2105,2400,2149,2671,2181,2900,2346,2602,2900,2286,2900,2342,2465,2614,2326,2578,2656,2167,2900,2728,2722,2400,2900,2435,2238,2900,2856,2798,2900,2176,2106,2496,2260,3500,3507,1900,3501,3500,3501,3518,3500,2893,2896,2604,2470,2318,2900,2583,2287,2835,2300,2899,2108,2900,2234,2000,2345,2181,2218,2181,2861,2862,2080,2813,2799,2182,2544,2900,2300,2791,2900,2600,2699,2204,2193,2900,2500,2376,2633,2311,2317,2900,2600,2300,2253,2106,2199,2514,2108,2143,2151,2043,2106,2600,2409,2000,2234,2429,2814,2607,2636,2462,3500,3409,3300,3500,3500,3500,3501,3500,2900,2222,2528,2876,2153,2198,2900,2276,2100,2697,2149,2900,2170,2872,2579,2900,2700,2669,2507,2800,2897,2403,2800,2900,2200,2900,2542,2200,2238,2824,2700,2118,2369,2684,2746,2561,2600,2232,2170,2560,2381,2178,2114,2802,2560,2100,2200,2348,2716,2401,2628,2801,2000,2100,2300,2500,2065,2300,2804,2000,3503" } } }, "f8f6b5ef03af8f03512e71fa6715559e78637ff8": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Temperature -m models\/intel\/face-detection-0206\/FP16-INT8\/face-detection-0206.xml -d CPU", "description": "CPU Temperature Monitor", "scale": "Celsius", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "61b589db5aad42010567809d699fd1abd0e1a9bf", "results": { "AVX512_CORE_AMX": { "value": "30.00,30.00,30.00,30.00,30.00,30.00,33.00,34.00,34.00,34.00,35.00,34.00,35.00,35.00,39.00,41.00,40.00,40.00,42.00,42.00,43.00,43.00,44.00,44.00,44.00,44.00,45.00,45.00,45.00,45.00,45.00,46.00,46.00,47.00,46.00,47.00,47.00,47.00,47.00,48.00,47.00,47.00,48.00,48.00,48.00,48.00,48.00,48.00,49.00,49.00,49.00,50.00,50.00,50.00,49.00,50.00,50.00,50.00,50.00,51.00,51.00,51.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,46.00,45.00,45.00,43.00,43.00,43.00,43.00,43.00,41.00,40.00,40.00,40.00,42.00,42.00,44.00,45.00,43.00,43.00,42.00,42.00,42.00,47.00,47.00,46.00,46.00,48.00,48.00,49.00,49.00,49.00,50.00,50.00,50.00,50.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,51.00,52.00,51.00,51.00,52.00,52.00,52.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,52.00,53.00,53.00,52.00,53.00,53.00,53.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,47.00,46.00,46.00,45.00,45.00,45.00,45.00,42.00,42.00,42.00,42.00,44.00,46.00,46.00,44.00,45.00,45.00,44.00,44.00,43.00,49.00,49.00,49.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,51.00,53.00,52.00,52.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,54.00,55.00,48.00,48.00,46.00,45.00,45.00,45.00,45.00" }, "AVX512_CORE_FP16": { "value": "34.00,34.00,34.00,34.00,34.00,36.00,39.00,39.00,39.00,45.00,46.00,47.00,46.00,47.00,45.00,48.00,48.00,49.00,49.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,53.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,55.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,48.00,48.00,46.00,46.00,44.00,42.00,42.00,43.00,55.00,51.00,51.00,50.00,53.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,53.00,54.00,54.00,54.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,56.00,56.00,56.00,56.00,55.00,56.00,56.00,55.00,56.00,56.00,56.00,55.00,55.00,56.00,56.00,55.00,56.00,56.00,57.00,49.00,47.00,47.00,46.00,46.00,44.00,43.00,43.00,46.00,45.00,45.00,46.00,51.00,53.00,53.00,53.00,54.00,54.00,53.00,50.00,53.00,54.00,53.00,55.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,57.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,57.00,56.00,55.00,56.00,56.00,56.00,57.00,57.00,56.00,56.00,57.00,57.00,57.00,56.00,56.00,57.00,57.00,56.00,57.00,48.00,48.00,47.00" }, "AVX512_CORE_BF16": { "value": "31.00,31.00,31.00,31.00,31.00,33.00,36.00,36.00,36.00,43.00,45.00,43.00,44.00,46.00,45.00,46.00,47.00,47.00,47.00,50.00,47.00,47.00,47.00,48.00,49.00,49.00,50.00,50.00,50.00,50.00,50.00,50.00,50.00,50.00,51.00,51.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,55.00,54.00,54.00,46.00,45.00,45.00,44.00,42.00,42.00,41.00,42.00,42.00,45.00,45.00,50.00,52.00,51.00,51.00,52.00,51.00,53.00,52.00,52.00,52.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,56.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,56.00,56.00,56.00,55.00,56.00,48.00,47.00,47.00,45.00,45.00,43.00,42.00,42.00,46.00,45.00,45.00,49.00,52.00,51.00,52.00,53.00,53.00,53.00,53.00,52.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,56.00,55.00,55.00,56.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,56.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,55.00,56.00,56.00,56.00,55.00,49.00,47.00,47.00,47.00" }, "AVX512_CORE_VNNI": { "value": "35.00,35.00,35.00,36.00,36.00,36.00,40.00,40.00,40.00,46.00,47.00,47.00,48.00,48.00,48.00,49.00,49.00,49.00,49.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,51.00,51.00,51.00,52.00,52.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,54.00,53.00,54.00,54.00,53.00,53.00,54.00,54.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,56.00,56.00,47.00,47.00,45.00,45.00,43.00,42.00,42.00,46.00,47.00,46.00,51.00,52.00,54.00,50.00,53.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,57.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,56.00,57.00,56.00,56.00,56.00,56.00,56.00,57.00,56.00,57.00,57.00,47.00,47.00,45.00,45.00,44.00,42.00,42.00,50.00,55.00,47.00,50.00,53.00,53.00,54.00,53.00,54.00,51.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,59.00,54.00,55.00,55.00,55.00,55.00,55.00,56.00,56.00,56.00,55.00,56.00,55.00,55.00,55.00,56.00,55.00,56.00,56.00,56.00,55.00,56.00,56.00,57.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,56.00,56.00,56.00,57.00,56.00,57.00,56.00,56.00,56.00,56.00,57.00,57.00,56.00,56.00,49.00,47.00,47.00,46.00" }, "AVX512_CORE": { "value": "33.00,33.00,33.00,33.00,33.00,34.00,34.00,36.00,34.00,45.00,45.00,45.00,46.00,47.00,47.00,47.00,47.00,48.00,48.00,48.00,49.00,49.00,49.00,49.00,50.00,50.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,51.00,52.00,52.00,52.00,53.00,52.00,53.00,52.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,55.00,54.00,54.00,55.00,54.00,55.00,55.00,56.00,55.00,54.00,56.00,55.00,56.00,50.00,47.00,47.00,46.00,44.00,44.00,42.00,42.00,44.00,45.00,46.00,46.00,52.00,54.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,54.00,54.00,55.00,56.00,55.00,54.00,55.00,54.00,55.00,56.00,55.00,56.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,55.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,56.00,57.00,57.00,49.00,47.00,46.00,46.00,45.00,45.00,43.00,43.00,43.00,46.00,46.00,57.00,53.00,54.00,53.00,54.00,54.00,53.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,53.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,56.00,56.00,55.00,56.00,55.00,56.00,56.00,55.00,56.00,56.00,56.00,57.00,57.00,56.00,57.00,56.00,56.00,57.00,56.00,56.00,57.00,57.00,56.00,56.00,56.00,57.00,56.00,57.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,57.00,57.00,49.00,48.00,48.00,47.00" } } }, "a12cc64348f3c5b45e18f137b2e1f4824b00baf5": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Temperature -m models\/intel\/weld-porosity-detection-0001\/FP16-INT8\/weld-porosity-detection-0001.xml -d CPU", "description": "CPU Temperature Monitor", "scale": "Celsius", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "9fb2dbd336b6ecf44756df5e51a5e021c87b0a75", "results": { "AVX512_CORE_AMX": { "value": "41.00,40.00,40.00,39.00,39.00,43.00,48.00,48.00,48.00,49.00,49.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,54.00,53.00,54.00,54.00,54.00,53.00,53.00,54.00,53.00,54.00,49.00,47.00,45.00,45.00,43.00,46.00,51.00,52.00,52.00,52.00,52.00,53.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,54.00,53.00,54.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,49.00,47.00,47.00,44.00,45.00,49.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,54.00,54.00,55.00,55.00,54.00,55.00,54.00,54.00,54.00,50.00" }, "AVX512_CORE_FP16": { "value": "41.00,40.00,40.00,40.00,42.00,49.00,52.00,52.00,53.00,52.00,52.00,52.00,54.00,52.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,55.00,54.00,56.00,56.00,55.00,55.00,55.00,53.00,56.00,56.00,57.00,56.00,57.00,56.00,56.00,55.00,57.00,58.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,58.00,56.00,55.00,57.00,57.00,56.00,56.00,58.00,57.00,58.00,56.00,57.00,58.00,51.00,47.00,46.00,46.00,44.00,47.00,55.00,55.00,56.00,55.00,55.00,56.00,55.00,56.00,55.00,56.00,55.00,56.00,56.00,56.00,56.00,54.00,55.00,56.00,56.00,57.00,57.00,57.00,57.00,56.00,57.00,57.00,56.00,57.00,56.00,57.00,58.00,58.00,57.00,56.00,57.00,58.00,57.00,56.00,56.00,57.00,56.00,57.00,57.00,58.00,57.00,57.00,58.00,57.00,58.00,58.00,57.00,58.00,56.00,57.00,57.00,58.00,58.00,58.00,58.00,50.00,50.00,47.00,45.00,45.00,47.00,55.00,57.00,55.00,54.00,55.00,56.00,56.00,56.00,57.00,57.00,56.00,56.00,56.00,55.00,55.00,56.00,55.00,56.00,55.00,57.00,57.00,57.00,56.00,57.00,57.00,56.00,57.00,56.00,57.00,56.00,57.00,57.00,57.00,57.00,58.00,58.00,57.00,58.00,58.00,58.00,57.00,57.00,57.00,56.00,57.00,58.00,58.00,58.00,58.00,57.00,58.00,58.00,58.00,58.00,58.00,57.00,58.00,58.00,57.00,50.00" }, "AVX512_CORE_BF16": { "value": "38.00,38.00,38.00,38.00,43.00,49.00,50.00,51.00,51.00,51.00,52.00,52.00,53.00,52.00,52.00,53.00,52.00,53.00,53.00,54.00,54.00,54.00,53.00,53.00,54.00,53.00,54.00,54.00,55.00,52.00,55.00,54.00,56.00,54.00,55.00,55.00,54.00,55.00,54.00,55.00,56.00,56.00,56.00,56.00,56.00,57.00,55.00,57.00,56.00,57.00,55.00,56.00,55.00,56.00,54.00,54.00,55.00,57.00,57.00,56.00,57.00,56.00,57.00,57.00,57.00,46.00,44.00,44.00,44.00,47.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,54.00,55.00,57.00,56.00,56.00,55.00,57.00,57.00,57.00,57.00,55.00,57.00,56.00,57.00,57.00,55.00,57.00,56.00,57.00,56.00,57.00,57.00,57.00,57.00,57.00,56.00,57.00,57.00,57.00,56.00,57.00,57.00,57.00,57.00,56.00,56.00,57.00,58.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,55.00,57.00,50.00,46.00,45.00,44.00,44.00,51.00,55.00,55.00,56.00,56.00,56.00,55.00,54.00,56.00,55.00,55.00,56.00,56.00,55.00,55.00,56.00,57.00,56.00,57.00,57.00,57.00,57.00,56.00,56.00,54.00,57.00,56.00,55.00,56.00,57.00,57.00,57.00,56.00,57.00,56.00,57.00,58.00,58.00,57.00,57.00,57.00,58.00,57.00,58.00,57.00,57.00,58.00,56.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,58.00,56.00,57.00,50.00" }, "AVX512_CORE_VNNI": { "value": "39.00,39.00,39.00,38.00,38.00,47.00,50.00,50.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,52.00,52.00,53.00,54.00,52.00,54.00,54.00,54.00,55.00,54.00,54.00,56.00,54.00,54.00,54.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,54.00,56.00,56.00,56.00,55.00,56.00,56.00,56.00,54.00,57.00,57.00,57.00,56.00,56.00,57.00,57.00,56.00,57.00,57.00,57.00,57.00,57.00,48.00,48.00,44.00,44.00,45.00,51.00,55.00,55.00,56.00,55.00,55.00,56.00,55.00,54.00,55.00,56.00,56.00,55.00,56.00,56.00,55.00,56.00,56.00,56.00,56.00,56.00,57.00,57.00,56.00,57.00,55.00,55.00,56.00,57.00,55.00,57.00,56.00,55.00,56.00,57.00,58.00,56.00,56.00,57.00,57.00,58.00,58.00,58.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,58.00,58.00,57.00,56.00,57.00,57.00,58.00,58.00,57.00,58.00,48.00,45.00,45.00,44.00,44.00,53.00,56.00,56.00,57.00,56.00,57.00,57.00,56.00,56.00,55.00,57.00,56.00,56.00,56.00,56.00,56.00,57.00,57.00,58.00,56.00,56.00,57.00,57.00,56.00,57.00,56.00,56.00,55.00,57.00,56.00,55.00,57.00,57.00,56.00,57.00,57.00,56.00,58.00,57.00,57.00,58.00,57.00,57.00,57.00,58.00,57.00,58.00,58.00,58.00,57.00,57.00,56.00,58.00,57.00,58.00,58.00,58.00,58.00,57.00,57.00,48.00" }, "AVX512_CORE": { "value": "39.00,39.00,39.00,39.00,48.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,51.00,53.00,53.00,52.00,53.00,53.00,52.00,54.00,54.00,53.00,53.00,53.00,54.00,53.00,54.00,54.00,55.00,54.00,55.00,55.00,55.00,54.00,56.00,55.00,54.00,54.00,55.00,55.00,55.00,56.00,55.00,55.00,54.00,56.00,55.00,55.00,56.00,57.00,56.00,57.00,57.00,55.00,56.00,56.00,56.00,55.00,56.00,55.00,56.00,56.00,56.00,56.00,56.00,47.00,45.00,45.00,46.00,54.00,55.00,55.00,55.00,56.00,56.00,56.00,56.00,55.00,56.00,55.00,56.00,56.00,57.00,56.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,58.00,56.00,56.00,56.00,57.00,58.00,57.00,57.00,56.00,57.00,57.00,56.00,57.00,58.00,57.00,57.00,57.00,58.00,57.00,57.00,58.00,57.00,57.00,58.00,58.00,56.00,57.00,57.00,57.00,58.00,57.00,57.00,57.00,57.00,57.00,57.00,58.00,50.00,47.00,47.00,44.00,44.00,52.00,56.00,56.00,54.00,54.00,56.00,57.00,55.00,56.00,56.00,56.00,55.00,56.00,55.00,56.00,56.00,56.00,56.00,57.00,56.00,56.00,57.00,57.00,56.00,56.00,56.00,56.00,56.00,57.00,57.00,56.00,57.00,57.00,57.00,57.00,55.00,57.00,56.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,57.00,58.00,57.00,57.00,58.00,56.00,57.00,57.00,57.00,58.00,58.00,57.00" } } }, "350cde621efae1cc78b4a9dd189d143eb3873b93": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Temperature -m models\/intel\/person-vehicle-bike-detection-2004\/FP16\/person-vehicle-bike-detection-2004.xml -d CPU", "description": "CPU Temperature Monitor", "scale": "Celsius", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "837eb56d12e5c5271e059c1a290c3be29289be36", "results": { "AVX512_CORE_AMX": { "value": "41.00,40.00,40.00,39.00,41.00,41.00,43.00,42.00,44.00,48.00,49.00,49.00,50.00,50.00,50.00,50.00,50.00,51.00,51.00,51.00,52.00,51.00,51.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,52.00,53.00,52.00,53.00,53.00,53.00,54.00,54.00,53.00,53.00,54.00,53.00,54.00,53.00,53.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,55.00,54.00,50.00,50.00,47.00,47.00,45.00,43.00,43.00,42.00,46.00,46.00,45.00,46.00,50.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,55.00,55.00,54.00,55.00,54.00,54.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,49.00,48.00,48.00,46.00,45.00,45.00,45.00,45.00,47.00,46.00,46.00,48.00,52.00,51.00,52.00,51.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,54.00,54.00,55.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,48.00,48.00,48.00" }, "AVX512_CORE_FP16": { "value": "40.00,40.00,40.00,39.00,42.00,42.00,47.00,49.00,49.00,50.00,50.00,49.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,51.00,51.00,51.00,52.00,53.00,52.00,52.00,52.00,53.00,53.00,52.00,53.00,52.00,54.00,54.00,52.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,53.00,54.00,54.00,54.00,53.00,53.00,53.00,55.00,54.00,55.00,54.00,54.00,55.00,54.00,55.00,54.00,54.00,55.00,55.00,53.00,54.00,48.00,47.00,47.00,45.00,44.00,44.00,47.00,50.00,52.00,53.00,52.00,53.00,53.00,52.00,52.00,53.00,53.00,54.00,53.00,54.00,55.00,54.00,53.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,56.00,56.00,56.00,56.00,56.00,56.00,56.00,54.00,55.00,56.00,54.00,55.00,55.00,56.00,55.00,55.00,55.00,54.00,56.00,55.00,55.00,49.00,49.00,46.00,46.00,44.00,44.00,44.00,48.00,52.00,53.00,53.00,53.00,52.00,53.00,53.00,54.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,53.00,54.00,53.00,54.00,55.00,54.00,54.00,53.00,55.00,55.00,55.00,55.00,55.00,53.00,54.00,55.00,55.00,55.00,56.00,55.00,54.00,55.00,55.00,56.00,55.00,55.00,55.00,54.00,54.00,56.00,55.00,56.00,55.00,56.00,56.00,55.00,56.00,57.00,56.00,55.00,56.00,54.00,56.00,55.00,52.00,49.00" }, "AVX512_CORE_BF16": { "value": "40.00,40.00,39.00,39.00,39.00,42.00,47.00,49.00,47.00,49.00,50.00,50.00,49.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,51.00,52.00,52.00,51.00,53.00,53.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,55.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,54.00,54.00,47.00,46.00,46.00,44.00,44.00,44.00,46.00,51.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,52.00,53.00,53.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,56.00,53.00,54.00,55.00,54.00,54.00,54.00,53.00,55.00,55.00,55.00,55.00,54.00,55.00,56.00,55.00,55.00,56.00,54.00,56.00,54.00,55.00,54.00,51.00,48.00,47.00,45.00,45.00,44.00,47.00,47.00,51.00,52.00,52.00,53.00,53.00,53.00,52.00,53.00,53.00,54.00,54.00,54.00,53.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,55.00,55.00,54.00,54.00,55.00,54.00,54.00,55.00,54.00,55.00,56.00,54.00,55.00,55.00,56.00,55.00,55.00,54.00,55.00,55.00,54.00,56.00,55.00,55.00,55.00,54.00,54.00,54.00,55.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,54.00,57.00,54.00,49.00,47.00" }, "AVX512_CORE_VNNI": { "value": "40.00,39.00,39.00,39.00,42.00,42.00,46.00,48.00,48.00,48.00,48.00,49.00,49.00,50.00,50.00,50.00,51.00,51.00,50.00,50.00,51.00,51.00,51.00,52.00,51.00,52.00,52.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,52.00,52.00,52.00,52.00,53.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,53.00,54.00,53.00,48.00,47.00,47.00,44.00,44.00,43.00,46.00,46.00,51.00,51.00,51.00,52.00,53.00,52.00,52.00,53.00,53.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,50.00,48.00,47.00,47.00,45.00,44.00,44.00,47.00,49.00,51.00,52.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,55.00,48.00" }, "AVX512_CORE": { "value": "41.00,41.00,41.00,40.00,40.00,40.00,43.00,47.00,49.00,48.00,49.00,48.00,49.00,50.00,50.00,50.00,51.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,50.00,48.00,47.00,45.00,45.00,44.00,44.00,46.00,49.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,50.00,48.00,46.00,46.00,45.00,45.00,47.00,47.00,51.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,54.00,53.00,54.00,54.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,55.00,54.00,54.00,55.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,54.00,55.00,54.00,54.00,49.00" } } }, "14767ea57ffd09f6a176c8e0ea435ef264ef207c": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Temperature -m models\/intel\/machine-translation-nar-en-de-0002\/FP16\/machine-translation-nar-en-de-0002.xml -d CPU", "description": "CPU Temperature Monitor", "scale": "Celsius", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "b3a8131fefe6128aa91a19d21376c4b9dbe300bf", "results": { "AVX512_CORE_AMX": { "value": "40.00,40.00,40.00,39.00,40.00,40.00,44.00,46.00,48.00,48.00,49.00,47.00,47.00,48.00,49.00,50.00,49.00,49.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,51.00,52.00,52.00,52.00,52.00,50.00,51.00,52.00,52.00,53.00,52.00,52.00,52.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,52.00,53.00,54.00,53.00,53.00,53.00,53.00,53.00,53.00,52.00,53.00,54.00,53.00,54.00,53.00,53.00,54.00,49.00,49.00,44.00,44.00,44.00,45.00,44.00,47.00,51.00,51.00,52.00,51.00,52.00,51.00,50.00,52.00,53.00,52.00,52.00,53.00,51.00,51.00,53.00,53.00,53.00,53.00,53.00,53.00,52.00,53.00,52.00,51.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,55.00,54.00,54.00,54.00,54.00,54.00,51.00,49.00,46.00,46.00,44.00,44.00,44.00,45.00,47.00,51.00,52.00,52.00,52.00,50.00,51.00,52.00,52.00,52.00,51.00,51.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,51.00,49.00" }, "AVX512_CORE_FP16": { "value": "40.00,40.00,40.00,38.00,38.00,40.00,42.00,44.00,49.00,50.00,50.00,50.00,50.00,51.00,50.00,50.00,51.00,51.00,51.00,52.00,51.00,52.00,52.00,51.00,52.00,52.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,55.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,56.00,55.00,56.00,56.00,55.00,55.00,55.00,55.00,49.00,49.00,46.00,46.00,44.00,44.00,44.00,48.00,48.00,52.00,52.00,53.00,52.00,50.00,53.00,53.00,54.00,53.00,53.00,53.00,53.00,53.00,54.00,53.00,53.00,54.00,54.00,55.00,55.00,54.00,54.00,55.00,54.00,55.00,54.00,54.00,55.00,55.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,49.00,49.00,46.00,45.00,45.00,43.00,43.00,47.00,47.00,52.00,52.00,52.00,53.00,53.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,54.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,55.00,54.00,55.00,55.00,56.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,50.00,50.00" }, "AVX512_CORE_BF16": { "value": "40.00,40.00,39.00,39.00,40.00,40.00,43.00,48.00,48.00,48.00,50.00,49.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,51.00,51.00,52.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,48.00,46.00,45.00,45.00,44.00,44.00,44.00,46.00,52.00,52.00,53.00,51.00,50.00,51.00,53.00,53.00,53.00,52.00,50.00,53.00,54.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,54.00,54.00,55.00,54.00,54.00,55.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,55.00,55.00,55.00,54.00,56.00,56.00,55.00,56.00,56.00,55.00,55.00,55.00,51.00,49.00,46.00,46.00,44.00,44.00,44.00,46.00,46.00,52.00,53.00,53.00,52.00,53.00,53.00,53.00,53.00,54.00,53.00,54.00,53.00,52.00,55.00,54.00,55.00,55.00,54.00,54.00,55.00,54.00,53.00,54.00,54.00,54.00,55.00,55.00,53.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,56.00,56.00,54.00,56.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,56.00,55.00,56.00,55.00,57.00,56.00,56.00,51.00,51.00" }, "AVX512_CORE_VNNI": { "value": "41.00,40.00,39.00,39.00,39.00,40.00,40.00,46.00,47.00,48.00,49.00,50.00,49.00,50.00,50.00,51.00,50.00,51.00,50.00,50.00,51.00,51.00,51.00,52.00,52.00,51.00,52.00,51.00,53.00,53.00,52.00,52.00,53.00,53.00,53.00,52.00,53.00,54.00,54.00,53.00,53.00,53.00,54.00,54.00,53.00,53.00,54.00,54.00,53.00,53.00,54.00,51.00,53.00,55.00,53.00,55.00,54.00,53.00,55.00,54.00,55.00,55.00,55.00,54.00,54.00,55.00,54.00,48.00,47.00,46.00,46.00,44.00,45.00,45.00,46.00,50.00,52.00,51.00,52.00,52.00,52.00,53.00,53.00,53.00,53.00,52.00,53.00,53.00,53.00,54.00,53.00,54.00,54.00,54.00,54.00,54.00,54.00,53.00,55.00,53.00,55.00,54.00,55.00,51.00,54.00,55.00,55.00,55.00,53.00,55.00,55.00,54.00,55.00,55.00,54.00,55.00,54.00,53.00,55.00,54.00,55.00,56.00,56.00,55.00,54.00,56.00,55.00,55.00,56.00,56.00,56.00,55.00,54.00,56.00,56.00,49.00,47.00,46.00,46.00,44.00,45.00,45.00,46.00,50.00,52.00,49.00,49.00,52.00,53.00,53.00,53.00,53.00,53.00,53.00,52.00,54.00,53.00,54.00,53.00,53.00,54.00,54.00,54.00,54.00,55.00,54.00,55.00,53.00,54.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,53.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,55.00,55.00,55.00,56.00,56.00,56.00,56.00,55.00,54.00,55.00,55.00,56.00,49.00" }, "AVX512_CORE": { "value": "41.00,40.00,40.00,40.00,40.00,40.00,40.00,45.00,48.00,47.00,45.00,50.00,50.00,50.00,51.00,51.00,51.00,51.00,51.00,51.00,51.00,52.00,52.00,52.00,52.00,51.00,53.00,53.00,53.00,52.00,53.00,52.00,52.00,53.00,53.00,52.00,53.00,53.00,53.00,52.00,54.00,53.00,53.00,54.00,55.00,54.00,54.00,53.00,54.00,54.00,55.00,54.00,54.00,54.00,54.00,54.00,55.00,56.00,54.00,55.00,54.00,54.00,55.00,55.00,56.00,54.00,54.00,50.00,48.00,48.00,45.00,44.00,44.00,44.00,45.00,47.00,52.00,49.00,52.00,53.00,52.00,53.00,52.00,53.00,53.00,53.00,54.00,53.00,55.00,55.00,54.00,54.00,55.00,55.00,52.00,53.00,53.00,54.00,53.00,54.00,55.00,54.00,54.00,55.00,54.00,54.00,55.00,55.00,55.00,55.00,54.00,56.00,51.00,54.00,54.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,56.00,56.00,56.00,55.00,55.00,54.00,55.00,55.00,55.00,55.00,55.00,55.00,56.00,52.00,49.00,48.00,48.00,45.00,44.00,44.00,45.00,47.00,47.00,52.00,49.00,52.00,52.00,54.00,52.00,53.00,53.00,53.00,54.00,52.00,54.00,53.00,50.00,52.00,54.00,53.00,54.00,55.00,53.00,54.00,54.00,54.00,55.00,53.00,55.00,54.00,54.00,55.00,54.00,55.00,55.00,54.00,54.00,54.00,54.00,54.00,55.00,55.00,55.00,55.00,55.00,54.00,55.00,55.00,56.00,56.00,55.00,56.00,53.00,55.00,55.00,56.00,55.00,55.00,55.00,56.00,55.00,55.00,49.00" } } }, "61b589db5aad42010567809d699fd1abd0e1a9bf": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/face-detection-0206\/FP16-INT8\/face-detection-0206.xml -d CPU", "description": "Model: Face Detection FP16-INT8 - Device: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 424.16000000000002501110429875552654266357421875, "raw_values": [ 427.470000000000027284841053187847137451171875, 428.33999999999997498889570124447345733642578125, 416.68000000000000682121026329696178436279296875 ], "min_result": [ "153.43" ], "max_result": [ "1952.95" ], "test_run_times": [ 77.340000000000003410605131648480892181396484375, 77.2099999999999937472239253111183643341064453125, 77.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 409.81000000000000227373675443232059478759765625, "raw_values": [ 411.42000000000001591615728102624416351318359375, 408.970000000000027284841053187847137451171875, 409.029999999999972715158946812152862548828125 ], "min_result": [ "203.37" ], "max_result": [ "909.92" ], "test_run_times": [ 67.8299999999999982946974341757595539093017578125, 67.93000000000000682121026329696178436279296875, 67.9200000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 409.83999999999997498889570124447345733642578125, "raw_values": [ 409.1200000000000045474735088646411895751953125, 411.1299999999999954525264911353588104248046875, 409.26999999999998181010596454143524169921875 ], "min_result": [ "208.02" ], "max_result": [ "643.02" ], "test_run_times": [ 67.8700000000000045474735088646411895751953125, 67.7600000000000051159076974727213382720947265625, 67.7399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 409.94999999999998863131622783839702606201171875, "raw_values": [ 408.3999999999999772626324556767940521240234375, 410.31999999999999317878973670303821563720703125, 411.1299999999999954525264911353588104248046875 ], "min_result": [ "216.25" ], "max_result": [ "615.53" ], "test_run_times": [ 67.6700000000000017053025658242404460906982421875, 67.6299999999999954525264911353588104248046875, 67.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 942.7899999999999636202119290828704833984375, "raw_values": [ 943.0900000000000318323145620524883270263671875, 943.0900000000000318323145620524883270263671875, 942.200000000000045474735088646411895751953125 ], "min_result": [ "383.12" ], "max_result": [ "1157.46" ], "test_run_times": [ 67.43999999999999772626324556767940521240234375, 67.4599999999999937472239253111183643341064453125, 68.4200000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "9fb2dbd336b6ecf44756df5e51a5e021c87b0a75": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/weld-porosity-detection-0001\/FP16-INT8\/weld-porosity-detection-0001.xml -d CPU", "description": "Model: Weld Porosity Detection FP16-INT8 - Device: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 5.17999999999999971578290569595992565155029296875, "raw_values": [ 5.1500000000000003552713678800500929355621337890625, 5.1699999999999999289457264239899814128875732421875, 5.21999999999999975131004248396493494510650634765625 ], "min_result": [ "1.43" ], "max_result": [ "102.62" ], "test_run_times": [ 61.82000000000000028421709430404007434844970703125, 61.85000000000000142108547152020037174224853515625, 61.8299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 13.46000000000000085265128291212022304534912109375, "raw_values": [ 13.3900000000000005684341886080801486968994140625, 13.5099999999999997868371792719699442386627197265625, 13.4900000000000002131628207280300557613372802734375 ], "min_result": [ "3.82" ], "max_result": [ "88.11" ], "test_run_times": [ 61.280000000000001136868377216160297393798828125, 61.32000000000000028421709430404007434844970703125, 61.27000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 13.42999999999999971578290569595992565155029296875, "raw_values": [ 13.17999999999999971578290569595992565155029296875, 13.57000000000000028421709430404007434844970703125, 13.53999999999999914734871708787977695465087890625 ], "min_result": [ "3.72" ], "max_result": [ "102.63" ], "test_run_times": [ 61.28999999999999914734871708787977695465087890625, 61.28999999999999914734871708787977695465087890625, 61.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 13.4399999999999995026200849679298698902130126953125, "raw_values": [ 13.28999999999999914734871708787977695465087890625, 13.4900000000000002131628207280300557613372802734375, 13.550000000000000710542735760100185871124267578125 ], "min_result": [ "3.47" ], "max_result": [ "112.16" ], "test_run_times": [ 61.27000000000000312638803734444081783294677734375, 61.28999999999999914734871708787977695465087890625, 61.32000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 20.53999999999999914734871708787977695465087890625, "raw_values": [ 20.129999999999999005240169935859739780426025390625, 21.07000000000000028421709430404007434844970703125, 20.42999999999999971578290569595992565155029296875 ], "min_result": [ "9.17" ], "max_result": [ "114" ], "test_run_times": [ 60.96000000000000085265128291212022304534912109375, 60.969999999999998863131622783839702606201171875, 60.97999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "837eb56d12e5c5271e059c1a290c3be29289be36": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/person-vehicle-bike-detection-2004\/FP16\/person-vehicle-bike-detection-2004.xml -d CPU", "description": "Model: Person Vehicle Bike Detection FP16 - Device: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 25.089999999999999857891452847979962825775146484375, "raw_values": [ 24.949999999999999289457264239899814128875732421875, 25.120000000000000994759830064140260219573974609375, 25.21000000000000085265128291212022304534912109375 ], "min_result": [ "11.66" ], "max_result": [ "132.09" ], "test_run_times": [ 67.8799999999999954525264911353588104248046875, 67.8599999999999994315658113919198513031005859375, 67.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 21.949999999999999289457264239899814128875732421875, "raw_values": [ 21.78999999999999914734871708787977695465087890625, 21.969999999999998863131622783839702606201171875, 22.10000000000000142108547152020037174224853515625 ], "min_result": [ "11.62" ], "max_result": [ "120.04" ], "test_run_times": [ 63.75, 63.75, 63.75999999999999801048033987171947956085205078125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 21.660000000000000142108547152020037174224853515625, "raw_values": [ 21.9200000000000017053025658242404460906982421875, 21.550000000000000710542735760100185871124267578125, 21.510000000000001563194018672220408916473388671875 ], "min_result": [ "13.42" ], "max_result": [ "101.56" ], "test_run_times": [ 63.8299999999999982946974341757595539093017578125, 63.75999999999999801048033987171947956085205078125, 63.77000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 32.92999999999999971578290569595992565155029296875, "raw_values": [ 32.75, 33.18999999999999772626324556767940521240234375, 32.840000000000003410605131648480892181396484375 ], "min_result": [ "12.7" ], "max_result": [ "103.82" ], "test_run_times": [ 63.93999999999999772626324556767940521240234375, 64, 64.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 32.93999999999999772626324556767940521240234375, "raw_values": [ 32.64999999999999857891452847979962825775146484375, 33, 33.17999999999999971578290569595992565155029296875 ], "min_result": [ "12.45" ], "max_result": [ "111.25" ], "test_run_times": [ 64, 63.96000000000000085265128291212022304534912109375, 64.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "b3a8131fefe6128aa91a19d21376c4b9dbe300bf": { "identifier": "pts\/openvino-1.2.0", "title": "OpenVINO", "app_version": "2022.3", "arguments": "-m models\/intel\/machine-translation-nar-en-de-0002\/FP16\/machine-translation-nar-en-de-0002.xml -d CPU", "description": "Model: Machine Translation EN To DE FP16 - Device: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "AVX512_CORE_AMX": { "value": 82.7900000000000062527760746888816356658935546875, "raw_values": [ 82.5199999999999960209606797434389591217041015625, 81.909999999999996589394868351519107818603515625, 83.93999999999999772626324556767940521240234375 ], "min_result": [ "31.64" ], "max_result": [ "1588.97" ], "test_run_times": [ 64.18999999999999772626324556767940521240234375, 64.2000000000000028421709430404007434844970703125, 64.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_FP16": { "value": 186.530000000000001136868377216160297393798828125, "raw_values": [ 186.56000000000000227373675443232059478759765625, 187.30000000000001136868377216160297393798828125, 185.740000000000009094947017729282379150390625 ], "min_result": [ "92.82" ], "max_result": [ "808.7" ], "test_run_times": [ 64.469999999999998863131622783839702606201171875, 64.3299999999999982946974341757595539093017578125, 64.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_BF16": { "value": 190.490000000000009094947017729282379150390625, "raw_values": [ 188.3899999999999863575794734060764312744140625, 194.169999999999987494447850622236728668212890625, 188.909999999999996589394868351519107818603515625 ], "min_result": [ "117.21" ], "max_result": [ "1606.21" ], "test_run_times": [ 64.280000000000001136868377216160297393798828125, 64.409999999999996589394868351519107818603515625, 64.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE_VNNI": { "value": 154.55000000000001136868377216160297393798828125, "raw_values": [ 152.75, 154.539999999999992041921359486877918243408203125, 156.3600000000000136424205265939235687255859375 ], "min_result": [ "90.51" ], "max_result": [ "1925.11" ], "test_run_times": [ 64.56000000000000227373675443232059478759765625, 64.469999999999998863131622783839702606201171875, 64.409999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } }, "AVX512_CORE": { "value": 158.259999999999990905052982270717620849609375, "raw_values": [ 154.68000000000000682121026329696178436279296875, 162.330000000000012505552149377763271331787109375, 157.780000000000001136868377216160297393798828125 ], "min_result": [ "62.25" ], "max_result": [ "1819.89" ], "test_run_times": [ 64.5100000000000051159076974727213382720947265625, 65.43999999999999772626324556767940521240234375, 64.3299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl" } } } } }, "324ab70d5f0c5f1aa98a0eee966c96132ac8cc6e": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Power Consumption -m models\/intel\/face-detection-0206\/FP16-INT8\/face-detection-0206.xml -d CPU", "description": "CPU Power Consumption Monitor", "scale": "Watts", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "61b589db5aad42010567809d699fd1abd0e1a9bf", "results": { "AVX512_CORE_AMX": { "value": "221.71,215.5,208.07,214.2,221.92,344.95,432.88,497.78,442.09,488.84,462.61,453.64,453.11,467.64,546.58,760.79,704.05,586.83,723.43,709.58,350.66,707.54,698.54,703.35,703.59,701.13,701.36,702.33,707.75,701.5,703.95,703.26,704.24,702.38,703.21,704.69,702.74,706.37,702.17,707.26,703.26,705.29,706.09,703.54,702.83,707.74,699.91,706.11,704.62,704.52,703.36,704.14,705.08,706.56,701.96,704.38,701.99,706.24,703.78,704.7,703.78,704.53,702.9,703.08,704.5,702.96,704.28,704.02,703.55,703.96,703.47,703.96,701.67,705.52,496.13,354.06,362.5,362.63,354.12,357.42,360.31,365.36,246.95,231.94,234.64,237.13,368.58,468.88,477.17,477.33,466.26,466.08,457.07,458.14,475.15,589.42,757.52,674.23,591.31,710.05,719.07,702.9,705.25,704.3,700.46,705.78,704.53,700.17,706.4,701.73,708.39,702.07,704.63,701,705.17,700.86,706.54,702.27,705.72,708.87,700.73,705.69,701.81,707,699.19,708.97,703.66,702.77,704.9,701.13,705.39,705.64,706.1,704.2,703.33,703.51,705.04,705.47,703.11,702.66,705.96,704.31,702.01,705.02,702.92,704.86,704.16,703.89,704.49,706.67,701.44,705.52,703.78,704.05,704.55,241.26,359.46,362.35,357.36,352.33,361.6,370.41,318.49,237.31,221.15,219.85,308.37,397.89,501.66,445.18,486,465.21,462.28,452.85,460.4,455.9,711.43,758.27,696.78,699.15,708.17,701.33,704.08,703.94,701.67,706.56,702.78,704.87,702.26,704.3,703.4,702.49,705.05,702.41,705.12,704.03,705.35,703.86,702.76,704.16,703.65,704.6,701.29,704.96,703.94,703.67,700.47,703.6,705.41,702.94,704.01,700.74,703.97,704.71,703.46,702.2,702.97,704.86,703.81,703.19,702.36,706.65,704.61,702.78,704.22,702,704.36,702.43,703.64,704.51,703.99,701.7,704.93,704.45,703.92,694.33,375.99,357.08,359.52,359.37,356.53,357.7,368.05" }, "AVX512_CORE_FP16": { "value": "213.59,227.4,244.88,215.16,210.51,342.3,432.43,407.65,417.25,597.62,724.28,739.68,681.8,719.7,673.7,669.12,727.11,696.2,706.48,703.92,704.13,702.81,704.33,704.11,704.52,703.67,704.71,703.54,703.81,703.7,704.7,702.25,703.95,704.1,704.42,704.68,703.68,704.28,703.56,703.93,704.92,704.24,703.42,704.15,704.54,704.47,703.34,704.44,704.89,703.92,704,704.18,704.94,704.98,703,704.22,704.18,703.75,704.33,703.68,704.15,704,703.58,704.13,704.57,702.36,705.67,704.3,705.87,480.25,352.46,353.09,321.03,278.58,223.4,210.27,302.93,410.68,416.56,422.95,271.58,747.67,740.97,701.4,703.11,704.85,702.11,705.29,703.25,705.56,703.83,705.08,705.17,704.61,703.42,705.48,703.94,698.78,708.39,703.8,703.59,702.62,703.63,705.34,703.02,704.61,702.14,703.53,704.64,704.35,703.51,704.61,704.83,703.97,703.34,705.51,704.18,703.81,704.24,707.56,700.42,706.28,703.01,703.75,703.44,704.48,704.44,703.5,703.94,704.83,704.02,703.21,705.75,702.94,703.89,704.94,704.7,703.84,704.37,702.84,569.56,359.54,357.46,360.43,296.83,243.14,220.53,252.58,367.95,438.42,413.11,426.2,717.75,739.98,716.21,703.81,703.43,703.03,704.2,683.25,722.61,704.03,702.03,705.42,703.06,705.52,705.66,704.84,702.96,704.62,703.86,703.42,704.64,703.07,703.03,704.76,702.36,704.18,703.61,704.4,704.08,703.5,703.73,703.08,704.13,703.75,703.4,704.33,702.77,704.71,703.82,704.15,704.16,702.88,704.95,705.07,704.71,703.69,703.53,704.51,703.63,704.45,704.2,702.57,703.75,703.83,703.67,351.93,702.83,704.58,704.32,698.77,367.3,358.57,371.52" }, "AVX512_CORE_BF16": { "value": "215.34,202.57,104.13,219.02,216.15,342.26,430.14,408.25,418.52,591.65,757.22,724.86,702.37,704.79,703.99,703.41,700.25,705.61,704.04,694.33,710.89,703.81,704.37,703.38,705.67,703.32,704.58,704.38,704.64,703.29,704.52,703.28,705.04,703.27,704.5,704.19,705.38,703.76,703.56,704.52,704.03,705.36,703.86,703.98,704.14,703.5,703.97,704.42,703,704.2,704.52,704.84,704,704.31,704.04,705.68,705.33,703.8,704.72,703.19,704.21,703.53,704.6,704.87,704.91,702.89,703.66,703.2,704.39,500.58,356.03,352.82,337.61,217.95,224.75,218.73,299.12,402.17,420.05,424.66,492.73,747.48,733.63,682.79,723.1,705.24,699.55,707.14,703.47,703.23,703.02,705.69,703.12,704.28,704.31,702.58,705.58,704.68,703.31,703.85,703.58,704.46,703.78,702.17,705.85,703.76,705.07,703.26,706.53,703.96,703.26,704.38,703.58,704.08,703,704.78,703.92,704.92,703.12,707.63,703.7,704.02,704.24,707.97,703.37,704.18,704.54,704.32,702.49,704.79,704.66,352.55,702.15,706.34,703.38,703.52,704.77,704.78,704.19,703.39,567.78,359.24,357.04,349,257.43,214.79,222.62,285.82,378.62,434.28,417.69,458.2,757.82,739.41,701.12,704.92,702.45,703.29,703.52,705.56,701.28,704.5,703.38,704.74,703.11,703.4,705.14,704.55,702.91,712.55,697.2,703.35,703.55,706.13,704.85,703.99,705.06,704.14,704.06,704.34,703.91,703.38,703.85,703.85,703.91,705.37,703.67,704.31,703.89,704.31,703.46,705.42,704.47,703.29,704.2,702.9,704.2,704.26,704.08,703.11,703.84,703.86,704.97,705.14,703.19,702.86,706.01,703.51,704.48,543.9,358.45,360.07,375.28" }, "AVX512_CORE_VNNI": { "value": "209.09,205.74,230.37,213.56,201.41,340.03,431.61,407.98,420.4,602.31,741.29,730.78,351.28,704.4,703.91,704.53,703.11,705.24,696.66,708.53,699,704.13,702.75,705.31,704.51,703.55,705.36,704.22,703.66,703.57,704.89,704.23,703.51,704.79,703.7,703.23,703.92,703.7,703.78,704.57,702.61,703.37,704.44,705.07,704.37,703.41,703.01,704.65,703.06,703.36,704.28,704.19,703.28,703.23,705.82,703.38,703.38,706.76,703.09,703.91,701.66,705.93,703.75,704.09,702.72,705.77,704.88,702.77,704.25,451.96,357.54,363.16,305.4,255.59,247.92,221.07,315.44,430.67,413.15,419.46,555.04,737.25,733.32,691.99,718.33,703.97,709.06,699.17,710.93,698.66,704.87,702.74,704.64,696.28,708.31,704.9,704.59,704.68,704.14,703.01,704.63,703.8,704.17,703.66,702.83,704.9,704.18,704.36,703.99,705.15,703.23,704.06,704.54,703.78,702.81,704.47,703.83,703.02,704.37,708.04,703.51,703.73,703.39,704.39,705.05,702.49,705.74,704.17,704.11,703.06,703.43,704.07,703.87,705,705.71,704.3,703.76,352.01,704.08,703.85,441.82,357.37,361.98,287.13,264.96,269.56,229.11,315.18,424.98,411.46,417.45,520.64,736.68,751.83,698.79,702.35,704.62,660.66,732.48,700.43,703.07,705.2,703.93,703.78,696.78,707.65,697.41,702.78,704.12,704.14,704.99,704.12,703.84,703.98,702.85,704.24,703.07,704.36,704.13,704.34,703.68,703.35,703.9,704.67,703.09,703.69,703.33,703.51,703.87,704.75,703.81,703.67,704.55,704.72,704.76,704.31,702.98,704.62,703.59,704.66,703.74,703.3,705.38,703.24,705.65,703.85,704.58,704.85,703.54,704.91,543.03,360.36,357.77,363.24" }, "AVX512_CORE": { "value": "218.22,213.88,213.81,237.24,234.83,345.15,428.48,396.97,412.44,685.57,737.91,714.42,702.87,703.81,702.91,702.36,703.03,702.37,703.47,702.81,702.98,703.14,703.74,702.26,702.56,702.5,702.46,702.48,703.32,703.28,703.1,702.12,703.95,702.5,703.36,702.87,702.06,703.19,703.87,702.87,703.2,702.31,701.85,702.93,703.1,702.44,703.26,702.95,703.18,701.89,703.71,702.81,703.87,704.71,703.39,703.01,703.02,702.08,703.3,702.83,702.6,703.11,703.25,702.47,703.23,703.17,702.57,703.82,691.87,410.99,355.74,373.79,285.36,215.87,291.67,289.71,351.13,436.32,402.45,416.54,716.21,758.25,702.13,346.95,709.65,702,703.83,703.32,702.28,702.9,702.88,703.52,702.25,703.65,703.21,703.3,702.78,702.79,703.47,702.36,703.23,702.63,703.38,702.7,704.17,702.03,702.65,703.26,702.19,702.96,702.53,702.3,703.64,701.97,703.17,702.86,703.44,705.39,704.52,702.61,702.72,704.19,702.62,703.08,702.92,703.13,703.24,702.51,703.1,703.2,701.95,703.6,702.75,701.6,704.12,702.99,702.88,674.82,403.22,357.64,370.28,286,307.09,253.51,237.86,350.97,436.17,402.19,417.17,711.54,758.9,702.11,702.62,703.57,702.42,702.99,702.81,702.47,702.53,705.27,703.08,702.5,700.97,704.55,702.57,702.86,703.31,702.97,702.62,703.45,703.46,703.12,702.65,702.95,703.28,702.87,702.94,702.95,703.65,694.31,707.04,703.4,702.55,703.51,702.93,703.22,702.65,703.42,702.61,702.68,702.67,703.86,703.18,702.57,703.32,702.51,703.24,703.38,703.44,702.8,703.3,702.18,703.96,702.94,703,703.29,703.46,702.81,703.06,655.86,395.17,363.44,368.1" } } }, "84db20c7b72f0dcb33f7536c2b9d6f89a2122ad1": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Power Consumption -m models\/intel\/weld-porosity-detection-0001\/FP16-INT8\/weld-porosity-detection-0001.xml -d CPU", "description": "CPU Power Consumption Monitor", "scale": "Watts", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "9fb2dbd336b6ecf44756df5e51a5e021c87b0a75", "results": { "AVX512_CORE_AMX": { "value": "222.43,229.06,224.47,217.23,217.09,449.72,755.14,751.05,706.04,702.05,698.89,705.08,695.91,708.21,696.51,704.71,703.22,689.83,710.54,697.04,704.16,698.73,700.23,705.17,686.96,705.71,704.15,696.23,701.98,700.75,700.15,703.84,702.08,694.91,702.66,706.91,695.22,693.92,711.47,698.19,690.97,701.11,708.28,696.62,705.6,690.2,705.87,705.89,689.83,706.94,690.5,712.47,695.48,693.42,707.42,696.11,698.26,713.96,686.89,708.05,700.35,693.88,704.52,690.05,710.63,564.08,339.71,240.18,226.67,221.89,354.06,615.08,753.56,723.82,705.47,698.75,697.82,708.31,693.13,701.34,706.69,702.55,690.76,701.22,708.27,695.65,697.58,704.99,704.95,697.81,703.81,703.07,688.79,705.56,706.83,698.9,699.59,691.64,707.25,700.83,702.55,347.49,697.96,707.19,691.59,707.25,705.97,704.43,702.32,699.28,695.39,703.75,700.6,706.14,700.95,699.09,690.34,709.65,692.53,708.59,698.59,702.34,699.69,706.78,688.17,709.01,693.24,707.33,703.76,696.06,696.9,399.56,296.02,273.53,225.2,224.67,469.48,749.9,756.75,701.99,695.42,701.68,706.94,697.69,694.51,705.57,700.17,692.01,707.18,703.37,692.96,700.47,703.12,704.25,700.68,700.79,706.04,697.46,695.94,706.24,699.44,698.87,699.95,706.96,691.92,702.19,707.58,700.87,699.02,700.52,704.49,695.33,704.38,702.38,696.93,704.76,700.42,706.56,697.91,694.09,712.39,699.63,695.4,701.2,700.03,704.15,703.77,700.37,699.03,703.48,699.61,696.8,708.15,698.59,694.75,703.23,561.97" }, "AVX512_CORE_FP16": { "value": "214.16,214.93,210.39,219.69,308.65,655.2,756.43,722.44,351.22,700.69,704.36,701.21,701.68,700.77,702.8,703.34,700.7,701.98,700.12,704.33,703.5,706.47,699.14,702.51,702.49,701.85,703.94,703.73,701.25,700.78,702.13,703.43,704.47,699.45,704.99,701.41,700.14,705.18,701.36,705.86,697.71,703,702.23,703.66,702.69,704,703.9,700.81,702.97,704.33,701.31,703.45,701.88,701.91,703.47,701.02,706.08,699.32,703.37,701.65,700.31,703.04,703.09,701.66,665.92,326.62,299.71,294.64,274.43,340.95,681.83,752.7,717.04,702.34,702.6,702.9,700.46,702.41,702.77,703.45,699.58,704.86,702.01,702.16,697.8,705.56,700.83,704.21,702.1,702.33,702.03,702.53,700.93,702.96,702.58,702.84,699.79,703.12,703.54,704.43,701.89,701.62,704.41,699.78,703.23,701.41,703.74,700.79,701.64,702.81,701.86,701.91,703.75,701.87,700.92,701.55,702.83,702.82,702.69,704.15,700.57,701.3,703.3,703.03,703.48,702.06,702.66,701.23,700.53,629.05,340.11,248.79,219.65,241.77,344.4,719.17,753.17,712.36,702.43,700.89,702.6,700.64,704.8,704.08,701.51,701.68,701.31,707.51,697.14,704.71,702,701.93,702.44,709.96,697.62,700.56,702.46,701.7,704.3,701.41,701.54,702.96,700.83,702.6,702.51,703.15,701.23,703.32,701.65,705.95,698.27,704.1,701.67,702.14,703.37,700.48,704.41,350.79,702.99,700.09,703.47,702.57,700.8,703.88,703.95,699.25,704.53,699.03,704.68,702.55,702.43,700.82,702.05,702.68,593.66" }, "AVX512_CORE_BF16": { "value": "209.67,231.13,218.31,214.54,374.03,751.56,767.06,706.45,701.6,705,701.47,694.57,710.72,700.82,708.99,697.05,702.39,704.25,700.85,701.01,703.26,701.56,701.28,702.98,702.18,702.75,701.68,699.29,707.36,698.18,706.97,702.13,701.34,701.94,703.12,701.82,701.71,704.02,701.54,706.45,700.17,700.93,702.26,701.85,703.37,700.66,702.16,703.47,704.11,700.07,705.26,701.24,700.18,702.12,703.41,704.61,350.19,705.62,702.03,699.95,704.57,700.02,703.3,702.93,533.71,305.93,244.67,214.75,241.39,422.65,768.53,753.34,699.83,703.39,700.97,700.02,707.39,700.95,703.11,702.38,700.06,702.05,703.08,702.05,704.91,697.5,705.05,702.45,701.36,703.89,700.79,703.73,702.3,702.74,700.25,703.88,699.89,701.99,703.16,702.59,699.82,703.26,701.6,703.82,701.77,701.17,703.48,703.93,701.55,702.74,703.09,700.49,701.18,703.67,699.35,701.05,703.39,703.02,701.67,701.54,701.94,700.89,703.03,706.15,698.69,703.08,703.17,700.32,704.12,508.68,303.85,228.02,238.9,242.64,465.59,759.12,750.25,701.16,701.47,704.01,704.29,699.16,703.8,700.86,704.43,701.01,701.59,704.28,701.3,704.23,699.77,701.73,702.35,701.71,701.66,704.53,700.82,701.75,704.38,702.03,701.38,700.28,706,700.52,703.65,702.68,701.13,702.27,702.04,701.25,702.28,705.39,699.61,702.67,702.61,703.37,702.89,702.48,699.01,705.7,702.34,699.72,704.7,701.99,702.06,703.03,703.44,702.49,701.74,700.85,705.03,701.95,700.65,704.2,476.53" }, "AVX512_CORE_VNNI": { "value": "222.45,215.25,210.67,212.08,214.49,497.47,760.3,746.66,703.99,701.73,700.97,703.31,703.15,703.59,704.3,701.41,703.05,701.69,704.1,701.42,701.57,703.46,701.39,703.45,702.87,701.69,708.93,696.49,701.16,705.45,701.14,704.8,700.73,701.42,703.11,702.86,700.34,704.85,702.06,699.27,704.96,706.58,697.32,703.61,699.5,703.47,708.56,698.74,700.9,703.25,703.13,700.62,706.16,700.12,704.31,700.93,702.82,701.14,702.5,703.51,702.9,702.96,699.21,706.9,703.77,452.15,298.29,221.66,221.06,258.86,279.01,759.37,738.72,701.07,701.65,701.77,705.59,700.07,704.54,703.88,700.44,699.98,703.28,703.79,700.06,697.86,705.24,701.58,703.4,702.38,703.93,700.74,702.11,702.4,701.18,703.31,693.65,709.18,702.33,704.1,701.75,702.51,701.65,703.98,700.38,701.79,704.26,699.21,706.65,701.81,700.59,701.64,702.93,701.92,702.43,701.36,703.92,702.09,700.76,703.52,703.02,703.16,701.5,701.48,703.67,700.66,704.67,702.17,702.43,700.7,425.98,244.21,250.64,243.72,251.47,589.48,755.8,734.23,702.95,700.68,704.52,699.88,703.16,704.04,704.75,696.55,705.24,701.56,703.87,700.17,702.56,701.7,702.06,701.62,702.26,704.02,702.37,702.15,702.47,701.64,702.9,701.65,703.21,701.13,701.76,701.26,702.93,701.41,701.83,701.97,703.08,701.85,701.53,702.92,700.1,701.93,703.42,701.76,701.57,704.31,700.23,701.14,704.33,705.4,700.82,703.22,700.02,703.18,702.54,702.13,702.26,702.02,703.39,701.39,703.35,394.38" }, "AVX512_CORE": { "value": "212.17,217.84,216.8,213.93,512.51,755.81,755.54,695.02,702.37,705.33,701.75,702.92,705.96,700.55,709.18,697.94,352.53,703.06,696.87,704.89,698.48,705.74,703.76,702.21,702.45,711,691.58,707.53,697.6,708.91,703.75,701.9,697.18,708.1,702.86,694.33,712.11,696.13,709.53,699.34,706.75,703.2,699.3,708.07,675.3,726.31,703.72,707.83,698.13,702.27,701.9,699.76,710.49,700.61,703.78,696.6,708.8,701.79,703.11,702.2,703.95,702.8,702.72,703.47,397.32,273.34,269.49,232.11,284.79,689.45,750.11,723.73,703.22,699.86,701.75,698.86,708.74,695.97,711.73,703.11,696.33,701.06,700.59,700.63,707.17,704.68,702.06,703.12,702.88,703.76,703.3,702.31,704.13,701.77,705.99,700.24,700.92,708.42,699.38,705.97,704.26,696.33,713.87,697.78,704.03,703.32,700.29,705.84,699.6,703.6,704.4,708.44,697.84,704.32,696.44,708.14,707.48,700.35,702.6,702.41,700.37,705.67,697.17,708.99,700.26,700.22,705.48,699.72,598,315.47,234.9,219.19,219.24,470.67,752.45,758.65,701.9,703.77,685.03,717.17,698.84,700.89,703.62,690.06,719.9,697.88,702.6,702.6,703.09,698.61,702.6,711.35,699.11,699.39,706.01,703.87,690.28,714.6,707.05,705.72,696.23,702.42,701.62,705.39,701.08,704.91,690.5,708.71,689.69,713.98,706.81,700.28,697.1,353.5,704.49,702.44,703.86,698.56,707.36,701.61,702.99,704.87,703.56,702.07,701.78,701.9,703.04,704.3,697.42,706.7,704.23,700.69,704.1" } } }, "de3e13bf2fec3b63b6a9822b01e79af4378fe683": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Power Consumption -m models\/intel\/person-vehicle-bike-detection-2004\/FP16\/person-vehicle-bike-detection-2004.xml -d CPU", "description": "CPU Power Consumption Monitor", "scale": "Watts", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "837eb56d12e5c5271e059c1a290c3be29289be36", "results": { "AVX512_CORE_AMX": { "value": "217.09,212.95,218.83,219.12,276.74,436.65,452.69,426.67,443.88,748.36,751.86,690.54,710.94,697.35,697.19,710.17,693.71,710.91,694.13,697.74,708.23,699.74,695.66,694.55,701.33,710.33,700.55,700.33,694.32,696.15,702.91,704.55,705.75,696.64,693.73,696.75,704.2,699.91,703.07,703.86,701.41,701.16,699.67,698.94,693.17,696.66,697.1,702.08,697.78,707.37,705.12,701.42,694.01,697.71,698.31,697.26,704.03,704.38,703.47,701.89,699.37,699.75,702.3,698.45,699.45,697.95,698.96,691.71,583.25,359.77,356.61,366.14,297.84,239.02,221.91,231.27,401.57,429.81,455.57,437.63,605.75,755.05,716.6,705.46,697.4,694.28,701.29,698.29,702.36,707.05,700.16,692.92,697.05,701.56,351.24,709.69,701.41,698.18,697.8,695.59,695.93,704.87,703.81,706.27,698.48,694.1,697.67,699.55,705.61,706.96,693.21,695.88,700.42,699.27,708.31,707.71,697.98,697.7,699.75,695.1,698.25,711.63,703.21,696.33,694.23,700.05,710.6,700.44,696.88,695.9,695.96,701.4,704.43,702.06,709.31,699.06,698.63,696.44,697.34,694.68,399.71,353.45,354.34,339.94,255.31,236.72,224.78,284.31,441.45,456.95,431.01,460.57,754.34,742.91,697.43,695.67,697.43,697.84,705.72,703.47,699.73,704.38,700.63,692.92,698.83,696.21,704.73,706.88,702.86,703.39,694.22,696.75,698.26,698.65,702.22,708.63,702.94,690.61,695.27,701.61,705.89,708.76,699.74,691.98,696.49,696.38,708.24,704.01,700.41,695.25,699.92,696.53,708.29,703.95,700.46,698.3,699.23,698.48,697.21,706.54,706.67,702.6,699.42,700.04,703.91,699.67,692.98,696.96,697.76,701.87,701.77,539.33,359.25,355.28,366.1" }, "AVX512_CORE_FP16": { "value": "213.4,214.47,212.85,211.4,332.41,419.35,607.11,754.1,715.03,708.96,695.81,683.87,705.31,679.44,713.59,685.32,702.8,710.3,670.7,710.22,696.9,703.55,685.14,694.56,706.33,697.88,696.34,696.09,688.01,697.83,711.22,694.61,676.18,711.51,673.51,702.86,704.08,690.94,709.92,692.06,699.75,686.34,704.59,680.09,694.28,688.11,698.37,705.32,697.29,691.37,683.03,700,710.99,701.58,696.92,698.76,680.12,695.32,683.15,717.34,688.83,705.44,683.65,711.07,681.79,685.37,399.41,346.83,278.3,131.91,228.63,257.42,419.77,475.06,755.9,747.36,682.28,707.94,688.4,704.67,700.53,694.69,696.69,692.06,707.61,694.49,692.07,690.66,694.44,690.77,712.21,699,675.06,721.73,693.39,682.86,708.66,693.48,699.04,699.29,691.74,687.33,703.54,678.26,692.71,707.78,708.88,674.92,701.11,696.97,686.98,699.56,713.71,689.72,688.53,706.63,693.47,695.66,697.94,681.1,695.03,694.09,691.31,718.23,690.67,703.85,678.39,700.72,693.04,680.59,726.17,687.6,704.43,528.56,361.75,269.11,215.94,224.18,253.66,382.11,430.23,662.99,755.65,705.8,693.95,684.76,720.05,671.24,720.46,673.08,702.65,707.36,685.15,714.33,681.04,706.08,690.71,700.9,681.34,718.95,686.97,709.08,693.81,678,701.56,702.63,683.53,716.55,697.06,671.94,703.99,709.3,686.86,691.97,703.55,682.15,687.82,703.14,708.06,708.62,672.57,701.83,703.46,689.39,681.42,725.08,673.1,708.87,702.67,689.71,696.26,676.59,706.46,699.43,688.38,703.7,705.09,666.41,710.96,684.82,672.92,357.95" }, "AVX512_CORE_BF16": { "value": "230.29,218.66,213.32,210.44,319.91,414.28,556.57,754.15,713.1,704.22,695.28,711.21,696.41,703.73,693.37,704.82,681.38,710.06,688.73,685.14,703.37,710.39,676.57,691.11,699.02,698.03,716.36,681.65,705.65,671.26,344.68,718.02,704.66,695.19,676.44,696.58,695.57,701.97,699.28,696.2,692.53,689.8,711.79,687.89,687.67,712.83,701.69,704.35,689.64,690.73,708.58,690.45,701.73,693.93,696.84,700.8,679.41,701.72,702.39,689.27,706.99,683.17,698.51,690.59,703.79,706.71,437.43,364.36,308.24,295.14,232.18,228.27,399.94,438.61,722.24,752.21,698.19,702.84,671.75,719.7,695.08,698.14,683.52,703.25,706.9,693.45,706.34,684.24,709.25,704.8,702.24,691.43,683.24,695.69,692.91,701.46,701.01,690.34,708,701.91,699.71,677.79,705.57,711.02,682.08,707.73,687,689.89,701.12,701.15,706.8,682.6,678.74,722.75,684.89,694.1,712.22,698.58,699.46,699.3,697.81,684.68,704.38,688.67,706.63,703.96,699.12,696.67,677.42,716.55,690.24,708.11,687.74,608.47,357.5,332.75,265.42,222.89,233.98,351.95,420.07,589.91,753.28,698.87,722.11,686.79,709.47,686.39,688.91,713.56,699.33,678.68,715.95,693.47,690.45,704.56,684.61,711.61,682.99,694,713.25,690.51,698.51,690.47,707.88,679.1,713.2,692.94,684.96,717.26,686.27,697.67,708.22,676.57,705.76,709.93,687.22,709.07,678.84,693.92,696.26,706.89,689.49,706.1,701.48,689.68,708.3,682.99,690.37,699.3,709.4,699.74,690,703.12,701.8,681.17,704.91,701.78,677.89,714.74,685.74,406.38,367.74" }, "AVX512_CORE_VNNI": { "value": "222.26,211.68,227.89,219.35,352.72,421.69,607.63,739.94,728.85,694.38,705.26,699.06,699.74,705.32,700.31,701.66,698.41,699.59,706.74,692.17,708.43,703.09,697.69,701.02,700.82,697.39,705.22,702.93,697.67,705.16,702.46,702.38,699.99,701.57,700.46,702.62,703.13,691.89,709.46,699.82,704.22,693.83,702.6,349.77,710.45,698.3,702.06,691.17,713.84,698.33,705.07,700.17,700.68,701.79,704.63,697.2,692.79,713.14,695.98,703.83,700.11,702.02,701.46,704.74,700.99,696.8,396.04,354.99,273.89,217.87,209.62,258.66,405.41,440.69,708.39,747.82,706.63,704.57,702.16,701.25,699.21,701.49,700.72,703.35,700.2,703.61,693.6,709.83,703.52,702.43,699.58,700.63,703.28,699.55,700.65,703.64,696.65,700.79,704.15,704.14,700.98,699.03,699.58,706.36,700.91,699,702.91,697.48,702.79,706.98,697.89,703.62,698.76,703.32,700.47,702.29,700.63,705.69,692.81,710.38,694.3,702.94,701.36,703.94,700.83,699.46,701.86,706.1,699.06,695.59,708.51,699.95,702.93,613.93,360.04,349.57,274.26,224.01,215.14,302.92,416.64,502.91,737.8,731.89,701.27,705.56,701.17,702.32,702.61,699.19,701.4,703.07,701.99,702.76,701.58,700.71,701.87,702.43,698.79,700.18,703.35,705.59,698.4,703.7,704.02,701.68,704.54,701.35,702.47,701.96,701.69,701.2,702.78,701.17,700.44,703.54,702.4,698.48,704.32,703.05,702.26,702.34,695.18,704.92,703.67,700.81,701.94,699.06,700.86,704.72,699.61,702.77,699.83,700.15,701.93,703.79,702.95,703.37,702.69,699.42,701.78,512.01,357.08" }, "AVX512_CORE": { "value": "229.14,211.87,217.21,226.27,228.81,395.83,434.52,687.74,737.88,713.65,703.34,700.62,693.1,711.45,688.34,710.35,701.7,697.29,703.33,702.4,702.6,699.01,699.76,699.39,711.1,698.25,699.8,702.97,701.56,703.06,692.31,706.47,704.32,691.78,707.72,701.61,703.99,699.69,700.51,700.86,704.57,699.92,702.59,701.72,698.75,702.37,702,701.23,704.49,701.84,701.9,702.24,702.55,698.8,701.24,702.29,704.04,701.12,704.75,697.1,700.61,703.26,701.48,702.58,702.74,698.98,645.47,359.02,350.33,243.38,237.5,267.67,285.43,420.51,483.65,741.29,742.85,702.88,698.2,698.81,698.05,706.08,697.83,706.98,701,698.86,701.88,702.65,696.65,705.86,702.75,698.9,702.08,701.02,703.81,699.62,703.18,704.12,699.85,700.42,704.08,695.7,704.73,701.98,696.35,702.78,700.28,699.67,703.82,701.41,701.88,702.54,698.86,705.23,699.67,701.46,699.29,703.73,701.16,703.57,704.24,696.74,697.41,705.96,699.37,703.92,697.11,704.92,703.17,701.51,702.59,698.37,702.37,702.24,536.32,354.09,300.42,243.74,257.81,245.98,354.35,424.05,587.29,748.65,723.54,707.1,694.61,699.85,703.49,704.16,703.58,700.48,701.05,705.21,701.45,701.22,699.82,703.91,699.86,702.36,700.57,699.41,702.06,704.48,695.75,707,694.13,704.88,704.46,701.21,696.58,700.95,353.62,699.46,696.96,704.92,703.58,698.28,702.52,700.79,702.64,695.55,703.4,703.52,691.81,709.6,697.42,703.77,700.01,699.75,703.42,703.51,701.42,700.4,700.15,704.29,700.18,694.46,703.21,705.73,694.3,707.67,407.77" } } }, "6fbae9db9b34ba27af18dedf48b52fbb60dadfa6": { "title": "OpenVINO", "app_version": "2022.3", "arguments": "CPU Power Consumption -m models\/intel\/machine-translation-nar-en-de-0002\/FP16\/machine-translation-nar-en-de-0002.xml -d CPU", "description": "CPU Power Consumption Monitor", "scale": "Watts", "proportion": "LIB", "display_format": "LINE_GRAPH", "parent": "b3a8131fefe6128aa91a19d21376c4b9dbe300bf", "results": { "AVX512_CORE_AMX": { "value": "214.96,212.3,213.91,216.66,286.26,347.98,393.45,600.91,736.66,732.28,696.61,611.54,599.36,622.02,736.76,709.42,669.66,604.83,670.31,730.82,703.44,695.79,706.64,703.04,704.3,705.68,701.92,704.81,702.14,696.89,707.94,703.14,700.08,591.92,668.49,691.11,719.35,703.66,702.97,702.61,700.84,705.24,701.02,704.12,702.4,705.62,705,697.87,703.38,703.62,705.52,353.08,703.18,698.71,702.64,702.01,705.26,676.02,604.94,714.34,681,720.5,698.79,705.74,701.39,703.75,700.88,390.58,326.7,229.15,223.14,217.93,323.29,353.26,414.33,677.73,741.64,723.18,699.14,699.03,626.59,607.92,665.14,738.27,695.06,707.48,695.86,606.18,612.73,706.67,720.45,705.46,701.73,699.81,704.2,704.01,657.17,597.09,725.45,699.99,708.83,703.68,706.89,705.98,703.64,698.38,705.22,704.57,700.08,710.05,701.57,701.43,706.97,699.57,702.23,704,703.18,706.34,700.6,705.41,696.85,688.54,689.36,716.29,696.86,704.76,700.72,701.48,704.95,699.68,703.47,705.34,635.21,365.64,271.05,227.6,215.52,217.35,347.95,358.38,435.62,731.91,739.48,711.51,691.13,602.97,605.3,698.32,724.99,684.66,607.71,599.8,691.66,727.68,707.76,697.61,707.31,705.74,699.74,667.3,605.16,703.48,715.19,705.61,708.14,704.57,702,705.35,700.49,700.14,706.9,704.77,703.85,702.83,701.54,704.01,701.26,702.42,702.93,702.11,702.09,702.86,700.99,701.21,684.27,693.12,656.68,621.98,735.88,705.23,704.88,703.99,698.66,700.96,706.51,701.16,706.85,703.4,706.38,701.66,553.78,367.18" }, "AVX512_CORE_FP16": { "value": "216.11,213.33,219.88,211.46,216.99,349.86,361.02,458.14,749.45,754.87,698.4,702.1,701.32,703.63,657.18,720.22,699.11,699.91,703.94,713.91,701.34,700.82,700.51,701.33,702.12,700.92,701.34,705.17,702.38,703.47,704.08,704.11,704.23,700.57,704.31,702.55,699.91,698.95,702.56,703.11,704.17,701.94,703.52,703.08,704.38,706.68,350.95,705.01,699.63,703.72,700.96,705.81,701.7,698.91,704.13,700.06,707.68,700.85,703.6,700.84,702.28,700.73,700.89,702.61,700.28,696.87,701.14,615.28,363.69,270.63,224.93,214.64,272.38,352.49,361.27,433.89,738.71,756.37,700.53,698.77,633.56,739.11,700.5,697.25,699.15,702.21,701.85,701.48,702.55,700.99,714.38,699.07,704.55,702.31,702.05,697.63,700.04,702.6,703.92,702.33,703.16,704.8,704.04,700.19,699.71,701.76,700.93,702.33,699.47,706.95,703.2,701.84,702.21,703.74,703.85,702.05,704.01,702.37,703.48,704.54,703.18,704.38,703.17,700.99,702.5,702.66,700.89,704.01,703.87,700.78,702.02,702.18,703.29,701.16,703.86,601.11,365.38,277.92,216.78,215.29,223.49,352.97,364.32,456.05,750.07,753.43,702.42,702.2,700.08,702,700.31,695.61,703.42,702.55,700.19,703.85,708.84,699.15,698.77,701.85,702.13,706.63,705.22,702.95,701.29,705.15,702.85,700.22,701.13,702.62,702.01,700.62,701.58,701.46,705.63,700.75,702.24,698.73,705.3,701.17,704.56,701.9,708.29,698.92,705.4,704.67,702.29,701.09,701.81,702,702.5,703.93,700.9,703.83,704.44,704.97,703.47,703.41,701.89,705.84,697.11,700.12,703.06,593.68,366.86" }, "AVX512_CORE_BF16": { "value": "217.83,209.17,215.72,227.73,324.73,353.66,414.14,688.98,756.02,634.8,371.27,687.5,702.53,698.8,702.46,701.15,700.07,704.55,699.1,705.3,701.29,705.57,707.34,699.78,701.09,696.15,704.21,705.46,702.82,703.17,701.68,704.04,700.07,701.15,703.29,700.46,702.98,701.42,701.72,703.31,705.43,707.94,695.71,698.72,701.89,703.63,701.53,701.95,702.23,706.35,703.15,700.22,698.53,704.96,703.38,705.43,699.38,700.56,705.27,712.39,702.06,700.88,703.95,701.21,700.34,704.08,650,359.41,289.84,216.45,231.74,249.38,346.74,360.47,416.6,736.57,755.74,705.38,685.33,606.33,616.33,754.53,700.22,699.41,698.91,568.56,719.71,716.58,704.92,704.23,700.42,700.65,700.35,701.79,701.8,699.87,704.1,705.88,695.8,708.54,704.65,703.42,700.43,699.42,701.51,699.29,700.22,707.78,700.67,702.69,706.18,700.85,700.38,697.98,701.59,699.18,702.74,701.12,705.4,699.67,704.07,709.41,703.65,702.26,702.39,704.25,700.38,700.95,700.68,706.86,700.63,702.67,700.42,706.91,646.29,360.89,321.35,221.36,248.35,219.68,336.25,361.42,416.41,717,755.79,707.56,699.46,655.6,704.77,705.91,702.62,704.25,698.97,702.39,706.13,641,712.89,705.21,710.28,697.87,699.88,701.3,699.45,700.34,699.4,701.06,704.12,701.01,712.83,702.76,700.27,701.18,700.92,698.32,700.31,702.61,705.89,707.33,704.06,701.36,702.94,701.56,700.57,352.26,702.14,699.89,703.02,697.81,708.82,699.3,700.23,702.24,709.34,707.5,703.01,701.21,704.24,701.31,702.23,704.64,700.02,704.33,622.78,368.18" }, "AVX512_CORE_VNNI": { "value": "211.75,208.28,211.21,215.44,264.91,348.97,381.11,505.71,750.71,669.06,719.88,711.8,705.33,705.75,688.51,711.61,701.7,701.86,711.3,702.59,710.98,701.37,347.15,708.95,711.11,690.53,715.55,697.46,699.1,713.33,705.19,694.64,702,705.6,680.78,703.14,705.97,707.2,698.13,710.58,695.01,695.26,707.91,701.49,705.49,705.81,702.6,706.55,701.01,700.8,708.64,606.06,703.8,729.01,706,700.92,694.16,696.75,705.25,706.37,706.06,707.06,703.2,683.19,705.69,713.17,694.49,457.11,358.58,253.97,223.7,219.6,254.28,354.29,378.99,490.93,750.02,652.65,733.25,701.15,709.03,701.68,691.24,678.71,721.72,703.8,706.61,702.7,702.68,703.2,699.02,700.48,705.3,699.31,709.97,704.36,692.81,712.59,706.45,701.52,707.78,703.28,702.37,647.61,616.68,750.8,695.05,702.65,709.31,696.7,712.12,699.27,692.43,705.17,708.65,704.63,699.28,700.62,711.56,707.73,689.72,711.74,702.25,707.23,691.37,704.25,699.14,707.6,716.01,698.9,705.52,701.6,689.2,703.83,706.11,447.41,339.53,280.27,281.73,231.05,278.09,353.44,384.79,536.47,749.34,630.88,539.36,676.24,747.88,694.93,703.58,350.95,715.23,684.78,699.2,719.53,705.53,696.54,689.05,702.54,713.6,699.01,712.55,660.01,733,691.49,712.79,706.83,703.13,707.21,694.36,709.45,703.5,706.65,704.19,706.49,695.71,714.41,690.88,708.48,709.33,699.36,709.06,708.04,592.58,738.96,700.68,693.41,709.07,712.48,703.15,698.33,696.96,714.23,702.2,693.12,712.56,709.19,701.46,699.12,709.47,705.79,706.52,417.5" }, "AVX512_CORE": { "value": "218.69,230.03,224.04,227.6,210.91,345.79,360.17,417.71,691.07,689.55,533.34,732.86,715.16,711.14,706.67,704.97,699.4,709.97,702.93,697.55,698.06,694.26,703.71,641.07,734.67,662.41,700.97,713.27,704.47,692.31,710.64,687.28,713.09,708.88,704.97,707.53,705.67,702.6,704.07,697,706.41,704.35,683.35,709.58,699.76,705.82,708.85,712.92,702.85,699,713.91,682.69,710.24,703.37,700.32,713.16,692.74,714.01,706.81,702.98,718.17,691.93,702.48,716.57,700.1,694.16,699.72,577.03,367.53,294.82,250.12,215.33,224.14,350.93,360.23,430.45,707.16,705.2,604.47,743.9,701.84,698.21,685.9,723.36,701.95,703.73,704.66,689.27,714.01,709.37,698.33,704.19,706.52,702.38,645.46,679.32,730.73,686.03,705.49,713.74,701.18,697.81,708.49,687.71,715.49,707.1,346.29,706.79,690.66,696.48,707.9,708.06,574.89,674.52,732.11,702.56,702.94,705.05,697.16,703.56,698.22,694.23,718.95,695.54,707.14,702.57,699.18,705.37,703.15,705.38,699.12,702.87,705.83,696.02,702.8,526.88,493.12,361.31,299.73,237.55,239.64,236.5,349.76,365.9,453.33,732.43,689.42,704.53,715.66,700.46,683.53,709.97,709.78,707.55,702.01,697.99,717.07,696.85,585.57,557.77,753.43,708.49,698.55,713.97,688.32,706.65,709.97,686.09,719.56,687.07,703.83,710.78,675.52,700.44,714.6,696.54,702.68,697.71,691.7,719.52,718.56,700.93,704.46,704.38,705.2,696.82,715.75,704.36,699.23,711.89,703.36,712.19,698.64,709.56,647.81,684.93,726.27,694.56,700.97,705.11,708.39,700.62,704.41,708.32,500.32" } } } } }