intel onnx

Tests for a future article. Intel Core i5-14500 testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel UHD 770 ADL-S GT1 31GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2402046-NE-INTELONNX64
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
February 04
  41 Minutes
b
February 04
  41 Minutes
c
February 04
  41 Minutes
d
February 04
  41 Minutes
Invert Hiding All Results Option
  41 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "intel onnx", "last_modified": "2024-02-04 22:20:45", "description": "Tests for a future article. Intel Core i5-14500 testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel UHD 770 ADL-S GT1 31GB on Ubuntu 23.10 via the Phoronix Test Suite.", "systems": { "a": { "identifier": "a", "hardware": { "Processor": "Intel Core i5-14600K @ 5.30GHz (14 Cores \/ 20 Threads)", "Motherboard": "ASUS PRIME Z790-P WIFI (1402 BIOS)", "Chipset": "Intel Device 7a27", "Memory": "2 x 16GB DRAM-6000MT\/s Corsair CMK32GX5M2B6000C36", "Disk": "1024GB SOLIDIGM SSDPFKKW010X7", "Graphics": "ASUS Intel RPL-S 31GB (1550MHz)", "Audio": "Realtek ALC897", "Monitor": "ASUS VP28U" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.7.0-060700-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3.1", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2024-02-04 20:11:03", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x11d", "cpu-thermald": "2.5.4", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "b": { "identifier": "b", "hardware": { "Processor": "Intel Core i5-14600K @ 5.30GHz (14 Cores \/ 20 Threads)", "Motherboard": "ASUS PRIME Z790-P WIFI (1402 BIOS)", "Chipset": "Intel Device 7a27", "Memory": "2 x 16GB DRAM-6000MT\/s Corsair CMK32GX5M2B6000C36", "Disk": "1024GB SOLIDIGM SSDPFKKW010X7", "Graphics": "ASUS Intel RPL-S 31GB (1550MHz)", "Audio": "Realtek ALC897", "Monitor": "ASUS VP28U" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.7.0-060700-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3.1", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2024-02-04 20:42:42", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x11d", "cpu-thermald": "2.5.4", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "c": { "identifier": "c", "hardware": { "Processor": "Intel Core i5-14500 @ 5.00GHz (14 Cores \/ 20 Threads)", "Motherboard": "ASUS PRIME Z790-P WIFI (1402 BIOS)", "Chipset": "Intel Device 7a27", "Memory": "2 x 16GB DRAM-6000MT\/s Corsair CMK32GX5M2B6000C36", "Disk": "1024GB SOLIDIGM SSDPFKKW010X7", "Graphics": "ASUS Intel UHD 770 ADL-S GT1 31GB (1550MHz)", "Audio": "Realtek ALC897", "Monitor": "ASUS VP28U" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.7.0-060700-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3.1", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2024-02-04 21:11:53", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x32", "cpu-thermald": "2.5.4", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "d": { "identifier": "d", "hardware": { "Processor": "Intel Core i5-14500 @ 5.00GHz (14 Cores \/ 20 Threads)", "Motherboard": "ASUS PRIME Z790-P WIFI (1402 BIOS)", "Chipset": "Intel Device 7a27", "Memory": "2 x 16GB DRAM-6000MT\/s Corsair CMK32GX5M2B6000C36", "Disk": "1024GB SOLIDIGM SSDPFKKW010X7", "Graphics": "ASUS Intel UHD 770 ADL-S GT1 31GB (1550MHz)", "Audio": "Realtek ALC897", "Monitor": "ASUS VP28U" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.7.0-060700-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3.1", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2024-02-04 21:42:00", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x32", "cpu-thermald": "2.5.4", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "cd5e4093dc1c14c9a2852e842de9e0570a17e64e": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "GPT2\/model.onnx -e cpu -P", "description": "Model: GPT-2 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 109.530000000000001136868377216160297393798828125, "test_run_times": [ 60.96000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 113.1970000000000027284841053187847137451171875, "test_run_times": [ 61.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 109.356999999999999317878973670303821563720703125, "test_run_times": [ 61.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 107.328000000000002955857780762016773223876953125, "test_run_times": [ 61 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "900b5f85935262c2771285cadf049fd541b80243": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "GPT2\/model.onnx -e cpu -P", "description": "Model: GPT-2 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "cd5e4093dc1c14c9a2852e842de9e0570a17e64e", "results": { "a": { "value": 9.1251400000000000289901436190120875835418701171875, "test_run_times": [ 60.96000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 8.830049999999999954525264911353588104248046875, "test_run_times": [ 61.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 9.13992999999999966576069709844887256622314453125, "test_run_times": [ 61.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 9.313069999999999737383404863066971302032470703125, "test_run_times": [ 61 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "89d1d12a9d70dbf470d3d5d6cf1988ed3cb92c1a": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "GPT2\/model.onnx -e cpu", "description": "Model: GPT-2 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 173.5049999999999954525264911353588104248046875, "test_run_times": [ 60.9500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 174.027999999999991587174008600413799285888671875, "test_run_times": [ 60.96000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 176.034999999999996589394868351519107818603515625, "test_run_times": [ 60.909999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 176.57499999999998863131622783839702606201171875, "test_run_times": [ 60.9200000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "ecc134a0b483b07e1539f2319519a2833a4e70af": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "GPT2\/model.onnx -e cpu", "description": "Model: GPT-2 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "89d1d12a9d70dbf470d3d5d6cf1988ed3cb92c1a", "results": { "a": { "value": 5.760130000000000194404492503963410854339599609375, "test_run_times": [ 60.9500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 5.7428200000000000358113538823090493679046630859375, "test_run_times": [ 60.96000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 5.6771300000000000096633812063373625278472900390625, "test_run_times": [ 60.909999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 5.65922999999999998266275724745355546474456787109375, "test_run_times": [ 60.9200000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "8a893b9d1f6cefb97afe1462834159232e1f2565": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "yolov4\/yolov4.onnx -e cpu -P", "description": "Model: yolov4 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 10.0397999999999996134647517465054988861083984375, "test_run_times": [ 60.780000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 10.5772999999999992581933838664554059505462646484375, "test_run_times": [ 60.74000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 10.1778999999999992809307514107786118984222412109375, "test_run_times": [ 60.78999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 9.4891600000000000392219590139575302600860595703125, "test_run_times": [ 60.78999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "c082b35bef2fbe75508758eec7614d00f7a2ee95": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "yolov4\/yolov4.onnx -e cpu -P", "description": "Model: yolov4 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "8a893b9d1f6cefb97afe1462834159232e1f2565", "results": { "a": { "value": 99.60169999999999390638549812138080596923828125, "test_run_times": [ 60.780000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 94.5408000000000043883119360543787479400634765625, "test_run_times": [ 60.74000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 98.24979999999999336068867705762386322021484375, "test_run_times": [ 60.78999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 105.381000000000000227373675443232059478759765625, "test_run_times": [ 60.78999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "ab7cb919e39d0f4d0c8506a0809149c8cb0d0d20": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "yolov4\/yolov4.onnx -e cpu", "description": "Model: yolov4 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 12.847300000000000608224581810645759105682373046875, "test_run_times": [ 60.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 12.8285000000000000142108547152020037174224853515625, "test_run_times": [ 60.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 11.841499999999999914734871708787977695465087890625, "test_run_times": [ 60.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 11.8566000000000002501110429875552654266357421875, "test_run_times": [ 60.72999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "646bb247a08a192674de0b2dae316b9aaa9fc1a4": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "yolov4\/yolov4.onnx -e cpu", "description": "Model: yolov4 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "ab7cb919e39d0f4d0c8506a0809149c8cb0d0d20", "results": { "a": { "value": 77.83580000000000609361450187861919403076171875, "test_run_times": [ 60.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 77.9497000000000070940586738288402557373046875, "test_run_times": [ 60.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 84.44679999999999608917278237640857696533203125, "test_run_times": [ 60.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 84.3392999999999943838702165521681308746337890625, "test_run_times": [ 60.72999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "f3b73606b5d879d38dc20a198023024adae4424d": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "t5-encoder\/t5-encoder.onnx -e cpu -P", "description": "Model: T5 Encoder - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 134.58899999999999863575794734060764312744140625, "test_run_times": [ 60.63000000000000255795384873636066913604736328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 126.4380000000000023874235921539366245269775390625, "test_run_times": [ 60.63000000000000255795384873636066913604736328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 133.1399999999999863575794734060764312744140625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 129.33899999999999863575794734060764312744140625, "test_run_times": [ 60.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "c2ef99c0096c37c13d3b8ec683a8d4185a70820c": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "t5-encoder\/t5-encoder.onnx -e cpu -P", "description": "Model: T5 Encoder - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "f3b73606b5d879d38dc20a198023024adae4424d", "results": { "a": { "value": 7.42879000000000022652102416031993925571441650390625, "test_run_times": [ 60.63000000000000255795384873636066913604736328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 7.90740999999999960579089020029641687870025634765625, "test_run_times": [ 60.63000000000000255795384873636066913604736328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 7.5095200000000001949729266925714910030364990234375, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 7.73020999999999958163243718445301055908203125, "test_run_times": [ 60.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "9d4915ebd74bea1828ab4914412637070c9b37de": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "t5-encoder\/t5-encoder.onnx -e cpu", "description": "Model: T5 Encoder - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 201.509999999999990905052982270717620849609375, "test_run_times": [ 60.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 201.770000000000010231815394945442676544189453125, "test_run_times": [ 60.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 208.88200000000000500222085975110530853271484375, "test_run_times": [ 60.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 210.03100000000000591171556152403354644775390625, "test_run_times": [ 60.56000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "548f1e55bbed0c6ae01a274210c3c51ef564891e": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "t5-encoder\/t5-encoder.onnx -e cpu", "description": "Model: T5 Encoder - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "9d4915ebd74bea1828ab4914412637070c9b37de", "results": { "a": { "value": 4.96161000000000029785951483063399791717529296875, "test_run_times": [ 60.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 4.955239999999999866986399865709245204925537109375, "test_run_times": [ 60.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 4.7864500000000003154809746774844825267791748046875, "test_run_times": [ 60.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 4.75973999999999985988097250810824334621429443359375, "test_run_times": [ 60.56000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "43b4afd3f62d41ac2ff03c77e7650323066f6725": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu -P", "description": "Model: bertsquad-12 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 16.07000000000000028421709430404007434844970703125, "test_run_times": [ 60.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 13.728500000000000369482222595252096652984619140625, "test_run_times": [ 60.74000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 12.5892999999999997129407347529195249080657958984375, "test_run_times": [ 60.7999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 14.432700000000000528643795405514538288116455078125, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "c4ebdb2ada39490ef68eca9e552a95ba4f10a11c": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu -P", "description": "Model: bertsquad-12 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "43b4afd3f62d41ac2ff03c77e7650323066f6725", "results": { "a": { "value": 62.2254999999999967030817060731351375579833984375, "test_run_times": [ 60.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 72.83990000000000009094947017729282379150390625, "test_run_times": [ 60.74000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 79.4309999999999973852027324028313159942626953125, "test_run_times": [ 60.7999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 69.2845999999999975216269376687705516815185546875, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "de426ac858a42a1e9f1ae6c3179b9db958a5344d": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu", "description": "Model: bertsquad-12 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 18.46039999999999992041921359486877918243408203125, "test_run_times": [ 60.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 18.54260000000000019326762412674725055694580078125, "test_run_times": [ 60.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 17.327799999999999869260136620141565799713134765625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 17.31960000000000121644916362129151821136474609375, "test_run_times": [ 60.68999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "6829a0514bf57215c97acea53d4bb8d695a51357": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu", "description": "Model: bertsquad-12 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "de426ac858a42a1e9f1ae6c3179b9db958a5344d", "results": { "a": { "value": 54.1681999999999987949195201508700847625732421875, "test_run_times": [ 60.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 53.92830000000000012505552149377763271331787109375, "test_run_times": [ 60.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 57.708899999999999863575794734060764312744140625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 57.73649999999999948840923025272786617279052734375, "test_run_times": [ 60.68999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "8cefb8b19dbb87fd91e13e52e3a069f47fbdb74d": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu -P", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 266.06400000000002137312549166381359100341796875, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 263.01699999999999590727384202182292938232421875, "test_run_times": [ 60.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 247.001000000000004774847184307873249053955078125, "test_run_times": [ 60.2000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 249.431000000000011596057447604835033416748046875, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "0df5715144d2b8933c0193df0f6cdd0fffbf4f38": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu -P", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "8cefb8b19dbb87fd91e13e52e3a069f47fbdb74d", "results": { "a": { "value": 3.75731999999999999317878973670303821563720703125, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 3.800739999999999785273985253297723829746246337890625, "test_run_times": [ 60.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 4.0471500000000002472688720445148646831512451171875, "test_run_times": [ 60.2000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 4.00771000000000032770230973255820572376251220703125, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "a9d4e90139ab4993a50345390d7b7f9bef06a2f3": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 722.9239999999999781721271574497222900390625, "test_run_times": [ 60.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 710.9379999999999881765688769519329071044921875, "test_run_times": [ 60.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 649.3300000000000409272615797817707061767578125, "test_run_times": [ 60.159999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 654.423000000000001818989403545856475830078125, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "3e92ac6967b6f850dfda44d1ae73221c00933431": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "a9d4e90139ab4993a50345390d7b7f9bef06a2f3", "results": { "a": { "value": 1.38253000000000003666400516522116959095001220703125, "test_run_times": [ 60.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 1.4058900000000000840572056404198519885540008544921875, "test_run_times": [ 60.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 1.5390699999999999381117277152952738106250762939453125, "test_run_times": [ 60.159999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 1.5272300000000000874678107720683328807353973388671875, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "4cd61b80c22d72c875494a1230130405e2b801ea": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "fcn-resnet101-11\/model.onnx -e cpu -P", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1.5804400000000000670041799821774475276470184326171875, "test_run_times": [ 61.2000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 1.520259999999999944719775157864205539226531982421875, "test_run_times": [ 61.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 1.35742999999999991445065461448393762111663818359375, "test_run_times": [ 61.67999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 1.4499400000000000066080474425689317286014556884765625, "test_run_times": [ 61.21000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "8b7e0ac95d00a330b6ca05c1864dcd4bbc6c0909": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "fcn-resnet101-11\/model.onnx -e cpu -P", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "4cd61b80c22d72c875494a1230130405e2b801ea", "results": { "a": { "value": 632.7340000000000372892827726900577545166015625, "test_run_times": [ 61.2000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 657.7809999999999490682967007160186767578125, "test_run_times": [ 61.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 736.683999999999969077180139720439910888671875, "test_run_times": [ 61.67999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 689.6799999999999499777914024889469146728515625, "test_run_times": [ 61.21000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "6058b2b7f123ceed327ddaa1efd1289747b1f7e2": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "fcn-resnet101-11\/model.onnx -e cpu", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 2.11385999999999985021759130177088081836700439453125, "test_run_times": [ 61.02000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 2.09046000000000020691004465334117412567138671875, "test_run_times": [ 61.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 1.7817700000000000759570184527547098696231842041015625, "test_run_times": [ 61.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 1.7800700000000000411404244005098007619380950927734375, "test_run_times": [ 61.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "7bf00cc4d90b5be8c6b0a6d16ee012dd4ab0933f": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "fcn-resnet101-11\/model.onnx -e cpu", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6058b2b7f123ceed327ddaa1efd1289747b1f7e2", "results": { "a": { "value": 473.06599999999997407940099947154521942138671875, "test_run_times": [ 61.02000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 478.36200000000002319211489520967006683349609375, "test_run_times": [ 61.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 561.2369999999999663486960344016551971435546875, "test_run_times": [ 61.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 561.7740000000000009094947017729282379150390625, "test_run_times": [ 61.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "b8ce3adf200be7c2dbaf48a2975eae4cadd7c56a": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet100\/resnet100.onnx -e cpu -P", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.2546400000000001995204002014361321926116943359375, "test_run_times": [ 60.72999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 8.2322900000000007736389306955970823764801025390625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 7.63407999999999997697841536137275397777557373046875, "test_run_times": [ 60.8299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 7.5340699999999998226485331542789936065673828125, "test_run_times": [ 60.77000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "42d1c91a130d86641096a66fbb0773e7febf6e23": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet100\/resnet100.onnx -e cpu -P", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "b8ce3adf200be7c2dbaf48a2975eae4cadd7c56a", "results": { "a": { "value": 121.143000000000000682121026329696178436279296875, "test_run_times": [ 60.72999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 121.4719999999999942019712761975824832916259765625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 130.990000000000009094947017729282379150390625, "test_run_times": [ 60.8299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 132.729000000000013415046851150691509246826171875, "test_run_times": [ 60.77000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "9b31d5f903505b627078b0640b940c58c9b64d25": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet100\/resnet100.onnx -e cpu", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.51173000000000001818989403545856475830078125, "test_run_times": [ 60.67999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 8.4981799999999996231281329528428614139556884765625, "test_run_times": [ 60.659999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 7.78146999999999966490804581553675234317779541015625, "test_run_times": [ 60.6400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 7.7807300000000001460875864722765982151031494140625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "a951c25b44e0be4321382698fbb87cd15315c951": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet100\/resnet100.onnx -e cpu", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "9b31d5f903505b627078b0640b940c58c9b64d25", "results": { "a": { "value": 117.4839999999999946567186270840466022491455078125, "test_run_times": [ 60.67999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 117.6710000000000064801497501321136951446533203125, "test_run_times": [ 60.659999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 128.508999999999986130205797962844371795654296875, "test_run_times": [ 60.6400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 128.52199999999999135980033315718173980712890625, "test_run_times": [ 60.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "be9015d33da2127ae45d639c4f30bd3f30dfa92f": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu -P", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 135.109000000000008867573342286050319671630859375, "test_run_times": [ 60.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 132.06000000000000227373675443232059478759765625, "test_run_times": [ 60.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 124.2039999999999935198502498678863048553466796875, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 125.5919999999999987494447850622236728668212890625, "test_run_times": [ 60.159999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "506aa12229999f575c0b09c736991fa0d6ca9ca3": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu -P", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "be9015d33da2127ae45d639c4f30bd3f30dfa92f", "results": { "a": { "value": 7.40035000000000042774672692758031189441680908203125, "test_run_times": [ 60.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 7.5709900000000001085709300241433084011077880859375, "test_run_times": [ 60.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 8.0497899999999997788791006314568221569061279296875, "test_run_times": [ 60.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 7.96089999999999964330754664842970669269561767578125, "test_run_times": [ 60.159999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "dfedfca9a0d6c7455741aa65e9eee1b27e300a02": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 239.33899999999999863575794734060764312744140625, "test_run_times": [ 60.11999999999999744204615126363933086395263671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 239.941000000000002501110429875552654266357421875, "test_run_times": [ 60.10000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 216.777999999999991587174008600413799285888671875, "test_run_times": [ 60.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 217.52600000000001045918907038867473602294921875, "test_run_times": [ 60.11999999999999744204615126363933086395263671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "0929ded4741613169cc08b76e5be43b11b6bef99": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "dfedfca9a0d6c7455741aa65e9eee1b27e300a02", "results": { "a": { "value": 4.1775999999999999801048033987171947956085205078125, "test_run_times": [ 60.11999999999999744204615126363933086395263671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 4.16706999999999982975396051187999546527862548828125, "test_run_times": [ 60.10000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 4.6122899999999997788791006314568221569061279296875, "test_run_times": [ 60.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 4.59654000000000007020162229309789836406707763671875, "test_run_times": [ 60.11999999999999744204615126363933086395263671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "5cbd2e79e9c57f005a7016f70b1494bde8789f54": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "super_resolution\/super_resolution.onnx -e cpu -P", "description": "Model: super-resolution-10 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 64.272099999999994679455994628369808197021484375, "test_run_times": [ 60.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 64.7913999999999958845364744774997234344482421875, "test_run_times": [ 60.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 63.6816000000000030922819860279560089111328125, "test_run_times": [ 60.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 61.312600000000003319655661471188068389892578125, "test_run_times": [ 60.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "4773a7aadffbc6d56fefd006170b560c643da43d": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "super_resolution\/super_resolution.onnx -e cpu -P", "description": "Model: super-resolution-10 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "5cbd2e79e9c57f005a7016f70b1494bde8789f54", "results": { "a": { "value": 15.557900000000000062527760746888816356658935546875, "test_run_times": [ 60.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 15.4334000000000006735945135005749762058258056640625, "test_run_times": [ 60.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 15.7019999999999999573674358543939888477325439453125, "test_run_times": [ 60.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 16.308800000000001517719283583573997020721435546875, "test_run_times": [ 60.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "89abe0aaa579bc5609ebf044dc792c1262430103": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "super_resolution\/super_resolution.onnx -e cpu", "description": "Model: super-resolution-10 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 82.6431999999999931105776340700685977935791015625, "test_run_times": [ 60.06000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 82.668499999999994543031789362430572509765625, "test_run_times": [ 60.06000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 79.1907000000000067529981606639921665191650390625, "test_run_times": [ 60.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 79.1886999999999972033037920482456684112548828125, "test_run_times": [ 60.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "738e2c9fd6e5597316e35acd39ab26dbbec4f48f": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "super_resolution\/super_resolution.onnx -e cpu", "description": "Model: super-resolution-10 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "89abe0aaa579bc5609ebf044dc792c1262430103", "results": { "a": { "value": 12.0998000000000001108446667785756289958953857421875, "test_run_times": [ 60.06000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 12.096000000000000085265128291212022304534912109375, "test_run_times": [ 60.06000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 12.6271000000000004348521542851813137531280517578125, "test_run_times": [ 60.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 12.6274999999999995026200849679298698902130126953125, "test_run_times": [ 60.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "5ed90c8878f70bd27c1ca52f7839a6240fb4fd95": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu -P", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 39.9746999999999985675458447076380252838134765625, "test_run_times": [ 61.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 39.46029999999999660076355212368071079254150390625, "test_run_times": [ 61.38000000000000255795384873636066913604736328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 36.23349999999999937472239253111183643341064453125, "test_run_times": [ 61.52000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 36.16239999999999810142981004901230335235595703125, "test_run_times": [ 61.46000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "22c3156abe8aebf86909bf9cef6300931ebbaaef": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu -P", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "5ed90c8878f70bd27c1ca52f7839a6240fb4fd95", "results": { "a": { "value": 25.014199999999998880184648442082107067108154296875, "test_run_times": [ 61.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 25.34009999999999962483343551866710186004638671875, "test_run_times": [ 61.38000000000000255795384873636066913604736328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 27.596900000000001540456651127897202968597412109375, "test_run_times": [ 61.52000000000000312638803734444081783294677734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 27.65129999999999910187398199923336505889892578125, "test_run_times": [ 61.46000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "4a08410d5caf508543af690ae84dfb33adcb834d": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 53.149799999999999045030563138425350189208984375, "test_run_times": [ 61.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 52.44879999999999853343979339115321636199951171875, "test_run_times": [ 61.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 46.17609999999999814690454513765871524810791015625, "test_run_times": [ 61.49000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 45.98310000000000030695446184836328029632568359375, "test_run_times": [ 61.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "a0768922bfa6b213ab4289b8480531db3385cfe9": { "identifier": "pts\/onnx-1.17.0", "title": "ONNX Runtime", "app_version": "1.17", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "4a08410d5caf508543af690ae84dfb33adcb834d", "results": { "a": { "value": 18.813300000000001688249540165998041629791259765625, "test_run_times": [ 61.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 19.064299999999999357669366872869431972503662109375, "test_run_times": [ 61.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 21.654599999999998516386767732910811901092529296875, "test_run_times": [ 61.49000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "d": { "value": 21.74549999999999982946974341757595539093017578125, "test_run_times": [ 61.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } } } }