onnx runtime 1.14 amd ryzen 7900

AMD Ryzen 9 7900 12-Core testing with a Gigabyte B650M DS3H (F4h BIOS) and Gigabyte AMD Raphael 512MB on Ubuntu 22.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2302113-NE-ONNXRUNTI86
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
February 11 2023
  7 Hours, 15 Minutes
b
February 11 2023
  55 Minutes
c
February 11 2023
  55 Minutes
Invert Hiding All Results Option
  3 Hours, 1 Minute

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "onnx runtime 1.14 amd ryzen 7900", "last_modified": "2023-02-11 12:26:06", "description": "AMD Ryzen 9 7900 12-Core testing with a Gigabyte B650M DS3H (F4h BIOS) and Gigabyte AMD Raphael 512MB on Ubuntu 22.10 via the Phoronix Test Suite.", "systems": { "a": { "identifier": "a", "hardware": { "Processor": "AMD Ryzen 9 7900 12-Core @ 3.70GHz (12 Cores \/ 24 Threads)", "Motherboard": "Gigabyte B650M DS3H (F4h BIOS)", "Chipset": "AMD Device 14d8", "Memory": "32GB", "Disk": "1000GB Sabrent Rocket 4.0 Plus", "Graphics": "Gigabyte AMD Raphael 512MB (2200\/2400MHz)", "Audio": "AMD Rembrandt Radeon HD Audio", "Monitor": "ASUS VP28U", "Network": "Realtek RTL8125 2.5GbE" }, "software": { "OS": "Ubuntu 22.10", "Kernel": "6.2.0-060200rc5daily20230129-generic (x86_64)", "Desktop": "GNOME Shell 43.0", "Display Server": "X Server 1.21.1.4 + Wayland", "OpenGL": "4.6 Mesa 23.0.0-devel (git-e20564c 2022-12-12 kinetic-oibaf-ppa) (LLVM 15.0.5 DRM 3.49)", "Vulkan": "1.3.235", "Compiler": "GCC 12.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2023-02-11 07:31:41", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-12-U8K4Qv\/gcc-12-12.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-12-U8K4Qv\/gcc-12-12.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0xa601203", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "b": { "identifier": "b", "hardware": { "Processor": "AMD Ryzen 9 7900 12-Core @ 3.70GHz (12 Cores \/ 24 Threads)", "Motherboard": "Gigabyte B650M DS3H (F4h BIOS)", "Chipset": "AMD Device 14d8", "Memory": "32GB", "Disk": "1000GB Sabrent Rocket 4.0 Plus", "Graphics": "Gigabyte AMD Raphael 512MB (2200\/2400MHz)", "Audio": "AMD Rembrandt Radeon HD Audio", "Monitor": "ASUS VP28U", "Network": "Realtek RTL8125 2.5GbE" }, "software": { "OS": "Ubuntu 22.10", "Kernel": "6.2.0-060200rc5daily20230129-generic (x86_64)", "Desktop": "GNOME Shell 43.0", "Display Server": "X Server 1.21.1.4 + Wayland", "OpenGL": "4.6 Mesa 23.0.0-devel (git-e20564c 2022-12-12 kinetic-oibaf-ppa) (LLVM 15.0.5 DRM 3.49)", "Vulkan": "1.3.235", "Compiler": "GCC 12.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2023-02-11 11:22:54", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-12-U8K4Qv\/gcc-12-12.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-12-U8K4Qv\/gcc-12-12.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0xa601203", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "c": { "identifier": "c", "hardware": { "Processor": "AMD Ryzen 9 7900 12-Core @ 3.70GHz (12 Cores \/ 24 Threads)", "Motherboard": "Gigabyte B650M DS3H (F4h BIOS)", "Chipset": "AMD Device 14d8", "Memory": "32GB", "Disk": "1000GB Sabrent Rocket 4.0 Plus", "Graphics": "Gigabyte AMD Raphael 512MB (2200\/2400MHz)", "Audio": "AMD Rembrandt Radeon HD Audio", "Monitor": "ASUS VP28U", "Network": "Realtek RTL8125 2.5GbE" }, "software": { "OS": "Ubuntu 22.10", "Kernel": "6.2.0-060200rc5daily20230129-generic (x86_64)", "Desktop": "GNOME Shell 43.0", "Display Server": "X Server 1.21.1.4 + Wayland", "OpenGL": "4.6 Mesa 23.0.0-devel (git-e20564c 2022-12-12 kinetic-oibaf-ppa) (LLVM 15.0.5 DRM 3.49)", "Vulkan": "1.3.235", "Compiler": "GCC 12.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2023-02-11 11:54:00", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-12-U8K4Qv\/gcc-12-12.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-12-U8K4Qv\/gcc-12-12.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0xa601203", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.10.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "5b2cd069406d1fb59ee3e25459d63a3dd635c7ab": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "GPT2\/model.onnx -e cpu -P", "description": "Model: GPT-2 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 117.6200000000000045474735088646411895751953125, "raw_values": [ 117.326999999999998181010596454143524169921875, 117.451999999999998181010596454143524169921875, 118.0799999999999982946974341757595539093017578125 ], "test_run_times": [ 90.719999999999998863131622783839702606201171875, 90.719999999999998863131622783839702606201171875, 90.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 119.30500000000000682121026329696178436279296875, "test_run_times": [ 90.7300000000000039790393202565610408782958984375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 117.986999999999994770405464805662631988525390625, "test_run_times": [ 90.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "eaf722af0d509821209012ba40aa451c31fa09f5": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "GPT2\/model.onnx -e cpu -P", "description": "Model: GPT-2 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "5b2cd069406d1fb59ee3e25459d63a3dd635c7ab", "results": { "a": { "value": 8.497939999999999827196006663143634796142578125, "raw_values": [ 8.5191800000000004189359970041550695896148681640625, 8.510149999999999437250153278000652790069580078125, 8.4644999999999992468247000942938029766082763671875 ], "test_run_times": [ 90.719999999999998863131622783839702606201171875, 90.719999999999998863131622783839702606201171875, 90.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 8.3783100000000008122924555209465324878692626953125, "test_run_times": [ 90.7300000000000039790393202565610408782958984375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 8.4714399999999994150812199222855269908905029296875, "test_run_times": [ 90.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "18eb3fbdbce2f91534f36992094de496bd2ff0ab": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "GPT2\/model.onnx -e cpu", "description": "Model: GPT-2 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 139.8509999999999990905052982270717620849609375, "raw_values": [ 137.6970000000000027284841053187847137451171875, 140.628999999999990677679306827485561370849609375, 141.2259999999999990905052982270717620849609375 ], "test_run_times": [ 90.7000000000000028421709430404007434844970703125, 90.7000000000000028421709430404007434844970703125, 90.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 140.46399999999999863575794734060764312744140625, "test_run_times": [ 90.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 140.868999999999999772626324556767940521240234375, "test_run_times": [ 90.7099999999999937472239253111183643341064453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "466bffd0e3581dc98a80821a88aa2f54692b673e": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "GPT2\/model.onnx -e cpu", "description": "Model: GPT-2 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "18eb3fbdbce2f91534f36992094de496bd2ff0ab", "results": { "a": { "value": 7.1493599999999997152144715073518455028533935546875, "raw_values": [ 7.26016999999999956827423375216312706470489501953125, 7.108959999999999723740984336473047733306884765625, 7.07894999999999985362819643341936171054840087890625 ], "test_run_times": [ 90.7000000000000028421709430404007434844970703125, 90.7000000000000028421709430404007434844970703125, 90.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 7.1173500000000000653699316899292171001434326171875, "test_run_times": [ 90.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 7.096650000000000346744855050928890705108642578125, "test_run_times": [ 90.7099999999999937472239253111183643341064453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "e2c360fe003cf9ba3e337e2596c3720ddcc49172": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "yolov4\/yolov4.onnx -e cpu -P", "description": "Model: yolov4 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 7.8923100000000001585931386216543614864349365234375, "raw_values": [ 7.96262999999999987466026141191832721233367919921875, 7.792880000000000251247911364771425724029541015625, 7.92142000000000034987124308827333152294158935546875 ], "test_run_times": [ 90.56999999999999317878973670303821563720703125, 90.56999999999999317878973670303821563720703125, 90.5199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 7.85662000000000038113512346171773970127105712890625, "test_run_times": [ 90.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 7.885220000000000339923644787631928920745849609375, "test_run_times": [ 90.5400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "41b7016a0043002a38230c7388ba933c5e57d4aa": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "yolov4\/yolov4.onnx -e cpu -P", "description": "Model: yolov4 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "e2c360fe003cf9ba3e337e2596c3720ddcc49172", "results": { "a": { "value": 126.71399999999999863575794734060764312744140625, "raw_values": [ 125.58400000000000318323145620524883270263671875, 128.31999999999999317878973670303821563720703125, 126.23799999999999954525264911353588104248046875 ], "test_run_times": [ 90.56999999999999317878973670303821563720703125, 90.56999999999999317878973670303821563720703125, 90.5199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 127.27899999999999636202119290828704833984375, "test_run_times": [ 90.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 126.8179999999999978399500832892954349517822265625, "test_run_times": [ 90.5400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "cac3f3df1e19f0dcdfe3e3b075749a97a151045a": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "yolov4\/yolov4.onnx -e cpu", "description": "Model: yolov4 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 9.7849500000000002586375558166764676570892333984375, "raw_values": [ 10.6747999999999994003019310184754431247711181640625, 7.84330999999999978200548866880126297473907470703125, 10.152300000000000324007487506605684757232666015625, 10.68299999999999982946974341757595539093017578125, 10.6548999999999995935695551452226936817169189453125, 7.820660000000000167119651450775563716888427734375, 7.83133999999999996788346834364347159862518310546875, 10.4094999999999995310417943983338773250579833984375, 10.4275000000000002131628207280300557613372802734375, 10.6631000000000000227373675443232059478759765625, 7.84077000000000001733724275254644453525543212890625, 10.1138999999999992240873325499705970287322998046875, 10.38550000000000039790393202565610408782958984375, 10.55049999999999954525264911353588104248046875, 10.7231000000000005201172825763933360576629638671875 ], "test_run_times": [ 90.5400000000000062527760746888816356658935546875, 90.5199999999999960209606797434389591217041015625, 90.5400000000000062527760746888816356658935546875, 90.530000000000001136868377216160297393798828125, 90.5199999999999960209606797434389591217041015625, 90.530000000000001136868377216160297393798828125, 90.5400000000000062527760746888816356658935546875, 90.5199999999999960209606797434389591217041015625, 90.56000000000000227373675443232059478759765625, 90.5499999999999971578290569595992565155029296875, 90.56000000000000227373675443232059478759765625, 90.5799999999999982946974341757595539093017578125, 90.5499999999999971578290569595992565155029296875, 90.56000000000000227373675443232059478759765625, 90.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 10.705500000000000682121026329696178436279296875, "test_run_times": [ 90.5199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 10.3651999999999997470467860694043338298797607421875, "test_run_times": [ 90.5199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "d0f86d1150ac36a31726821da754faed26fc1b77": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "yolov4\/yolov4.onnx -e cpu", "description": "Model: yolov4 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "cac3f3df1e19f0dcdfe3e3b075749a97a151045a", "results": { "a": { "value": 103.9428999999999945202944218181073665618896484375, "raw_values": [ 93.6761000000000052523319027386605739593505859375, 127.4950000000000045474735088646411895751953125, 98.4971000000000032059688237495720386505126953125, 93.6046999999999940200723358429968357086181640625, 93.8512999999999948386175674386322498321533203125, 127.86299999999999954525264911353588104248046875, 127.688999999999992951416061259806156158447265625, 96.0638000000000005229594535194337368011474609375, 95.8974999999999937472239253111183643341064453125, 93.77920000000000300133251585066318511962890625, 127.53600000000000136424205265939235687255859375, 98.87139999999999417923390865325927734375, 96.28530000000000654836185276508331298828125, 94.77989999999999781721271574497222900390625, 93.2544999999999930651028989814221858978271484375 ], "test_run_times": [ 90.5400000000000062527760746888816356658935546875, 90.5199999999999960209606797434389591217041015625, 90.5400000000000062527760746888816356658935546875, 90.530000000000001136868377216160297393798828125, 90.5199999999999960209606797434389591217041015625, 90.530000000000001136868377216160297393798828125, 90.5400000000000062527760746888816356658935546875, 90.5199999999999960209606797434389591217041015625, 90.56000000000000227373675443232059478759765625, 90.5499999999999971578290569595992565155029296875, 90.56000000000000227373675443232059478759765625, 90.5799999999999982946974341757595539093017578125, 90.5499999999999971578290569595992565155029296875, 90.56000000000000227373675443232059478759765625, 90.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 93.4080000000000012505552149377763271331787109375, "test_run_times": [ 90.5199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 96.4741999999999961801222525537014007568359375, "test_run_times": [ 90.5199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "9c0b2aaf50b7668b0752137cee23dbe2d4edad91": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu -P", "description": "Model: bertsquad-12 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 12.724399999999999266719896695576608180999755859375, "raw_values": [ 12.6818000000000008498091119690798223018646240234375, 12.5513999999999992240873325499705970287322998046875, 12.9399999999999995026200849679298698902130126953125 ], "test_run_times": [ 90.6299999999999954525264911353588104248046875, 90.6200000000000045474735088646411895751953125, 90.590000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 12.6537000000000006139089236967265605926513671875, "test_run_times": [ 90.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 12.5677000000000003154809746774844825267791748046875, "test_run_times": [ 90.650000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "a61b0190bd4e2e27541497cc191c952eebc9f19d": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu -P", "description": "Model: bertsquad-12 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "9c0b2aaf50b7668b0752137cee23dbe2d4edad91", "results": { "a": { "value": 78.599999999999994315658113919198513031005859375, "raw_values": [ 78.8512999999999948386175674386322498321533203125, 79.6706999999999965211827657185494899749755859375, 77.27809999999999490682967007160186767578125 ], "test_run_times": [ 90.6299999999999954525264911353588104248046875, 90.6200000000000045474735088646411895751953125, 90.590000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 79.0267000000000052750692702829837799072265625, "test_run_times": [ 90.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 79.5670999999999963847585604526102542877197265625, "test_run_times": [ 90.650000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "b832834046fd70ff0953021ad618091c25c1408d": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu", "description": "Model: bertsquad-12 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 16.31269999999999953388396534137427806854248046875, "raw_values": [ 16.434899999999998954081092961132526397705078125, 18.055599999999998317434801720082759857177734375, 17.89189999999999969304553815163671970367431640625, 18.140499999999999403144101961515843868255615234375, 17.60510000000000019326762412674725055694580078125, 18.1263000000000005229594535194337368011474609375, 12.417899999999999494093572138808667659759521484375, 15.9244000000000003325340003357268869876861572265625, 12.3940999999999998948396751075051724910736083984375, 12.545700000000000073896444519050419330596923828125, 18.17060000000000030695446184836328029632568359375, 18.045300000000001006128513836301863193511962890625 ], "test_run_times": [ 90.6299999999999954525264911353588104248046875, 90.6400000000000005684341886080801486968994140625, 90.6200000000000045474735088646411895751953125, 90.599999999999994315658113919198513031005859375, 90.6200000000000045474735088646411895751953125, 90.6099999999999994315658113919198513031005859375, 90.6200000000000045474735088646411895751953125, 90.6400000000000005684341886080801486968994140625, 90.6299999999999954525264911353588104248046875, 90.659999999999996589394868351519107818603515625, 90.6099999999999994315658113919198513031005859375, 90.6299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 18.268699999999999050714905024506151676177978515625, "test_run_times": [ 90.6200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 18.060500000000001108446667785756289958953857421875, "test_run_times": [ 90.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "3020f9500886f073b24e12333ea8f50f4e36c187": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu", "description": "Model: bertsquad-12 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "b832834046fd70ff0953021ad618091c25c1408d", "results": { "a": { "value": 62.78020000000000067075234255753457546234130859375, "raw_values": [ 60.8438000000000016598278307355940341949462890625, 55.3826999999999998181010596454143524169921875, 55.889600000000001500666257925331592559814453125, 55.123300000000000409272615797817707061767578125, 56.79990000000000094360075308941304683685302734375, 55.1666000000000025238477974198758602142333984375, 80.5267999999999943838702165521681308746337890625, 62.7948999999999983856469043530523777008056640625, 80.68139999999999645297066308557987213134765625, 79.706500000000005456968210637569427490234375, 55.0320999999999997953636921010911464691162109375, 55.4144000000000005456968210637569427490234375 ], "test_run_times": [ 90.6299999999999954525264911353588104248046875, 90.6400000000000005684341886080801486968994140625, 90.6200000000000045474735088646411895751953125, 90.599999999999994315658113919198513031005859375, 90.6200000000000045474735088646411895751953125, 90.6099999999999994315658113919198513031005859375, 90.6200000000000045474735088646411895751953125, 90.6400000000000005684341886080801486968994140625, 90.6299999999999954525264911353588104248046875, 90.659999999999996589394868351519107818603515625, 90.6099999999999994315658113919198513031005859375, 90.6299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 54.7368000000000023419488570652902126312255859375, "test_run_times": [ 90.6200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 55.3673000000000001818989403545856475830078125, "test_run_times": [ 90.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "0704eaeddc7c2d884e21f08fa1ba3bb85c909c9b": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu -P", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 747.70299999999997453414835035800933837890625, "raw_values": [ 748.0850000000000363797880709171295166015625, 746.953999999999950887286104261875152587890625, 748.0710000000000263753463514149188995361328125 ], "test_run_times": [ 90.1700000000000017053025658242404460906982421875, 90.159999999999996589394868351519107818603515625, 90.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 756.2089999999999463398125953972339630126953125, "test_run_times": [ 90.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 747.9420000000000072759576141834259033203125, "test_run_times": [ 90.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "e73ddb28ff53c37010825e491f13439092d3b35e": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu -P", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "0704eaeddc7c2d884e21f08fa1ba3bb85c909c9b", "results": { "a": { "value": 1.33643000000000000682121026329696178436279296875, "raw_values": [ 1.3357099999999999528910166191053576767444610595703125, 1.33790999999999993264054864994250237941741943359375, 1.335669999999999912887460595811717212200164794921875 ], "test_run_times": [ 90.1700000000000017053025658242404460906982421875, 90.159999999999996589394868351519107818603515625, 90.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 1.3212099999999999955235807647113688290119171142578125, "test_run_times": [ 90.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 1.3360499999999999598543354295543394982814788818359375, "test_run_times": [ 90.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "23ef58f619c7a985ae3c5f0865f07e076ba750ba": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 939.153000000000020008883439004421234130859375, "raw_values": [ 1029.990000000000009094947017729282379150390625, 1019.19000000000005456968210637569427490234375, 926.70299999999997453414835035800933837890625, 847.5040000000000190993887372314929962158203125, 826.836000000000012732925824820995330810546875, 1028.259999999999990905052982270717620849609375, 1025.799999999999954525264911353588104248046875, 846.0940000000000509317032992839813232421875, 865.933999999999969077180139720439910888671875, 1011.3999999999999772626324556767940521240234375, 840.44000000000005456968210637569427490234375, 1001.6799999999999499777914024889469146728515625 ], "test_run_times": [ 90.1400000000000005684341886080801486968994140625, 90.1400000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.1299999999999954525264911353588104248046875, 90.1400000000000005684341886080801486968994140625, 90.1400000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.1400000000000005684341886080801486968994140625, 90.159999999999996589394868351519107818603515625, 90.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 1014.19000000000005456968210637569427490234375, "test_run_times": [ 90.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 1015.490000000000009094947017729282379150390625, "test_run_times": [ 90.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "3b587d77d00d2e7ba396c7545b5007d10a04cc0e": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "caffenet-12-int8\/caffenet-12-int8.onnx -e cpu", "description": "Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "23ef58f619c7a985ae3c5f0865f07e076ba750ba", "results": { "a": { "value": 1.0729770000000000695905555403442122042179107666015625, "raw_values": [ 0.9705340000000000078017592386459000408649444580078125, 0.980836000000000041154635255225002765655517578125, 1.078580000000000094217966761789284646511077880859375, 1.17931000000000008043343768804334104061126708984375, 1.208979999999999943582906780648045241832733154296875, 0.97215200000000001612221467439667321741580963134765625, 0.9744580000000000463700189357041381299495697021484375, 1.18128000000000010771827874123118817806243896484375, 1.1542300000000000892441676114685833454132080078125, 0.9883420000000000538165068064699880778789520263671875, 1.1891400000000000858335624798201024532318115234375, 0.99787999999999998923527755323448218405246734619140625 ], "test_run_times": [ 90.1400000000000005684341886080801486968994140625, 90.1400000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.1299999999999954525264911353588104248046875, 90.1400000000000005684341886080801486968994140625, 90.1400000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.150000000000005684341886080801486968994140625, 90.1400000000000005684341886080801486968994140625, 90.159999999999996589394868351519107818603515625, 90.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 0.98563999999999996060040530210244469344615936279296875, "test_run_times": [ 90.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 0.984377999999999975244691086118109524250030517578125, "test_run_times": [ 90.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "787125f351541462776bbda7ae8c6c8a0ccfcc9d": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "fcn-resnet101-11\/model.onnx -e cpu -P", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1.4474899999999999433697439599200151860713958740234375, "raw_values": [ 1.466320000000000067785776991513557732105255126953125, 1.445489999999999941593387120519764721393585205078125, 1.430660000000000042774672692758031189441680908203125 ], "test_run_times": [ 90.849999999999994315658113919198513031005859375, 91.7099999999999937472239253111183643341064453125, 91.2600000000000051159076974727213382720947265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 1.4249700000000000699174051987938582897186279296875, "test_run_times": [ 91.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 1.465009999999999923403493085061199963092803955078125, "test_run_times": [ 91.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "44644f93c09b73b1004060660044332cf649ab1d": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "fcn-resnet101-11\/model.onnx -e cpu -P", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "787125f351541462776bbda7ae8c6c8a0ccfcc9d", "results": { "a": { "value": 690.9199999999999590727384202182292938232421875, "raw_values": [ 681.9779999999999517967808060348033905029296875, 691.80600000000004001776687800884246826171875, 698.9750000000000227373675443232059478759765625 ], "test_run_times": [ 90.849999999999994315658113919198513031005859375, 91.7099999999999937472239253111183643341064453125, 91.2600000000000051159076974727213382720947265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 701.7649999999999863575794734060764312744140625, "test_run_times": [ 91.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 682.5890000000000554791768081486225128173828125, "test_run_times": [ 91.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "aa4e5fd01d6546a36e0b67420892382edf28ad33": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "fcn-resnet101-11\/model.onnx -e cpu", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 2.4446799999999999641886461176909506320953369140625, "raw_values": [ 2.601620000000000043627323975670151412487030029296875, 1.898120000000000029416469260468147695064544677734375, 1.5820499999999999563016217507538385689258575439453125, 2.543089999999999850643916943226940929889678955078125, 2.54990000000000005542233338928781449794769287109375, 2.58980999999999994543031789362430572509765625, 2.504309999999999813979911778005771338939666748046875, 2.570510000000000072617467594682238996028900146484375, 2.608190000000000008384404281969182193279266357421875, 2.5093399999999999039346221252344548702239990234375, 2.6064600000000002211208993685431778430938720703125, 2.60362999999999988887111612712033092975616455078125, 2.473780000000000089954710347228683531284332275390625, 2.58476000000000016854073692229576408863067626953125 ], "test_run_times": [ 91.2900000000000062527760746888816356658935546875, 91.0799999999999982946974341757595539093017578125, 91.3700000000000045474735088646411895751953125, 91.0400000000000062527760746888816356658935546875, 91.18999999999999772626324556767940521240234375, 91.340000000000003410605131648480892181396484375, 91.219999999999998863131622783839702606201171875, 91.2300000000000039790393202565610408782958984375, 91.0799999999999982946974341757595539093017578125, 91.0499999999999971578290569595992565155029296875, 90.9200000000000017053025658242404460906982421875, 91.25, 91.1200000000000045474735088646411895751953125, 91.1299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 2.544119999999999937045913611655123531818389892578125, "test_run_times": [ 90.9899999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 2.612929999999999974846787154092453420162200927734375, "test_run_times": [ 91.2999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "d78c1221f9bb5420d511ab6ed7b35d79b0cbd743": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "fcn-resnet101-11\/model.onnx -e cpu", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "aa4e5fd01d6546a36e0b67420892382edf28ad33", "results": { "a": { "value": 417.423000000000001818989403545856475830078125, "raw_values": [ 384.37299999999999045030563138425350189208984375, 526.8350000000000363797880709171295166015625, 632.0890000000000554791768081486225128173828125, 393.22100000000000363797880709171295166015625, 392.17000000000001591615728102624416351318359375, 386.12700000000000954969436861574649810791015625, 399.31000000000000227373675443232059478759765625, 389.02600000000001045918907038867473602294921875, 383.40600000000000591171556152403354644775390625, 398.50799999999998135535861365497112274169921875, 383.66000000000002501110429875552654266357421875, 384.07799999999997453414835035800933837890625, 404.23799999999999954525264911353588104248046875, 386.8799999999999954525264911353588104248046875 ], "test_run_times": [ 91.2900000000000062527760746888816356658935546875, 91.0799999999999982946974341757595539093017578125, 91.3700000000000045474735088646411895751953125, 91.0400000000000062527760746888816356658935546875, 91.18999999999999772626324556767940521240234375, 91.340000000000003410605131648480892181396484375, 91.219999999999998863131622783839702606201171875, 91.2300000000000039790393202565610408782958984375, 91.0799999999999982946974341757595539093017578125, 91.0499999999999971578290569595992565155029296875, 90.9200000000000017053025658242404460906982421875, 91.25, 91.1200000000000045474735088646411895751953125, 91.1299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 393.0620000000000118234311230480670928955078125, "test_run_times": [ 90.9899999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 382.70999999999997953636921010911464691162109375, "test_run_times": [ 91.2999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "a91965ff6807fd10d40c39e937d275b96784a9ef": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet100\/resnet100.onnx -e cpu -P", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 28.552499999999998436805981327779591083526611328125, "raw_values": [ 28.622299999999999187139110290445387363433837890625, 28.384499999999999175770426518283784389495849609375, 28.650700000000000500222085975110530853271484375 ], "test_run_times": [ 90.4599999999999937472239253111183643341064453125, 90.43000000000000682121026329696178436279296875, 90.43000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 28.01259999999999905639924691058695316314697265625, "test_run_times": [ 90.4599999999999937472239253111183643341064453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 28.480199999999999960209606797434389591217041015625, "test_run_times": [ 90.4500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "1fd2f96019ba090fcce292bed674bb4ffdfd5520": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet100\/resnet100.onnx -e cpu -P", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "a91965ff6807fd10d40c39e937d275b96784a9ef", "results": { "a": { "value": 35.02289999999999992041921359486877918243408203125, "raw_values": [ 34.9369999999999976125764078460633754730224609375, 35.229500000000001591615728102624416351318359375, 34.902299999999996771293808706104755401611328125 ], "test_run_times": [ 90.4599999999999937472239253111183643341064453125, 90.43000000000000682121026329696178436279296875, 90.43000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 35.6974000000000017962520360015332698822021484375, "test_run_times": [ 90.4599999999999937472239253111183643341064453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 35.11119999999999663486960344016551971435546875, "test_run_times": [ 90.4500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "95b922c4192b681ada81aabb54708264f4806fd2": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet100\/resnet100.onnx -e cpu", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 39.100200000000000954969436861574649810791015625, "raw_values": [ 27.52159999999999939745976007543504238128662109375, 28.143299999999999982946974341757595539093017578125, 40.86590000000000344471118296496570110321044921875, 40.5981000000000022964741219766438007354736328125, 40.88029999999999830606611794792115688323974609375, 40.919499999999999317878973670303821563720703125, 40.93130000000000023874235921539366245269775390625, 40.892099999999999226929503493010997772216796875, 40.9070999999999997953636921010911464691162109375, 40.18229999999999790816218592226505279541015625, 40.8275000000000005684341886080801486968994140625, 40.9457000000000022055246517993509769439697265625, 40.8509999999999990905052982270717620849609375, 41.1124999999999971578290569595992565155029296875, 40.92540000000000333102434524334967136383056640625 ], "test_run_times": [ 90.469999999999998863131622783839702606201171875, 90.469999999999998863131622783839702606201171875, 90.4500000000000028421709430404007434844970703125, 90.4500000000000028421709430404007434844970703125, 90.4500000000000028421709430404007434844970703125, 90.43000000000000682121026329696178436279296875, 90.4500000000000028421709430404007434844970703125, 90.43999999999999772626324556767940521240234375, 90.43000000000000682121026329696178436279296875, 90.43000000000000682121026329696178436279296875, 90.43000000000000682121026329696178436279296875, 90.4500000000000028421709430404007434844970703125, 90.43999999999999772626324556767940521240234375, 90.43999999999999772626324556767940521240234375, 90.43999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 39.80199999999999960209606797434389591217041015625, "test_run_times": [ 90.4500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 35.37160000000000081854523159563541412353515625, "test_run_times": [ 90.4500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "bd59ab4f1f02dc35e0fb175e43eee56039353ee9": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet100\/resnet100.onnx -e cpu", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "95b922c4192b681ada81aabb54708264f4806fd2", "results": { "a": { "value": 26.01429999999999864712663111276924610137939453125, "raw_values": [ 36.33279999999999887450030655600130558013916015625, 35.53009999999999735109668108634650707244873046875, 24.4686999999999983401721692644059658050537109375, 24.62989999999999923829818726517260074615478515625, 24.46000000000000085265128291212022304534912109375, 24.436699999999998311750459834001958370208740234375, 24.42960000000000064801497501321136951446533203125, 24.452999999999999403144101961515843868255615234375, 24.44409999999999882902557146735489368438720703125, 24.885000000000001563194018672220408916473388671875, 24.49170000000000158024704433046281337738037109375, 24.420899999999999607780409860424697399139404296875, 24.477699999999998681232682429254055023193359375, 24.321999999999999175770426518283784389495849609375, 24.43299999999999982946974341757595539093017578125 ], "test_run_times": [ 90.469999999999998863131622783839702606201171875, 90.469999999999998863131622783839702606201171875, 90.4500000000000028421709430404007434844970703125, 90.4500000000000028421709430404007434844970703125, 90.4500000000000028421709430404007434844970703125, 90.43000000000000682121026329696178436279296875, 90.4500000000000028421709430404007434844970703125, 90.43999999999999772626324556767940521240234375, 90.43000000000000682121026329696178436279296875, 90.43000000000000682121026329696178436279296875, 90.43000000000000682121026329696178436279296875, 90.4500000000000028421709430404007434844970703125, 90.43999999999999772626324556767940521240234375, 90.43999999999999772626324556767940521240234375, 90.43999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 25.122699999999998254907040973193943500518798828125, "test_run_times": [ 90.4500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 28.2700999999999993406163412146270275115966796875, "test_run_times": [ 90.4500000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "fc5f8a76259510c20a36cd4f49e6cfe1dc32cdd8": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu -P", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 342.10899999999998044586391188204288482666015625, "raw_values": [ 343.79599999999999226929503493010997772216796875, 342.26799999999997226041159592568874359130859375, 340.2640000000000100044417195022106170654296875 ], "test_run_times": [ 90.099999999999994315658113919198513031005859375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 343.33400000000000318323145620524883270263671875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 339.5579999999999927240423858165740966796875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "081c092a77120c168c7e60ece7ece5eeadfd497c": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu -P", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "fc5f8a76259510c20a36cd4f49e6cfe1dc32cdd8", "results": { "a": { "value": 2.922239999999999948698814478120766580104827880859375, "raw_values": [ 2.90777999999999980929032972198911011219024658203125, 2.9208400000000001028865881380625069141387939453125, 2.938099999999999933919525574310682713985443115234375 ], "test_run_times": [ 90.099999999999994315658113919198513031005859375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 2.91195000000000003836930773104541003704071044921875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 2.944179999999999797211103214067406952381134033203125, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "3904dace8de74462b70d810bd4da5b772b847bac": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 388.9189999999999827196006663143634796142578125, "raw_values": [ 360.91000000000002501110429875552654266357421875, 428.67200000000002546585164964199066162109375, 359.03800000000001091393642127513885498046875, 428.06499999999999772626324556767940521240234375, 388.15600000000000591171556152403354644775390625, 358.509999999999990905052982270717620849609375, 429.25299999999998590283212251961231231689453125, 358.90399999999999636202119290828704833984375, 360.7730000000000245563569478690624237060546875, 428.06900000000001682565198279917240142822265625, 422.67599999999998772182152606546878814697265625, 381.20999999999997953636921010911464691162109375, 387.30599999999998317434801720082759857177734375, 383.85800000000000409272615797817707061767578125, 358.3799999999999954525264911353588104248046875 ], "test_run_times": [ 90.0799999999999982946974341757595539093017578125, 90.0799999999999982946974341757595539093017578125, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 387.84300000000001773514668457210063934326171875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 358.93900000000002137312549166381359100341796875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "09f3fbb8489ccaf105ea7ca3c21bcf867b5d8a11": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "resnet50-v1-12-int8\/resnet50-v1-12-int8.onnx -e cpu", "description": "Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3904dace8de74462b70d810bd4da5b772b847bac", "results": { "a": { "value": 2.584750000000000103028696685214526951313018798828125, "raw_values": [ 2.770189999999999930224703348358161747455596923828125, 2.332380000000000119797505249152891337871551513671875, 2.784569999999999989626076057902537286281585693359375, 2.335360000000000102460262496606446802616119384765625, 2.57570999999999994400923242210410535335540771484375, 2.78856999999999999317878973670303821563720703125, 2.329079999999999817106299815350212156772613525390625, 2.785559999999999813979911778005771338939666748046875, 2.771059999999999856612475923611782491207122802734375, 2.335339999999999971436182022443972527980804443359375, 2.365340000000000220126139538479037582874298095703125, 2.622529999999999805737616043188609182834625244140625, 2.581379999999999785842419441905803978443145751953125, 2.604530000000000011795009413617663085460662841796875, 2.789709999999999912034809312899596989154815673828125 ], "test_run_times": [ 90.0799999999999982946974341757595539093017578125, 90.0799999999999982946974341757595539093017578125, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375, 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 2.577690000000000036806113712373189628124237060546875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 2.785270000000000134576794152962975203990936279296875, "test_run_times": [ 90.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "0571ea16ffb36714067fee7dee153c62e2a90b7f": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "super_resolution\/super_resolution.onnx -e cpu -P", "description": "Model: super-resolution-10 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 104.9539999999999935198502498678863048553466796875, "raw_values": [ 106.2409999999999996589394868351519107818603515625, 104.3799999999999954525264911353588104248046875, 104.2409999999999996589394868351519107818603515625 ], "test_run_times": [ 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 103.9839999999999946567186270840466022491455078125, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 105.14199999999999590727384202182292938232421875, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "ac5304a3f18e210c85a3e7c3f3dea178a02280be": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "super_resolution\/super_resolution.onnx -e cpu -P", "description": "Model: super-resolution-10 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "0571ea16ffb36714067fee7dee153c62e2a90b7f", "results": { "a": { "value": 9.528040000000000731006366549991071224212646484375, "raw_values": [ 9.411899999999999266719896695576608180999755859375, 9.5797299999999996344968167250044643878936767578125, 9.5924899999999997390887074288912117481231689453125 ], "test_run_times": [ 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 9.616189999999999571400621789507567882537841796875, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 9.510220000000000339923644787631928920745849609375, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "df5708436a64b6d94e0eeb1a56931916d646450a": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "super_resolution\/super_resolution.onnx -e cpu", "description": "Model: super-resolution-10 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 136.489000000000004320099833421409130096435546875, "raw_values": [ 120.099999999999994315658113919198513031005859375, 115.8479999999999989768184605054557323455810546875, 166.674000000000006593836587853729724884033203125, 110.6569999999999964757080306299030780792236328125, 146.18999999999999772626324556767940521240234375, 166.4859999999999899955582804977893829345703125, 162.606999999999999317878973670303821563720703125, 113.393000000000000682121026329696178436279296875, 107.951999999999998181010596454143524169921875, 116.715000000000003410605131648480892181396484375, 114.748999999999995225152815692126750946044921875, 165.55500000000000682121026329696178436279296875, 166.195999999999997953636921010911464691162109375, 107.9659999999999939745976007543504238128662109375, 166.25299999999998590283212251961231231689453125 ], "test_run_times": [ 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.030000000000001136868377216160297393798828125, 90.0400000000000062527760746888816356658935546875, 90.030000000000001136868377216160297393798828125, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 162.635999999999995679900166578590869903564453125, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 117.1490000000000009094947017729282379150390625, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "862e3e7e3f4aca2d33b3622e04296735e1978595": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "super_resolution\/super_resolution.onnx -e cpu", "description": "Model: super-resolution-10 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "df5708436a64b6d94e0eeb1a56931916d646450a", "results": { "a": { "value": 7.5790600000000001301714291912503540515899658203125, "raw_values": [ 8.3260500000000003950617610826157033443450927734375, 8.6316100000000002268052412546239793300628662109375, 5.99941000000000013159251466277055442333221435546875, 9.0365300000000008395772965741343796253204345703125, 6.84009999999999962483343551866710186004638671875, 6.00621999999999989228172125876881182193756103515625, 6.14951000000000025380586521350778639316558837890625, 8.818490000000000605950845056213438510894775390625, 9.2630199999999991433696777676232159137725830078125, 8.567479999999999762394509161822497844696044921875, 8.71433999999999997498889570124447345733642578125, 6.03999000000000041410430640098638832569122314453125, 6.016709999999999780584403197281062602996826171875, 9.2617999999999991445065461448393762111663818359375, 6.0146399999999999863575794734060764312744140625 ], "test_run_times": [ 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.030000000000001136868377216160297393798828125, 90.0400000000000062527760746888816356658935546875, 90.030000000000001136868377216160297393798828125, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875, 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 6.14843999999999990535570759675465524196624755859375, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 8.5357199999999995299049260211177170276641845703125, "test_run_times": [ 90.0400000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "0340e7bb87100a3f13e9513c02006c9d155f0cb0": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu -P", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 46.158400000000000318323145620524883270263671875, "raw_values": [ 47.874200000000001864464138634502887725830078125, 45.72200000000000130739863379858434200286865234375, 45.56680000000000063664629124104976654052734375, 45.47059999999999746478351880796253681182861328125 ], "test_run_times": [ 90.3299999999999982946974341757595539093017578125, 90.31999999999999317878973670303821563720703125, 90.31999999999999317878973670303821563720703125, 90.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 48.7839000000000027057467377744615077972412109375, "test_run_times": [ 90.2999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 45.54549999999999698729880037717521190643310546875, "test_run_times": [ 90.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "8bdda5e9f0e7001d731aa406ca7eb417222a2c59": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu -P", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "0340e7bb87100a3f13e9513c02006c9d155f0cb0", "results": { "a": { "value": 21.672399999999999664623828721232712268829345703125, "raw_values": [ 20.886500000000001620037437533028423786163330078125, 21.868900000000000005684341886080801486968994140625, 21.943999999999999062083588796667754650115966796875, 21.9902000000000015234036254696547985076904296875 ], "test_run_times": [ 90.3299999999999982946974341757595539093017578125, 90.31999999999999317878973670303821563720703125, 90.31999999999999317878973670303821563720703125, 90.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 20.497099999999999653255144949071109294891357421875, "test_run_times": [ 90.2999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 21.954100000000000392219590139575302600860595703125, "test_run_times": [ 90.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "22f150dd22dc4c7bcab389338bbe70c627e81c37": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard", "scale": "Inferences Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 56.476799999999997226041159592568874359130859375, "raw_values": [ 62.0080999999999988858689903281629085540771484375, 48.56320000000000192130755749531090259552001953125, 48.8541000000000025238477974198758602142333984375, 62.2586000000000012732925824820995330810546875, 60.91470000000000339923644787631928920745849609375, 61.0979999999999989768184605054557323455810546875, 48.57730000000000103455022326670587062835693359375, 62.076099999999996725819073617458343505859375, 48.3248999999999995225152815692126750946044921875, 62.42269999999999896544977673329412937164306640625, 62.078800000000001091393642127513885498046875, 61.1426000000000016143530956469476222991943359375, 62.330500000000000682121026329696178436279296875, 48.457999999999998408384271897375583648681640625, 48.0439999999999969304553815163671970367431640625 ], "test_run_times": [ 90.3700000000000045474735088646411895751953125, 90.3799999999999954525264911353588104248046875, 90.3700000000000045474735088646411895751953125, 90.3599999999999994315658113919198513031005859375, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3599999999999994315658113919198513031005859375, 90.3599999999999994315658113919198513031005859375, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3599999999999994315658113919198513031005859375, 90.3700000000000045474735088646411895751953125, 90.3799999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 48.3156000000000034333424991928040981292724609375, "test_run_times": [ 90.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 48.23530000000000228510543820448219776153564453125, "test_run_times": [ 90.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } }, "9d8967d7eeca8d574f6227d47af5577c817fec0c": { "identifier": "pts\/onnx-1.6.0", "title": "ONNX Runtime", "app_version": "1.14", "arguments": "FasterRCNN-12-int8\/FasterRCNN-12-int8.onnx -e cpu", "description": "Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard", "scale": "Inference Time Cost (ms)", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "22f150dd22dc4c7bcab389338bbe70c627e81c37", "results": { "a": { "value": 17.95810000000000172803993336856365203857421875, "raw_values": [ 16.1253999999999990677679306827485561370849609375, 20.589200000000001722355591482482850551605224609375, 20.466899999999998982502802391536533832550048828125, 16.060199999999998254907040973193943500518798828125, 16.41460000000000007958078640513122081756591796875, 16.365300000000001290345608140341937541961669921875, 20.5835000000000007958078640513122081756591796875, 16.10770000000000123918653116561472415924072265625, 20.69160000000000110276232589967548847198486328125, 16.018100000000000449063009000383317470550537109375, 16.106500000000000483169060316868126392364501953125, 16.353300000000000835598257253877818584442138671875, 16.041799999999998505018083960749208927154541015625, 20.6347999999999984765963745303452014923095703125, 20.81230000000000046611603465862572193145751953125 ], "test_run_times": [ 90.3700000000000045474735088646411895751953125, 90.3799999999999954525264911353588104248046875, 90.3700000000000045474735088646411895751953125, 90.3599999999999994315658113919198513031005859375, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3599999999999994315658113919198513031005859375, 90.3599999999999994315658113919198513031005859375, 90.3700000000000045474735088646411895751953125, 90.3700000000000045474735088646411895751953125, 90.3599999999999994315658113919198513031005859375, 90.3700000000000045474735088646411895751953125, 90.3799999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "b": { "value": 20.695299999999999585043042316101491451263427734375, "test_run_times": [ 90.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } }, "c": { "value": 20.729600000000001358557710773311555385589599609375, "test_run_times": [ 90.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto=auto -fno-fat-lto-objects -ldl -lrt" } } } } } } }