onednn onnx alderlake

Intel Core i9-12900K testing with a ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS) and Gigabyte AMD Radeon RX 6800 XT 16GB on Ubuntu 21.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2203319-NE-ONEDNNONN20
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
A
March 31 2022
  1 Hour, 52 Minutes
B
March 31 2022
  1 Hour, 51 Minutes
C
March 31 2022
  1 Hour, 47 Minutes
D
March 31 2022
  1 Hour, 47 Minutes
Invert Hiding All Results Option
  1 Hour, 49 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


{ "title": "onednn onnx alderlake", "last_modified": "2022-03-31 18:01:40", "description": "Intel Core i9-12900K testing with a ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS) and Gigabyte AMD Radeon RX 6800 XT 16GB on Ubuntu 21.10 via the Phoronix Test Suite.", "systems": { "A": { "identifier": "A", "hardware": { "Processor": "Intel Core i9-12900K @ 5.20GHz (16 Cores \/ 24 Threads)", "Motherboard": "ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS)", "Chipset": "Intel Device 7aa7", "Memory": "32GB", "Disk": "1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB", "Graphics": "Gigabyte AMD Radeon RX 6800 XT 16GB (2575\/1000MHz)", "Audio": "Intel Device 7ad0", "Monitor": "ASUS VP28U", "Network": "Intel I225-V + Intel Wi-Fi 6 AX210\/AX211\/AX411" }, "software": { "OS": "Ubuntu 21.10", "Kernel": "5.17.0-phx (x86_64)", "Desktop": "GNOME Shell 40.5", "Display Server": "X Server 1.20.13 + Wayland", "OpenGL": "4.6 Mesa 22.1.0-devel (git-ae710f3 2022-03-26 impish-oibaf-ppa) (LLVM 13.0.1 DRM 3.46)", "Vulkan": "1.3.207", "Compiler": "GCC 11.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2022-03-31 05:14:04", "client_version": "10.8.2", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x18", "cpu-thermald": "2.4.6", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.9.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } }, "B": { "identifier": "B", "hardware": { "Processor": "Intel Core i9-12900K @ 5.20GHz (16 Cores \/ 24 Threads)", "Motherboard": "ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS)", "Chipset": "Intel Device 7aa7", "Memory": "32GB", "Disk": "1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB", "Graphics": "Gigabyte AMD Radeon RX 6800 XT 16GB (2575\/1000MHz)", "Audio": "Intel Device 7ad0", "Monitor": "ASUS VP28U", "Network": "Intel I225-V + Intel Wi-Fi 6 AX210\/AX211\/AX411" }, "software": { "OS": "Ubuntu 21.10", "Kernel": "5.17.0-phx (x86_64)", "Desktop": "GNOME Shell 40.5", "Display Server": "X Server 1.20.13 + Wayland", "OpenGL": "4.6 Mesa 22.1.0-devel (git-ae710f3 2022-03-26 impish-oibaf-ppa) (LLVM 13.0.1 DRM 3.46)", "Vulkan": "1.3.207", "Compiler": "GCC 11.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2022-03-31 07:33:04", "client_version": "10.8.2", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x18", "cpu-thermald": "2.4.6", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.9.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } }, "C": { "identifier": "C", "hardware": { "Processor": "Intel Core i9-12900K @ 5.20GHz (16 Cores \/ 24 Threads)", "Motherboard": "ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS)", "Chipset": "Intel Device 7aa7", "Memory": "32GB", "Disk": "1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB", "Graphics": "Gigabyte AMD Radeon RX 6800 XT 16GB (2575\/1000MHz)", "Audio": "Intel Device 7ad0", "Monitor": "ASUS VP28U", "Network": "Intel I225-V + Intel Wi-Fi 6 AX210\/AX211\/AX411" }, "software": { "OS": "Ubuntu 21.10", "Kernel": "5.17.0-phx (x86_64)", "Desktop": "GNOME Shell 40.5", "Display Server": "X Server 1.20.13 + Wayland", "OpenGL": "4.6 Mesa 22.1.0-devel (git-ae710f3 2022-03-26 impish-oibaf-ppa) (LLVM 13.0.1 DRM 3.46)", "Vulkan": "1.3.207", "Compiler": "GCC 11.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2022-03-31 12:06:58", "client_version": "10.8.2", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x18", "cpu-thermald": "2.4.6", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.9.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } }, "D": { "identifier": "D", "hardware": { "Processor": "Intel Core i9-12900K @ 5.20GHz (16 Cores \/ 24 Threads)", "Motherboard": "ASUS ROG STRIX Z690-E GAMING WIFI (1003 BIOS)", "Chipset": "Intel Device 7aa7", "Memory": "32GB", "Disk": "1000GB Western Digital WDS100T1X0E-00AFY0 + 2000GB", "Graphics": "Gigabyte AMD Radeon RX 6800 XT 16GB (2575\/1000MHz)", "Audio": "Intel Device 7ad0", "Monitor": "ASUS VP28U", "Network": "Intel I225-V + Intel Wi-Fi 6 AX210\/AX211\/AX411" }, "software": { "OS": "Ubuntu 21.10", "Kernel": "5.17.0-phx (x86_64)", "Desktop": "GNOME Shell 40.5", "Display Server": "X Server 1.20.13 + Wayland", "OpenGL": "4.6 Mesa 22.1.0-devel (git-ae710f3 2022-03-26 impish-oibaf-ppa) (LLVM 13.0.1 DRM 3.46)", "Vulkan": "1.3.207", "Compiler": "GCC 11.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "phoronix", "timestamp": "2022-03-31 14:09:18", "client_version": "10.8.2", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-ZPT0kp\/gcc-11-11.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate powersave (EPP: balance_performance)", "cpu-microcode": "0x18", "cpu-thermald": "2.4.6", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.9.7", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "c5969548ad50594c41c7c83f9df4af2edbd5215e": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu -P", "description": "Model: bertsquad-12 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 925, "raw_values": [ 911, 925.5, 939 ], "test_run_times": [ 120.7900000000000062527760746888816356658935546875, 120.780000000000001136868377216160297393798828125, 120.7300000000000039790393202565610408782958984375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 937, "raw_values": [ 956, 922, 904.5, 953.5, 948.5 ], "test_run_times": [ 120.81999999999999317878973670303821563720703125, 120.780000000000001136868377216160297393798828125, 120.7600000000000051159076974727213382720947265625, 120.7900000000000062527760746888816356658935546875, 120.780000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 933, "raw_values": [ 908, 949.5, 940 ], "test_run_times": [ 120.7900000000000062527760746888816356658935546875, 120.7399999999999948840923025272786617279052734375, 120.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 964, "raw_values": [ 950.5, 971.5, 969 ], "test_run_times": [ 120.7600000000000051159076974727213382720947265625, 120.7399999999999948840923025272786617279052734375, 120.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "94396e9e842f6113bc966382f57ec0e95f7395d2": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--deconv --batch=inputs\/deconv\/shapes_1d --cfg=f32 --engine=cpu", "description": "Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 8.2767999999999997129407347529195249080657958984375, "raw_values": [ 8.3232900000000000773070496506989002227783203125, 8.151270000000000237605490838177502155303955078125, 7.790060000000000428599378210492432117462158203125, 8.1047700000000002518163455533795058727264404296875, 8.7668300000000005667288860422559082508087158203125, 8.8637700000000005928768587182275950908660888671875, 8.51604999999999989768184605054557323455810546875, 8.8327000000000008839151632855646312236785888671875, 8.19866999999999990222931955941021442413330078125, 7.84649999999999980815346134477294981479644775390625, 8.2217000000000002302158463862724602222442626953125, 8.8549900000000008049028110690414905548095703125, 7.9015100000000000335376171278767287731170654296875, 7.9113600000000001699618223938159644603729248046875, 7.868520000000000180762071977369487285614013671875 ], "min_result": [ "4.02" ], "test_run_times": [ 21.07000000000000028421709430404007434844970703125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.07000000000000028421709430404007434844970703125, 21.10000000000000142108547152020037174224853515625, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.089999999999999857891452847979962825775146484375, 21.089999999999999857891452847979962825775146484375, 21.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 8.38410999999999972942532622255384922027587890625, "raw_values": [ 8.7475900000000006428990673157386481761932373046875, 9.3386200000000005871925168321467936038970947265625, 8.8567300000000006576783562195487320423126220703125, 8.7524099999999993571009326842613518238067626953125, 8.1914899999999999380406734417192637920379638671875, 8.074909999999999143938111956231296062469482421875, 8.4103200000000004621369953383691608905792236328125, 8.3478100000000008407141649513505399227142333984375, 8.1631000000000000227373675443232059478759765625, 8.2189099999999992718358043930493295192718505859375, 7.79328999999999982861709213466383516788482666015625, 8.721450000000000812860889709554612636566162109375, 7.96394999999999964046537570538930594921112060546875, 7.7969799999999995776533978641964495182037353515625 ], "min_result": [ "3.99" ], "test_run_times": [ 21.0799999999999982946974341757595539093017578125, 21.089999999999999857891452847979962825775146484375, 21.07000000000000028421709430404007434844970703125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.07000000000000028421709430404007434844970703125, 21.07000000000000028421709430404007434844970703125, 21.07000000000000028421709430404007434844970703125, 21.07000000000000028421709430404007434844970703125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.07000000000000028421709430404007434844970703125, 21.10000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 8.214150000000000062527760746888816356658935546875, "raw_values": [ 7.8044399999999995998223312199115753173828125, 8.3440799999999999414512785733677446842193603515625, 9.04090000000000060254023992456495761871337890625, 7.8571200000000001040234565152786672115325927734375, 7.8273700000000001608668753760866820812225341796875, 8.320460000000000633235686109401285648345947265625, 7.815870000000000317186277243308722972869873046875, 8.632799999999999585043042316101491451263427734375, 7.9699200000000001153921402874402701854705810546875, 8.455619999999999691908669774420559406280517578125, 7.868629999999999569126885035075247287750244140625, 8.7102699999999995128519003628753125667572021484375, 8.029180000000000205773176276125013828277587890625, 8.1793899999999997163513398845680058002471923828125, 8.356159999999999143938111956231296062469482421875 ], "min_result": [ "4.09" ], "test_run_times": [ 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.07000000000000028421709430404007434844970703125, 21.089999999999999857891452847979962825775146484375, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.07000000000000028421709430404007434844970703125, 21.10000000000000142108547152020037174224853515625, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.089999999999999857891452847979962825775146484375, 21.089999999999999857891452847979962825775146484375, 21.089999999999999857891452847979962825775146484375, 21.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 8.05084000000000088448359747417271137237548828125, "raw_values": [ 8.100590000000000401314537157304584980010986328125, 7.9372699999999998254907040973193943500518798828125, 8.1146499999999992525090419803746044635772705078125 ], "min_result": [ "4.24" ], "test_run_times": [ 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125, 21.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "9c8557669a8f6f1d066b71df2dd815459da87664": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--ip --batch=inputs\/ip\/shapes_3d --cfg=u8s8f32 --engine=cpu", "description": "Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 0.882082000000000032713387554395012557506561279296875, "raw_values": [ 0.88103600000000004133227093916502781212329864501953125, 0.88257200000000002315658775842166505753993988037109375, 0.88263700000000000489563944938709028065204620361328125 ], "min_result": [ "0.87" ], "test_run_times": [ 9.160000000000000142108547152020037174224853515625, 9.1699999999999999289457264239899814128875732421875, 9.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 0.85162700000000002287237066411762498319149017333984375, "raw_values": [ 0.8442009999999999791953086969442665576934814453125, 0.854516999999999971038278090418316423892974853515625, 0.856163000000000007361222742474637925624847412109375 ], "min_result": [ "0.83" ], "test_run_times": [ 9.160000000000000142108547152020037174224853515625, 9.1699999999999999289457264239899814128875732421875, 9.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 0.88179899999999999948840923025272786617279052734375, "raw_values": [ 0.87902000000000002355449169044732116162776947021484375, 0.87979200000000001846700570240500383079051971435546875, 0.88658400000000003871036824421025812625885009765625 ], "min_result": [ "0.86" ], "test_run_times": [ 9.160000000000000142108547152020037174224853515625, 9.160000000000000142108547152020037174224853515625, 9.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 0.8850569999999999826201246833079494535923004150390625, "raw_values": [ 0.879113999999999951029394651413895189762115478515625, 0.87771399999999999419486584883998148143291473388671875, 0.898341999999999973880449033458717167377471923828125 ], "min_result": [ "0.86" ], "test_run_times": [ 9.1699999999999999289457264239899814128875732421875, 9.160000000000000142108547152020037174224853515625, 9.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "2ad7cb023295fba19d65b19b9bc14fa7cd9c5935": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--ip --batch=inputs\/ip\/shapes_1d --cfg=u8s8f32 --engine=cpu", "description": "Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1.0827899999999999192112909440766088664531707763671875, "raw_values": [ 1.0530500000000000415667500419658608734607696533203125, 1.0675600000000000644462261334410868585109710693359375, 1.2290799999999999503330627703689970076084136962890625, 1.168460000000000054143356464919634163379669189453125, 1.071450000000000013500311979441903531551361083984375, 1.054489999999999927382532405317761003971099853515625, 1.0454499999999999904076730672386474907398223876953125, 1.042920000000000069206862463033758103847503662109375, 1.0568200000000000926547727431170642375946044921875, 1.039870000000000072049033406074158847332000732421875, 1.068729999999999957793761495850048959255218505859375, 1.20038000000000000255795384873636066913604736328125, 1.0423299999999999787547722007730044424533843994140625, 1.0447699999999999764810354463406838476657867431640625, 1.0565400000000000346744855050928890705108642578125 ], "min_result": [ "1.01" ], "test_run_times": [ 15.0800000000000000710542735760100185871124267578125, 15.0800000000000000710542735760100185871124267578125, 15.0800000000000000710542735760100185871124267578125, 15.0800000000000000710542735760100185871124267578125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125, 15.0800000000000000710542735760100185871124267578125, 15.07000000000000028421709430404007434844970703125, 15.0800000000000000710542735760100185871124267578125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 1.055779999999999940740735837607644498348236083984375, "raw_values": [ 1.03845000000000009521272659185342490673065185546875, 1.0643000000000000238031816479633562266826629638671875, 1.064599999999999990762944435118697583675384521484375 ], "min_result": [ "1.01" ], "test_run_times": [ 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125, 15.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 1.057539999999999924540361462277360260486602783203125, "raw_values": [ 1.051909999999999900666125540737994015216827392578125, 1.0748699999999999921129756330628879368305206298828125, 1.045830000000000037374547900981269776821136474609375 ], "min_result": [ "1.01" ], "test_run_times": [ 15.07000000000000028421709430404007434844970703125, 15.0800000000000000710542735760100185871124267578125, 15.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1.059229999999999893844915277441032230854034423828125, "raw_values": [ 1.059839999999999893276481088832952082157135009765625, 1.0552099999999999813127260495093651115894317626953125, 1.062650000000000094502183856093324720859527587890625 ], "min_result": [ "1.02" ], "test_run_times": [ 15.07000000000000028421709430404007434844970703125, 15.0800000000000000710542735760100185871124267578125, 15.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "8c77b59bd07f0e4b342c59bacd5ae573858701b4": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--ip --batch=inputs\/ip\/shapes_3d --cfg=f32 --engine=cpu", "description": "Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 3.912129999999999885318402448319830000400543212890625, "raw_values": [ 3.91120000000000000994759830064140260219573974609375, 3.91162000000000009691802915767766535282135009765625, 3.913559999999999927666749499621801078319549560546875 ], "min_result": [ "3.89" ], "test_run_times": [ 9.230000000000000426325641456060111522674560546875, 9.2200000000000006394884621840901672840118408203125, 9.2200000000000006394884621840901672840118408203125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 3.818869999999999986783905114862136542797088623046875, "raw_values": [ 3.82444000000000006167510946397669613361358642578125, 3.819430000000000102744479590910486876964569091796875, 3.812749999999999861444166526780463755130767822265625 ], "min_result": [ "3.78" ], "test_run_times": [ 9.230000000000000426325641456060111522674560546875, 9.2200000000000006394884621840901672840118408203125, 9.230000000000000426325641456060111522674560546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 3.884869999999999823359075890039093792438507080078125, "raw_values": [ 3.88872999999999979792164594982750713825225830078125, 3.881200000000000205346850634668953716754913330078125, 3.884679999999999910897940935683436691761016845703125 ], "min_result": [ "3.86" ], "test_run_times": [ 9.230000000000000426325641456060111522674560546875, 9.2200000000000006394884621840901672840118408203125, 9.230000000000000426325641456060111522674560546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 3.887169999999999792095195516594685614109039306640625, "raw_values": [ 3.89839000000000002188471626141108572483062744140625, 3.884279999999999954951590552809648215770721435546875, 3.87884999999999990905052982270717620849609375 ], "min_result": [ "3.85" ], "test_run_times": [ 9.230000000000000426325641456060111522674560546875, 9.2200000000000006394884621840901672840118408203125, 9.2200000000000006394884621840901672840118408203125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "c555af2e9a7163b27101505120fc9fb712dd488f": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "super_resolution\/super_resolution.onnx -e cpu -P", "description": "Model: super-resolution-10 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 4518, "raw_values": [ 4477.5, 4624.5, 4451 ], "test_run_times": [ 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 4504, "raw_values": [ 4457, 4629, 4425.5 ], "test_run_times": [ 120.0799999999999982946974341757595539093017578125, 120.099999999999994315658113919198513031005859375, 120.090000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 4444, "raw_values": [ 4399.5, 4498, 4434 ], "test_run_times": [ 120.090000000000003410605131648480892181396484375, 120.099999999999994315658113919198513031005859375, 120.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 4506, "raw_values": [ 4509, 4405, 4604 ], "test_run_times": [ 120.090000000000003410605131648480892181396484375, 120.090000000000003410605131648480892181396484375, 120.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "22dfb5c2ed5df4d56feb3b81ed3df682e629c488": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "bertsquad-12\/bertsquad-12.onnx -e cpu", "description": "Model: bertsquad-12 - Device: CPU - Executor: Standard", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 931, "raw_values": [ 925.5, 926.5, 941 ], "test_run_times": [ 120.68000000000000682121026329696178436279296875, 120.68000000000000682121026329696178436279296875, 120.6400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 916, "raw_values": [ 920.5, 908.5, 920 ], "test_run_times": [ 120.6700000000000017053025658242404460906982421875, 120.68999999999999772626324556767940521240234375, 120.650000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 918, "raw_values": [ 900, 925, 929.5 ], "test_run_times": [ 120.7000000000000028421709430404007434844970703125, 120.6400000000000005684341886080801486968994140625, 120.68000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 926, "raw_values": [ 921, 926, 930 ], "test_run_times": [ 120.6299999999999954525264911353588104248046875, 120.6700000000000017053025658242404460906982421875, 120.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "8cb62d0fa361648a680cee57606daa3ff598d1a1": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "GPT2\/model.onnx -e cpu -P", "description": "Model: GPT-2 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 7989, "raw_values": [ 8094, 7978, 7893.5 ], "test_run_times": [ 120.8900000000000005684341886080801486968994140625, 120.8299999999999982946974341757595539093017578125, 120.81999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 8110, "raw_values": [ 8206, 8064.5, 8060.5 ], "test_run_times": [ 120.8299999999999982946974341757595539093017578125, 120.8799999999999954525264911353588104248046875, 120.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 8046, "raw_values": [ 8071.5, 7967, 8098.5 ], "test_run_times": [ 120.8299999999999982946974341757595539093017578125, 120.849999999999994315658113919198513031005859375, 120.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 8095, "raw_values": [ 8143.5, 8075, 8065.5 ], "test_run_times": [ 120.81999999999999317878973670303821563720703125, 120.81999999999999317878973670303821563720703125, 120.8599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "1c92606138e31c54485dd605ebadde2e9cc683d1": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "resnet100\/resnet100.onnx -e cpu", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1908, "raw_values": [ 1914.5, 1912.5, 1897.5 ], "test_run_times": [ 120.68999999999999772626324556767940521240234375, 120.6700000000000017053025658242404460906982421875, 120.7999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 1913, "raw_values": [ 1912, 1908.5, 1918.5 ], "test_run_times": [ 120.68000000000000682121026329696178436279296875, 120.6700000000000017053025658242404460906982421875, 120.650000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 1896, "raw_values": [ 1911, 1905, 1873 ], "test_run_times": [ 120.68000000000000682121026329696178436279296875, 120.68000000000000682121026329696178436279296875, 120.68999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 1893, "raw_values": [ 1900.5, 1886.5, 1892 ], "test_run_times": [ 120.68000000000000682121026329696178436279296875, 120.659999999999996589394868351519107818603515625, 120.7099999999999937472239253111183643341064453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "f668fee35bf1585e0ea3534c1b9194b926b478f8": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "fcn-resnet101-11\/model.onnx -e cpu", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Standard", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 96, "raw_values": [ 95.5, 96.5, 95.5 ], "test_run_times": [ 121.6099999999999994315658113919198513031005859375, 121.3799999999999954525264911353588104248046875, 121.56999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 95, "raw_values": [ 94.5, 95.5, 94.5 ], "test_run_times": [ 121.1400000000000005684341886080801486968994140625, 121.6099999999999994315658113919198513031005859375, 121.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 95, "raw_values": [ 95, 95, 94 ], "test_run_times": [ 121.3299999999999982946974341757595539093017578125, 121.5, 121.06000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 95, "raw_values": [ 93.5, 93.5, 96.5 ], "test_run_times": [ 121.3299999999999982946974341757595539093017578125, 121.090000000000003410605131648480892181396484375, 121.099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "61482819291a886b7cd2679238dfcf55500fda54": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "super_resolution\/super_resolution.onnx -e cpu", "description": "Model: super-resolution-10 - Device: CPU - Executor: Standard", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 5332, "raw_values": [ 5291, 5345, 5360 ], "test_run_times": [ 120.06999999999999317878973670303821563720703125, 120.0799999999999982946974341757595539093017578125, 120.06999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 5349, "raw_values": [ 5307, 5329, 5411 ], "test_run_times": [ 120.090000000000003410605131648480892181396484375, 120.06999999999999317878973670303821563720703125, 120.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 5328, "raw_values": [ 5356, 5357, 5271 ], "test_run_times": [ 120.06999999999999317878973670303821563720703125, 120.06999999999999317878973670303821563720703125, 120.06999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 5384, "raw_values": [ 5356.5, 5309, 5486 ], "test_run_times": [ 120.06999999999999317878973670303821563720703125, 120.06999999999999317878973670303821563720703125, 120.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "e7c291f4e1912729d9c10cfe7fad790e53862914": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--deconv --batch=inputs\/deconv\/shapes_1d --cfg=u8s8f32 --engine=cpu", "description": "Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1.3537600000000000743938244340824894607067108154296875, "raw_values": [ 1.3299000000000000820676859802915714681148529052734375, 1.3864199999999999857180910112219862639904022216796875, 1.344959999999999933351091385702602565288543701171875 ], "min_result": [ "1.28" ], "test_run_times": [ 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 1.353320000000000078443918027915060520172119140625, "raw_values": [ 1.38037000000000009691802915767766535282135009765625, 1.330999999999999960920149533194489777088165283203125, 1.3485899999999999554489704678417183458805084228515625 ], "min_result": [ "1.28" ], "test_run_times": [ 21.059999999999998721023075631819665431976318359375, 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 1.3406100000000000793676235844031907618045806884765625, "raw_values": [ 1.34027999999999991587174008600413799285888671875, 1.3328699999999999992184029906638897955417633056640625, 1.348689999999999944435558063560165464878082275390625 ], "min_result": [ "1.28" ], "test_run_times": [ 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1.3429599999999999315747345463023521006107330322265625, "raw_values": [ 1.331469999999999931361571725574322044849395751953125, 1.35792000000000001591615728102624416351318359375, 1.3394800000000000039790393202565610408782958984375 ], "min_result": [ "1.28" ], "test_run_times": [ 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125, 21.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "e12cafe1a5f66abe0476d087b8095e0643e7de2a": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--rnn --batch=inputs\/rnn\/perf_rnn_inference_lb --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1615.079999999999927240423858165740966796875, "raw_values": [ 1610.59999999999990905052982270717620849609375, 1613.529999999999972715158946812152862548828125, 1621.1199999999998908606357872486114501953125 ], "min_result": [ "1605.12" ], "test_run_times": [ 75.7300000000000039790393202565610408782958984375, 75.7999999999999971578290569595992565155029296875, 75.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 1630.529999999999972715158946812152862548828125, "raw_values": [ 1674.76999999999998181010596454143524169921875, 1607.1300000000001091393642127513885498046875, 1609.69000000000005456968210637569427490234375 ], "min_result": [ "1601.77" ], "test_run_times": [ 75.5100000000000051159076974727213382720947265625, 75.7099999999999937472239253111183643341064453125, 75.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 1618.779999999999972715158946812152862548828125, "raw_values": [ 1616.700000000000045474735088646411895751953125, 1614, 1625.65000000000009094947017729282379150390625 ], "min_result": [ "1609.4" ], "test_run_times": [ 75.8700000000000045474735088646411895751953125, 75.7699999999999960209606797434389591217041015625, 75.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1616.109999999999899955582804977893829345703125, "raw_values": [ 1620.410000000000081854523159563541412353515625, 1614.430000000000063664629124104976654052734375, 1613.5 ], "min_result": [ "1608.7" ], "test_run_times": [ 75.81000000000000227373675443232059478759765625, 75.7099999999999937472239253111183643341064453125, 75.780000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "13c3b2908d7d0186ce944119892bbb97759a0f68": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "yolov4\/yolov4.onnx -e cpu", "description": "Model: yolov4 - Device: CPU - Executor: Standard", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 670, "raw_values": [ 673.5, 665.5, 670.5 ], "test_run_times": [ 120.56999999999999317878973670303821563720703125, 120.599999999999994315658113919198513031005859375, 120.6099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 664, "raw_values": [ 660.5, 672.5, 659.5 ], "test_run_times": [ 120.590000000000003410605131648480892181396484375, 120.5799999999999982946974341757595539093017578125, 120.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 666, "raw_values": [ 670.5, 665.5, 661 ], "test_run_times": [ 120.590000000000003410605131648480892181396484375, 120.5499999999999971578290569595992565155029296875, 120.56999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 669, "raw_values": [ 662.5, 670.5, 674.5 ], "test_run_times": [ 120.56999999999999317878973670303821563720703125, 120.5799999999999982946974341757595539093017578125, 120.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "09bb459c0eac61e4f13a06788c8808f92ed1d055": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "GPT2\/model.onnx -e cpu", "description": "Model: GPT-2 - Device: CPU - Executor: Standard", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 11035, "raw_values": [ 11008.5, 11039, 11056 ], "test_run_times": [ 120.81999999999999317878973670303821563720703125, 120.7999999999999971578290569595992565155029296875, 120.81000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 11077, "raw_values": [ 11097.5, 11059.5, 11073.5 ], "test_run_times": [ 120.81999999999999317878973670303821563720703125, 120.81999999999999317878973670303821563720703125, 120.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 11079, "raw_values": [ 11057, 11076.5, 11103 ], "test_run_times": [ 120.7900000000000062527760746888816356658935546875, 120.81000000000000227373675443232059478759765625, 120.81999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 11123, "raw_values": [ 11092.5, 11204.5, 11072.5 ], "test_run_times": [ 120.780000000000001136868377216160297393798828125, 120.7999999999999971578290569595992565155029296875, 120.7900000000000062527760746888816356658935546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "e4c8e10eae810fdede335d1e23cfaf5f9932a3e8": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "yolov4\/yolov4.onnx -e cpu -P", "description": "Model: yolov4 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 628, "raw_values": [ 622, 630.5, 630 ], "test_run_times": [ 120.659999999999996589394868351519107818603515625, 120.6700000000000017053025658242404460906982421875, 120.659999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 632, "raw_values": [ 632.5, 628.5, 635.5 ], "test_run_times": [ 120.650000000000005684341886080801486968994140625, 120.719999999999998863131622783839702606201171875, 120.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 631, "raw_values": [ 630.5, 635, 628 ], "test_run_times": [ 120.68999999999999772626324556767940521240234375, 120.659999999999996589394868351519107818603515625, 120.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 633, "raw_values": [ 634.5, 631, 634.5 ], "test_run_times": [ 120.7099999999999937472239253111183643341064453125, 120.7300000000000039790393202565610408782958984375, 120.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "6ce2601b654ec06b6e844547d138f0898403e25b": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--ip --batch=inputs\/ip\/shapes_1d --cfg=f32 --engine=cpu", "description": "Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 2.637239999999999806590267326100729405879974365234375, "raw_values": [ 2.637570000000000192130755749531090259552001953125, 2.646450000000000191135995919466949999332427978515625, 2.62769999999999992468247000942938029766082763671875 ], "min_result": [ "2.5" ], "test_run_times": [ 15.0999999999999996447286321199499070644378662109375, 15.089999999999999857891452847979962825775146484375, 15.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 2.65134999999999987352339303470216691493988037109375, "raw_values": [ 2.63276000000000021117330106790177524089813232421875, 2.640379999999999949267248666728846728801727294921875, 2.680919999999999969730879456619732081890106201171875 ], "min_result": [ "2.51" ], "test_run_times": [ 15.2200000000000006394884621840901672840118408203125, 15.089999999999999857891452847979962825775146484375, 15.089999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 2.6318000000000001392663762089796364307403564453125, "raw_values": [ 2.62380000000000013216094885137863457202911376953125, 2.638980000000000103455022326670587062835693359375, 2.632610000000000116671117211808450520038604736328125 ], "min_result": [ "2.49" ], "test_run_times": [ 15.199999999999999289457264239899814128875732421875, 15.0999999999999996447286321199499070644378662109375, 15.089999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 2.632870000000000043627323975670151412487030029296875, "raw_values": [ 2.6356999999999999317878973670303821563720703125, 2.635660000000000113828946268768049776554107666015625, 2.627260000000000150777168528293259441852569580078125 ], "min_result": [ "2.51" ], "test_run_times": [ 15.1899999999999995026200849679298698902130126953125, 15.089999999999999857891452847979962825775146484375, 15.089999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "7395ebca35288c1857f274873d04be4823cabb5e": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "resnet100\/resnet100.onnx -e cpu -P", "description": "Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 363, "raw_values": [ 362.5, 363, 363 ], "test_run_times": [ 120.8599999999999994315658113919198513031005859375, 120.900000000000005684341886080801486968994140625, 120.909999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 364, "raw_values": [ 364, 362.5, 364 ], "test_run_times": [ 120.900000000000005684341886080801486968994140625, 120.9599999999999937472239253111183643341064453125, 120.900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 362, "raw_values": [ 362.5, 362, 362 ], "test_run_times": [ 120.8299999999999982946974341757595539093017578125, 120.8900000000000005684341886080801486968994140625, 120.8799999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 364, "raw_values": [ 363, 364, 363.5 ], "test_run_times": [ 120.900000000000005684341886080801486968994140625, 120.9200000000000017053025658242404460906982421875, 120.8700000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "219a78d0502cd8dccfb0bdae660a9055b3e78d2e": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--rnn --batch=inputs\/rnn\/perf_rnn_inference_lb --cfg=u8s8f32 --engine=cpu", "description": "Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1617.549999999999954525264911353588104248046875, "raw_values": [ 1627.55999999999994543031789362430572509765625, 1611.4600000000000363797880709171295166015625, 1613.6300000000001091393642127513885498046875 ], "min_result": [ "1606.77" ], "test_run_times": [ 75.849999999999994315658113919198513031005859375, 75.75, 75.7999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 1612.799999999999954525264911353588104248046875, "raw_values": [ 1615.59999999999990905052982270717620849609375, 1613.279999999999972715158946812152862548828125, 1609.509999999999990905052982270717620849609375 ], "min_result": [ "1604.84" ], "test_run_times": [ 75.840000000000003410605131648480892181396484375, 75.7399999999999948840923025272786617279052734375, 75.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 1611.26999999999998181010596454143524169921875, "raw_values": [ 1611.720000000000027284841053187847137451171875, 1613.7899999999999636202119290828704833984375, 1608.2899999999999636202119290828704833984375 ], "min_result": [ "1602.83" ], "test_run_times": [ 75.7699999999999960209606797434389591217041015625, 75.75, 75.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1614.26999999999998181010596454143524169921875, "raw_values": [ 1613.970000000000027284841053187847137451171875, 1613.2899999999999636202119290828704833984375, 1615.5399999999999636202119290828704833984375 ], "min_result": [ "1608.32" ], "test_run_times": [ 75.7999999999999971578290569595992565155029296875, 75.7399999999999948840923025272786617279052734375, 75.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "f4acab98c8e24e22a8c2ce5117e614558e5beede": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--rnn --batch=inputs\/rnn\/perf_rnn_training --cfg=f32 --engine=cpu", "description": "Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 2883.1199999999998908606357872486114501953125, "raw_values": [ 2889.739999999999781721271574497222900390625, 2881.36000000000012732925824820995330810546875, 2878.26999999999998181010596454143524169921875 ], "min_result": [ "2869.72" ], "test_run_times": [ 79.81999999999999317878973670303821563720703125, 79.6200000000000045474735088646411895751953125, 79.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 2875.92999999999983629095368087291717529296875, "raw_values": [ 2883.82000000000016370904631912708282470703125, 2871.25, 2872.7100000000000363797880709171295166015625 ], "min_result": [ "2865.18" ], "test_run_times": [ 79.659999999999996589394868351519107818603515625, 79.6700000000000017053025658242404460906982421875, 79.599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 2881.760000000000218278728425502777099609375, "raw_values": [ 2885.010000000000218278728425502777099609375, 2877.40999999999985448084771633148193359375, 2882.8699999999998908606357872486114501953125 ], "min_result": [ "2866.35" ], "test_run_times": [ 79.7099999999999937472239253111183643341064453125, 79.68000000000000682121026329696178436279296875, 79.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 2879.920000000000072759576141834259033203125, "raw_values": [ 2873.010000000000218278728425502777099609375, 2883.07000000000016370904631912708282470703125, 2883.69000000000005456968210637569427490234375 ], "min_result": [ "2866.64" ], "test_run_times": [ 79.599999999999994315658113919198513031005859375, 79.68999999999999772626324556767940521240234375, 79.6400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "12d5decf9f33a5b00ef75252ae90bbe8636fcb70": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--rnn --batch=inputs\/rnn\/perf_rnn_training --cfg=u8s8f32 --engine=cpu", "description": "Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 2881.9600000000000363797880709171295166015625, "raw_values": [ 2871.34999999999990905052982270717620849609375, 2892.4499999999998181010596454143524169921875, 2882.07000000000016370904631912708282470703125 ], "min_result": [ "2865.7" ], "test_run_times": [ 79.6099999999999994315658113919198513031005859375, 79.75, 79.68999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 2885.9600000000000363797880709171295166015625, "raw_values": [ 2890.34999999999990905052982270717620849609375, 2884.01999999999998181010596454143524169921875, 2883.510000000000218278728425502777099609375 ], "min_result": [ "2873.23" ], "test_run_times": [ 79.7300000000000039790393202565610408782958984375, 79.68000000000000682121026329696178436279296875, 79.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 2882.6199999999998908606357872486114501953125, "raw_values": [ 2885, 2882.21999999999979991116560995578765869140625, 2880.6300000000001091393642127513885498046875 ], "min_result": [ "2872.99" ], "test_run_times": [ 79.6400000000000005684341886080801486968994140625, 79.7300000000000039790393202565610408782958984375, 79.68000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 2880.34999999999990905052982270717620849609375, "raw_values": [ 2884.3699999999998908606357872486114501953125, 2881.19000000000005456968210637569427490234375, 2875.5 ], "min_result": [ "2869.74" ], "test_run_times": [ 79.7699999999999960209606797434389591217041015625, 79.7000000000000028421709430404007434844970703125, 79.6299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "c7d52bac3d1a1527688403f50243edfddd04581c": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--rnn --batch=inputs\/rnn\/perf_rnn_training --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 2884.94000000000005456968210637569427490234375, "raw_values": [ 2880.53000000000020008883439004421234130859375, 2894.07000000000016370904631912708282470703125, 2880.23000000000001818989403545856475830078125 ], "min_result": [ "2874.53" ], "test_run_times": [ 79.6700000000000017053025658242404460906982421875, 79.7900000000000062527760746888816356658935546875, 79.6299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 2881.5399999999999636202119290828704833984375, "raw_values": [ 2873.420000000000072759576141834259033203125, 2883.1199999999998908606357872486114501953125, 2888.07000000000016370904631912708282470703125 ], "min_result": [ "2866.57" ], "test_run_times": [ 79.5499999999999971578290569595992565155029296875, 79.7000000000000028421709430404007434844970703125, 79.7600000000000051159076974727213382720947265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 2879.53000000000020008883439004421234130859375, "raw_values": [ 2880.8000000000001818989403545856475830078125, 2883.079999999999927240423858165740966796875, 2874.71999999999979991116560995578765869140625 ], "min_result": [ "2866.7" ], "test_run_times": [ 79.5799999999999982946974341757595539093017578125, 79.7000000000000028421709430404007434844970703125, 79.6400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 2882.21999999999979991116560995578765869140625, "raw_values": [ 2882.0399999999999636202119290828704833984375, 2883.989999999999781721271574497222900390625, 2880.63999999999987267074175179004669189453125 ], "min_result": [ "2871.87" ], "test_run_times": [ 79.7399999999999948840923025272786617279052734375, 79.75, 79.6200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "0f1a66927ff2c2cc1874e2bf3d7f10a02a67bde1": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--rnn --batch=inputs\/rnn\/perf_rnn_inference_lb --cfg=f32 --engine=cpu", "description": "Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1614.5399999999999636202119290828704833984375, "raw_values": [ 1612.4600000000000363797880709171295166015625, 1612.5, 1618.65000000000009094947017729282379150390625 ], "min_result": [ "1608.19" ], "test_run_times": [ 75.7099999999999937472239253111183643341064453125, 75.7999999999999971578290569595992565155029296875, 75.7399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 1611.799999999999954525264911353588104248046875, "raw_values": [ 1613.990000000000009094947017729282379150390625, 1607.569999999999936335370875895023345947265625, 1613.829999999999927240423858165740966796875 ], "min_result": [ "1603.03" ], "test_run_times": [ 75.7000000000000028421709430404007434844970703125, 75.6700000000000017053025658242404460906982421875, 75.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 1612.970000000000027284841053187847137451171875, "raw_values": [ 1613.8800000000001091393642127513885498046875, 1611.490000000000009094947017729282379150390625, 1613.549999999999954525264911353588104248046875 ], "min_result": [ "1606.37" ], "test_run_times": [ 75.7099999999999937472239253111183643341064453125, 75.7600000000000051159076974727213382720947265625, 75.7399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1614.779999999999972715158946812152862548828125, "raw_values": [ 1612.950000000000045474735088646411895751953125, 1613.670000000000072759576141834259033203125, 1617.73000000000001818989403545856475830078125 ], "min_result": [ "1607.96" ], "test_run_times": [ 75.7900000000000062527760746888816356658935546875, 75.780000000000001136868377216160297393798828125, 75.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "eab69135fcc83129e2dc53ffca7b3df4d64a320d": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--conv --batch=inputs\/conv\/shapes_auto --cfg=u8s8f32 --engine=cpu", "description": "Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 6.05435999999999996390442902338691055774688720703125, "raw_values": [ 6.05121000000000019980461729574017226696014404296875, 6.06139999999999989910293152206577360630035400390625, 6.05046999999999979280573825235478579998016357421875 ], "min_result": [ "5.99" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 6.04614999999999991331378623726777732372283935546875, "raw_values": [ 6.048809999999999575948095298372209072113037109375, 6.047290000000000276259015663526952266693115234375, 6.04234000000000026631141736288554966449737548828125 ], "min_result": [ "5.97" ], "test_run_times": [ 6.160000000000000142108547152020037174224853515625, 6.160000000000000142108547152020037174224853515625, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 6.05661999999999967059238770161755383014678955078125, "raw_values": [ 6.0518000000000000682121026329696178436279296875, 6.05858999999999969787722875480540096759796142578125, 6.0594599999999996242650013300590217113494873046875 ], "min_result": [ "5.9" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 6.04797999999999991160848367144353687763214111328125, "raw_values": [ 6.04853000000000040614622776047326624393463134765625, 6.0519800000000003592504072003066539764404296875, 6.043440000000000367208485840819776058197021484375 ], "min_result": [ "5.95" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "612013fa047cb69c7be77df40eec88f18db6c055": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--deconv --batch=inputs\/deconv\/shapes_3d --cfg=u8s8f32 --engine=cpu", "description": "Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 2.21736999999999984112264428404159843921661376953125, "raw_values": [ 2.216979999999999950688334138249047100543975830078125, 2.21408000000000004803268893738277256488800048828125, 2.221039999999999903224079389474354684352874755859375 ], "min_result": [ "2.2" ], "test_run_times": [ 3.04000000000000003552713678800500929355621337890625, 3.04000000000000003552713678800500929355621337890625, 3.04999999999999982236431605997495353221893310546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 2.220079999999999831317154530552215874195098876953125, "raw_values": [ 2.22196000000000015717205315013416111469268798828125, 2.219399999999999817390516909654252231121063232421875, 2.218879999999999963478103381930850446224212646484375 ], "min_result": [ "2.19" ], "test_run_times": [ 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 2.22074999999999977973175191436894237995147705078125, "raw_values": [ 2.223619999999999929940486254054121673107147216796875, 2.219700000000000006394884621840901672840118408203125, 2.218929999999999846949094717274419963359832763671875 ], "min_result": [ "2.2" ], "test_run_times": [ 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875, 3.060000000000000053290705182007513940334320068359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 2.219300000000000050448534238967113196849822998046875, "raw_values": [ 2.22534000000000009578116078046150505542755126953125, 2.22055999999999986727061696001328527927398681640625, 2.212000000000000188293824976426549255847930908203125 ], "min_result": [ "2.19" ], "test_run_times": [ 3.04999999999999982236431605997495353221893310546875, 3.04000000000000003552713678800500929355621337890625, 3.04999999999999982236431605997495353221893310546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "7ded569d19cd1ee48138f1a6c99c1f3ca5973bb7": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--conv --batch=inputs\/conv\/shapes_auto --cfg=f32 --engine=cpu", "description": "Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 5.9086499999999997356781022972427308559417724609375, "raw_values": [ 5.9079899999999998527755451505072414875030517578125, 5.91701000000000032486013878951780498027801513671875, 5.9009400000000002961542122648097574710845947265625 ], "min_result": [ "5.79" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 5.9032000000000000028421709430404007434844970703125, "raw_values": [ 5.90641999999999978143705448019318282604217529296875, 5.90784000000000020236257114447653293609619140625, 5.89533000000000040330405681743286550045013427734375 ], "min_result": [ "5.83" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.160000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 5.90578000000000002955857780762016773223876953125, "raw_values": [ 5.904099999999999681676854379475116729736328125, 5.9131000000000000227373675443232059478759765625, 5.900150000000000005684341886080801486968994140625 ], "min_result": [ "5.82" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 5.9092999999999999971578290569595992565155029296875, "raw_values": [ 5.9058299999999999130295691429637372493743896484375, 5.91265999999999980474285621312446892261505126953125, 5.9093999999999997640998117276467382907867431640625 ], "min_result": [ "5.75" ], "test_run_times": [ 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875, 6.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "a0e8a30d70f61437c90391ea9c4ae5ea07b70069": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--deconv --batch=inputs\/deconv\/shapes_3d --cfg=f32 --engine=cpu", "description": "Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 5.2453599999999998004795997985638678073883056640625, "raw_values": [ 5.2492000000000000881072992342524230480194091796875, 5.24540999999999968395059113390743732452392578125, 5.24148000000000013898215911467559635639190673828125 ], "min_result": [ "5.18" ], "test_run_times": [ 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875, 3.060000000000000053290705182007513940334320068359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 5.2460100000000000619593265582807362079620361328125, "raw_values": [ 5.2411799999999999499777914024889469146728515625, 5.25007999999999963591790219652466475963592529296875, 5.2467699999999997118038663757033646106719970703125 ], "min_result": [ "5.17" ], "test_run_times": [ 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875, 3.069999999999999840127884453977458178997039794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 5.2464800000000000324007487506605684757232666015625, "raw_values": [ 5.24767000000000027881696951226331293582916259765625, 5.24861000000000021969981389702297747135162353515625, 5.2431499999999999772626324556767940521240234375 ], "min_result": [ "5.19" ], "test_run_times": [ 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 5.2482600000000001472244548494927585124969482421875, "raw_values": [ 5.25330000000000030269120543380267918109893798828125, 5.24908000000000019014123608940280973911285400390625, 5.24240999999999957026375341229140758514404296875 ], "min_result": [ "5.17" ], "test_run_times": [ 3.060000000000000053290705182007513940334320068359375, 3.04999999999999982236431605997495353221893310546875, 3.04999999999999982236431605997495353221893310546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "9e32a6dbe8ee3de4c4dde1271cc3d63a24d09e2c": { "identifier": "pts\/onnx-1.5.0", "title": "ONNX Runtime", "app_version": "1.11", "arguments": "fcn-resnet101-11\/model.onnx -e cpu -P", "description": "Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel", "scale": "Inferences Per Minute", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 111, "raw_values": [ 109.5, 111, 111.5 ], "test_run_times": [ 121.409999999999996589394868351519107818603515625, 121.5199999999999960209606797434389591217041015625, 121.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "B": { "value": 111, "raw_values": [ 111, 110.5, 111.5 ], "test_run_times": [ 121.4899999999999948840923025272786617279052734375, 121.6200000000000045474735088646411895751953125, 121.8700000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "C": { "value": 111, "raw_values": [ 110.5, 111, 111 ], "test_run_times": [ 121.6099999999999994315658113919198513031005859375, 121.4899999999999948840923025272786617279052734375, 121.900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } }, "D": { "value": 111, "raw_values": [ 111.5, 111.5, 111 ], "test_run_times": [ 121.8299999999999982946974341757595539093017578125, 121.7399999999999948840923025272786617279052734375, 121.8700000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt" } } } } }, "45071389122b42870bb64262a0700ed257f0d0bc": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--matmul --batch=inputs\/matmul\/shapes_transformer --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "B": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "C": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "D": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } } } }, "f66fc914ba0f9e5a32201e61e114786391b2bac0": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--matmul --batch=inputs\/matmul\/shapes_transformer --cfg=u8s8f32 --engine=cpu", "description": "Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1.0336540000000000727453652871190570294857025146484375, "raw_values": [ 0.83831599999999995009858366756816394627094268798828125, 1.16880000000000006110667527536861598491668701171875, 1.1504499999999999726441046732361428439617156982421875, 1.0325800000000000533617594555835239589214324951171875, 0.8611400000000000165556457432103343307971954345703125, 0.85838800000000003986855290349922142922878265380859375, 1.121280000000000054427573559223674237728118896484375, 1.8912299999999999666755456928513012826442718505859375, 0.87079300000000003922906444131513126194477081298828125, 0.82355999999999995875299418912618421018123626708984375, 0.83145700000000000162714286489062942564487457275390625, 0.95584999999999997744026813961681909859180450439453125 ], "min_result": [ "0.71" ], "test_run_times": [ 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 0.82633900000000004570921419144724495708942413330078125, "raw_values": [ 0.8255090000000000483026951769716106355190277099609375, 0.8299119999999999830464503247640095651149749755859375, 0.82359499999999996600053009387920610606670379638671875 ], "min_result": [ "0.71" ], "test_run_times": [ 12.089999999999999857891452847979962825775146484375, 12.0800000000000000710542735760100185871124267578125, 12.0800000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 0.84299800000000002508926399968913756310939788818359375, "raw_values": [ 0.836859000000000019525714378687553107738494873046875, 0.83619399999999999284483465089579112827777862548828125, 0.85594099999999995187494050696841441094875335693359375 ], "min_result": [ "0.72" ], "test_run_times": [ 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.0999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1.0111410000000000675157707519247196614742279052734375, "raw_values": [ 1.251020000000000020889956431346945464611053466796875, 1.0433600000000000651567688692011870443820953369140625, 0.82246099999999999763389268991886638104915618896484375, 0.83515700000000003822009375653578899800777435302734375, 0.8566570000000000018047785488306544721126556396484375, 0.83631599999999994832222682816791348159313201904296875, 0.8485810000000000297148972094873897731304168701171875, 1.8797900000000000719779791324981488287448883056640625, 0.82712499999999999911182158029987476766109466552734375, 0.817617999999999955917928673443384468555450439453125, 0.86338700000000001555378048578859306871891021728515625, 1.2522200000000001107736125049996189773082733154296875 ], "min_result": [ "0.7" ], "test_run_times": [ 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375, 12.089999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "ff7e047e017dbbfa2b7942529e73e3f574bb8e41": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--matmul --batch=inputs\/matmul\/shapes_transformer --cfg=f32 --engine=cpu", "description": "Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "value": 1.245670000000000054996007747831754386425018310546875, "raw_values": [ 1.2706999999999999406696815640316344797611236572265625, 1.2422999999999999598543354295543394982814788818359375, 1.2240200000000001079314415619592182338237762451171875 ], "min_result": [ "1.17" ], "test_run_times": [ 12.1199999999999992184029906638897955417633056640625, 12.1099999999999994315658113919198513031005859375, 12.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "B": { "value": 1.255100000000000104449782156734727323055267333984375, "raw_values": [ 1.2319199999999999040056763988104648888111114501953125, 1.24885000000000001563194018672220408916473388671875, 1.2845400000000000151345602716901339590549468994140625 ], "min_result": [ "1.17" ], "test_run_times": [ 12.1099999999999994315658113919198513031005859375, 12.0999999999999996447286321199499070644378662109375, 12.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "C": { "value": 1.2843199999999999061373046060907654464244842529296875, "raw_values": [ 1.3046800000000000618882722847047261893749237060546875, 1.26180000000000003268496584496460855007171630859375, 1.286470000000000002415845301584340631961822509765625 ], "min_result": [ "1.19" ], "test_run_times": [ 12.1099999999999994315658113919198513031005859375, 12.1099999999999994315658113919198513031005859375, 12.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } }, "D": { "value": 1.310810000000000030695446184836328029632568359375, "raw_values": [ 1.2606200000000000738253902454744093120098114013671875, 1.27066999999999996617816577781923115253448486328125, 1.4416800000000000725464133211062289774417877197265625, 1.549549999999999982946974341757595539093017578125, 1.33617000000000007986500349943526089191436767578125, 1.2630999999999998895106045893044210970401763916015625, 1.2681199999999999139532746994518674910068511962890625, 1.3139600000000000168398628375143744051456451416015625, 1.28125, 1.2755300000000000526512167198234237730503082275390625, 1.2983800000000000895994389793486334383487701416015625, 1.2761400000000000520827825312153436243534088134765625, 1.28770000000000006679101716144941747188568115234375, 1.31055000000000010373923942097462713718414306640625, 1.22872000000000003439026841078884899616241455078125 ], "min_result": [ "1.17" ], "test_run_times": [ 12.0999999999999996447286321199499070644378662109375, 12.0999999999999996447286321199499070644378662109375, 12.1099999999999994315658113919198513031005859375, 12.0999999999999996447286321199499070644378662109375, 12.1099999999999994315658113919198513031005859375, 12.0999999999999996447286321199499070644378662109375, 12.1099999999999994315658113919198513031005859375, 12.0999999999999996447286321199499070644378662109375, 12.1099999999999994315658113919198513031005859375, 12.0999999999999996447286321199499070644378662109375, 12.0999999999999996447286321199499070644378662109375, 12.0999999999999996447286321199499070644378662109375, 12.0999999999999996447286321199499070644378662109375, 12.1099999999999994315658113919198513031005859375, 12.1300000000000007815970093361102044582366943359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" } } } } }, "3121db86f76aa95af1060fec9fa354cec5622f54": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--deconv --batch=inputs\/deconv\/shapes_3d --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "B": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "C": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "D": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } } } }, "c11bb0fd6439e2fb1af7edc1b47cc211ffcf703b": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--deconv --batch=inputs\/deconv\/shapes_1d --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "B": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "C": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "D": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } } } }, "838cdc46a3d36377082ad77582ab48fea410712f": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--conv --batch=inputs\/conv\/shapes_auto --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "test_run_times": [ 0.0200000000000000004163336342344337026588618755340576171875, 0.0200000000000000004163336342344337026588618755340576171875, 0.0200000000000000004163336342344337026588618755340576171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "B": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.0200000000000000004163336342344337026588618755340576171875, 0.0200000000000000004163336342344337026588618755340576171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "C": { "test_run_times": [ 0.0200000000000000004163336342344337026588618755340576171875, 0.01000000000000000020816681711721685132943093776702880859375, 0.0200000000000000004163336342344337026588618755340576171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "D": { "test_run_times": [ 0.0200000000000000004163336342344337026588618755340576171875, 0.01000000000000000020816681711721685132943093776702880859375, 0.0200000000000000004163336342344337026588618755340576171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } } } }, "ca530a68265ce111b6caa3f67849175be2352726": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--ip --batch=inputs\/ip\/shapes_3d --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "B": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "C": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "D": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } } } }, "8b4dbdf4e2ba7a1aab10e93f8ee1fd35a3754263": { "identifier": "pts\/onednn-1.8.0", "title": "oneDNN", "app_version": "2.6", "arguments": "--ip --batch=inputs\/ip\/shapes_1d --cfg=bf16bf16bf16 --engine=cpu", "description": "Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "A": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "B": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "C": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } }, "D": { "test_run_times": [ 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread" }, "error": "The test run did not produce a result. The test run did not produce a result. The test run did not produce a result." } } } } } }