net

INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312187-NE-NET50813920
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 2 Tests
HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 18 2023
  3 Hours, 20 Minutes
b
December 18 2023
  3 Hours, 20 Minutes
c
December 18 2023
  3 Hours, 16 Minutes
Invert Hiding All Results Option
  3 Hours, 19 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "net", "last_modified": "2023-12-18 20:36:43", "description": "INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 23.10 via the Phoronix Test Suite.", "systems": { "a": { "identifier": "a", "hardware": { "Processor": "INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)", "Chipset": "Intel Device 1bce", "Memory": "512GB", "Disk": "3201GB Micron_7450_MTFDKCC3T2TFS + 0GB Virtual HDisk0 + 0GB Virtual HDisk2 + 0GB Virtual HDisk1 + 0GB Virtual HDisk3", "Graphics": "ASPEED" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.6.0-rc5-phx-patched (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server 1.21.1.7", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1200" }, "user": "phoronix", "timestamp": "2023-12-18 11:29:31", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x21000161", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.20+8-post-Ubuntu-1ubuntu1)", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "b": { "identifier": "b", "hardware": { "Processor": "INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)", "Chipset": "Intel Device 1bce", "Memory": "512GB", "Disk": "3201GB Micron_7450_MTFDKCC3T2TFS + 0GB Virtual HDisk0 + 0GB Virtual HDisk2 + 0GB Virtual HDisk1 + 0GB Virtual HDisk3", "Graphics": "ASPEED" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.6.0-rc5-phx-patched (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server 1.21.1.7", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1200" }, "user": "phoronix", "timestamp": "2023-12-18 14:45:19", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x21000161", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } }, "c": { "identifier": "c", "hardware": { "Processor": "INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)", "Chipset": "Intel Device 1bce", "Memory": "512GB", "Disk": "3201GB Micron_7450_MTFDKCC3T2TFS + 0GB Virtual HDisk0 + 0GB Virtual HDisk2 + 0GB Virtual HDisk1 + 0GB Virtual HDisk3", "Graphics": "ASPEED" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.6.0-rc5-phx-patched (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server 1.21.1.7", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "1920x1200" }, "user": "phoronix", "timestamp": "2023-12-18 17:34:19", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-13-XYspKM\/gcc-13-13.2.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "intel_pstate performance (EPP: performance)", "cpu-microcode": "0x21000161", "kernel-extra-details": "Transparent Huge Pages: madvise", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced \/ Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "5fa176cc50862c4db0a5446794759786be71a046": { "identifier": "pts\/lczero-1.7.0", "title": "LeelaChessZero", "app_version": "0.30", "arguments": "-b blas", "description": "Backend: BLAS", "scale": "Nodes Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 67, "raw_values": [ 66, 68, 68 ], "test_run_times": [ 380.6299999999999954525264911353588104248046875, 388.68000000000000682121026329696178436279296875, 383.04000000000002046363078989088535308837890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-flto -pthread" } } }, "b": { "value": 67, "raw_values": [ 68, 66, 68 ], "test_run_times": [ 385.45999999999997953636921010911464691162109375, 382.8500000000000227373675443232059478759765625, 382.8899999999999863575794734060764312744140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-flto -pthread" } } }, "c": { "value": 68, "raw_values": [ 69, 68, 67 ], "test_run_times": [ 380.8500000000000227373675443232059478759765625, 382.5, 382.93000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-flto -pthread" } } } } }, "ab7b1e284f00adf277eb0c7e548ec0276757edcf": { "identifier": "pts\/lczero-1.7.0", "title": "LeelaChessZero", "app_version": "0.30", "arguments": "-b eigen", "description": "Backend: Eigen", "scale": "Nodes Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 796, "raw_values": [ 816, 714, 797, 863, 833, 791, 890, 768, 688 ], "test_run_times": [ 381.3999999999999772626324556767940521240234375, 381.3600000000000136424205265939235687255859375, 382.95999999999997953636921010911464691162109375, 383.6200000000000045474735088646411895751953125, 383.8700000000000045474735088646411895751953125, 380.25, 380.58999999999997498889570124447345733642578125, 382.1100000000000136424205265939235687255859375, 376.6000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-flto -pthread" } } }, "b": { "value": 805, "raw_values": [ 810, 803, 747, 846, 764, 839, 796, 834, 806 ], "test_run_times": [ 379.3799999999999954525264911353588104248046875, 384.80000000000001136868377216160297393798828125, 383.509999999999990905052982270717620849609375, 381.08999999999997498889570124447345733642578125, 379.92000000000001591615728102624416351318359375, 386.57999999999998408384271897375583648681640625, 384.30000000000001136868377216160297393798828125, 383.06000000000000227373675443232059478759765625, 383.54000000000002046363078989088535308837890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-flto -pthread" } } }, "c": { "value": 817, "raw_values": [ 757, 845, 854, 871, 683, 894 ], "test_run_times": [ 383.529999999999972715158946812152862548828125, 384.31999999999999317878973670303821563720703125, 385.30000000000001136868377216160297393798828125, 382.5, 384.1200000000000045474735088646411895751953125, 386.6200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-flto -pthread" } } } } }, "4f1143b9eb648135d9abf519fd418b332528343f": { "identifier": "pts\/xmrig-1.2.0", "title": "Xmrig", "app_version": "6.21", "arguments": "-a kawpow --bench=1M", "description": "Variant: KawPow - Hash Count: 1M", "scale": "H\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 39936.199999999997089616954326629638671875, "raw_values": [ 39577.300000000002910383045673370361328125, 40199.4000000000014551915228366851806640625, 40032 ], "test_run_times": [ 27.269999999999999573674358543939888477325439453125, 26.910000000000000142108547152020037174224853515625, 27.010000000000001563194018672220408916473388671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "b": { "value": 40344.699999999997089616954326629638671875, "raw_values": [ 40464.5, 40418.699999999997089616954326629638671875, 40151 ], "test_run_times": [ 26.719999999999998863131622783839702606201171875, 26.769999999999999573674358543939888477325439453125, 26.940000000000001278976924368180334568023681640625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "c": { "value": 40242.5, "raw_values": [ 40147.699999999997089616954326629638671875, 40131.5999999999985448084771633148193359375, 40448.199999999997089616954326629638671875 ], "test_run_times": [ 26.9200000000000017053025658242404460906982421875, 26.949999999999999289457264239899814128875732421875, 26.739999999999998436805981327779591083526611328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } } } }, "40e6f71b11b5fa11b51d184848040716189668b7": { "identifier": "pts\/xmrig-1.2.0", "title": "Xmrig", "app_version": "6.21", "arguments": "--bench=1M", "description": "Variant: Monero - Hash Count: 1M", "scale": "H\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 40329.5999999999985448084771633148193359375, "raw_values": [ 40162.300000000002910383045673370361328125, 40526.800000000002910383045673370361328125, 40299.800000000002910383045673370361328125 ], "test_run_times": [ 26.92999999999999971578290569595992565155029296875, 26.719999999999998863131622783839702606201171875, 26.82000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "b": { "value": 40153.199999999997089616954326629638671875, "raw_values": [ 39684.0999999999985448084771633148193359375, 40412.199999999997089616954326629638671875, 40363.300000000002910383045673370361328125 ], "test_run_times": [ 27.199999999999999289457264239899814128875732421875, 26.75, 26.78999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "c": { "value": 40072.199999999997089616954326629638671875, "raw_values": [ 40340.5, 40270.5999999999985448084771633148193359375, 39605.5 ], "test_run_times": [ 26.78999999999999914734871708787977695465087890625, 26.82000000000000028421709430404007434844970703125, 27.28999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } } } }, "4d8e8ba34b6c45a42169dbb1384a050822d0fa72": { "identifier": "pts\/xmrig-1.2.0", "title": "Xmrig", "app_version": "6.21", "arguments": "-a rx\/wow --bench=1M", "description": "Variant: Wownero - Hash Count: 1M", "scale": "H\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 43088.300000000002910383045673370361328125, "raw_values": [ 42944.300000000002910383045673370361328125, 43205.9000000000014551915228366851806640625, 43114.5999999999985448084771633148193359375 ], "test_run_times": [ 25.32000000000000028421709430404007434844970703125, 25.1700000000000017053025658242404460906982421875, 25.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "b": { "value": 42998.699999999997089616954326629638671875, "raw_values": [ 42835.699999999997089616954326629638671875, 43066.300000000002910383045673370361328125, 43094.199999999997089616954326629638671875 ], "test_run_times": [ 25.370000000000000994759830064140260219573974609375, 25.199999999999999289457264239899814128875732421875, 25.230000000000000426325641456060111522674560546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "c": { "value": 43080.4000000000014551915228366851806640625, "raw_values": [ 43250.699999999997089616954326629638671875, 43101.5999999999985448084771633148193359375, 42889 ], "test_run_times": [ 25.1400000000000005684341886080801486968994140625, 25.219999999999998863131622783839702606201171875, 25.3299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } } } }, "9524205c1703ecea055ce3dff22ecbfbb11e896a": { "identifier": "pts\/xmrig-1.2.0", "title": "Xmrig", "app_version": "6.21", "arguments": "-a gr --bench=1M", "description": "Variant: GhostRider - Hash Count: 1M", "scale": "H\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 6862.899999999999636202119290828704833984375, "raw_values": [ 6852.3000000000001818989403545856475830078125, 6869.5, 6867 ], "test_run_times": [ 148.18000000000000682121026329696178436279296875, 147.80000000000001136868377216160297393798828125, 147.830000000000012505552149377763271331787109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "b": { "value": 6857.8000000000001818989403545856475830078125, "raw_values": [ 6914.600000000000363797880709171295166015625, 6844.8000000000001818989403545856475830078125, 6813.899999999999636202119290828704833984375 ], "test_run_times": [ 146.840000000000003410605131648480892181396484375, 148.31000000000000227373675443232059478759765625, 148.969999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "c": { "value": 6820.8000000000001818989403545856475830078125, "raw_values": [ 6783.1999999999998181010596454143524169921875, 6842.399999999999636202119290828704833984375, 6836.6999999999998181010596454143524169921875 ], "test_run_times": [ 149.650000000000005684341886080801486968994140625, 148.3799999999999954525264911353588104248046875, 148.479999999999989768184605054557323455810546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } } } }, "990a88e4294b8e246c7f8296e1c5431f06eb369c": { "identifier": "pts\/xmrig-1.2.0", "title": "Xmrig", "app_version": "6.21", "arguments": "-a cn-heavy\/0 --bench=1M", "description": "Variant: CryptoNight-Heavy - Hash Count: 1M", "scale": "H\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 40394.9000000000014551915228366851806640625, "raw_values": [ 40387.699999999997089616954326629638671875, 40325.800000000002910383045673370361328125, 40471.0999999999985448084771633148193359375 ], "test_run_times": [ 26.75, 26.8299999999999982946974341757595539093017578125, 26.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "b": { "value": 40282.199999999997089616954326629638671875, "raw_values": [ 40377.9000000000014551915228366851806640625, 40309.5999999999985448084771633148193359375, 40159 ], "test_run_times": [ 26.75, 26.8299999999999982946974341757595539093017578125, 26.92999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "c": { "value": 40286.5999999999985448084771633148193359375, "raw_values": [ 40594.300000000002910383045673370361328125, 40257.5999999999985448084771633148193359375, 40008 ], "test_run_times": [ 26.6400000000000005684341886080801486968994140625, 26.8599999999999994315658113919198513031005859375, 27.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } } } }, "818a69a5f4ebff2e4bb2c759fe2a8d0dd0452dad": { "identifier": "pts\/xmrig-1.2.0", "title": "Xmrig", "app_version": "6.21", "arguments": "-a cn\/upx2 --bench=1M", "description": "Variant: CryptoNight-Femto UPX2 - Hash Count: 1M", "scale": "H\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 40425.9000000000014551915228366851806640625, "raw_values": [ 40533.4000000000014551915228366851806640625, 40394.199999999997089616954326629638671875, 40350.199999999997089616954326629638671875 ], "test_run_times": [ 26.660000000000000142108547152020037174224853515625, 26.780000000000001136868377216160297393798828125, 26.78999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "b": { "value": 40080.4000000000014551915228366851806640625, "raw_values": [ 39966.4000000000014551915228366851806640625, 40213.9000000000014551915228366851806640625, 40060.9000000000014551915228366851806640625 ], "test_run_times": [ 27.030000000000001136868377216160297393798828125, 26.89999999999999857891452847979962825775146484375, 26.969999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } }, "c": { "value": 40331.0999999999985448084771633148193359375, "raw_values": [ 40508.800000000002910383045673370361328125, 40247.9000000000014551915228366851806640625, 40236.5999999999985448084771633148193359375 ], "test_run_times": [ 26.6700000000000017053025658242404460906982421875, 26.8599999999999994315658113919198513031005859375, 26.82000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc" } } } } }, "5faad2eeccf95a6c2fcf92a16ab8952107f7ac7e": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 4 -n 160 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 4 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 7.15599999999999969446662362315692007541656494140625, "raw_values": [ 7.11699999999999999289457264239899814128875732421875, 7.19200000000000017053025658242404460906982421875, 7.15899999999999980815346134477294981479644775390625 ], "test_run_times": [ 25.42999999999999971578290569595992565155029296875, 25.219999999999998863131622783839702606201171875, 25.379999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 7.16800000000000014921397450962103903293609619140625, "raw_values": [ 7.2110000000000002984279490192420780658721923828125, 7.12300000000000022026824808563105762004852294921875, 7.17100000000000026290081223123706877231597900390625 ], "test_run_times": [ 25.129999999999999005240169935859739780426025390625, 25.3900000000000005684341886080801486968994140625, 25.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 7.150999999999999801048033987171947956085205078125, "raw_values": [ 7.01799999999999979394260662957094609737396240234375, 7.1730000000000000426325641456060111522674560546875, 7.26199999999999956656893118633888661861419677734375 ], "test_run_times": [ 25.769999999999999573674358543939888477325439453125, 25.28999999999999914734871708787977695465087890625, 25.629999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "c14d0b5ebcf53498668c8654883e64476ca9e6cb": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 8 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 8 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 75.1389999999999957935870043002068996429443359375, "raw_values": [ 75.375, 74.3990000000000009094947017729282379150390625, 75.643000000000000682121026329696178436279296875 ], "test_run_times": [ 10.46000000000000085265128291212022304534912109375, 11.3100000000000004973799150320701301097869873046875, 11.1300000000000007815970093361102044582366943359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 75.736999999999994770405464805662631988525390625, "raw_values": [ 75.400000000000005684341886080801486968994140625, 75.5319999999999964757080306299030780792236328125, 76.27899999999999636202119290828704833984375 ], "test_run_times": [ 10.4399999999999995026200849679298698902130126953125, 10.42999999999999971578290569595992565155029296875, 10.300000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 74.9260000000000019326762412674725055694580078125, "raw_values": [ 74.6340000000000003410605131648480892181396484375, 75.0400000000000062527760746888816356658935546875, 75.1039999999999992041921359486877918243408203125 ], "test_run_times": [ 10.6699999999999999289457264239899814128875732421875, 11.3599999999999994315658113919198513031005859375, 10.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "01b8a8423c77dc9bfd8f5cfd4ccbe2dde54dc852": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 12 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 12 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 228.873999999999995225152815692126750946044921875, "raw_values": [ 229.705000000000012505552149377763271331787109375, 228.5629999999999881765688769519329071044921875, 228.35300000000000864019966684281826019287109375 ], "test_run_times": [ 7.62000000000000010658141036401502788066864013671875, 7.6699999999999999289457264239899814128875732421875, 7.5999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 229.5140000000000100044417195022106170654296875, "raw_values": [ 230.044999999999987494447850622236728668212890625, 227.455999999999988858689903281629085540771484375, 231.04099999999999681676854379475116729736328125 ], "test_run_times": [ 7.69000000000000039079850466805510222911834716796875, 7.61000000000000031974423109204508364200592041015625, 7.6500000000000003552713678800500929355621337890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 228.518000000000000682121026329696178436279296875, "raw_values": [ 225.78600000000000136424205265939235687255859375, 230.77899999999999636202119290828704833984375, 228.990000000000009094947017729282379150390625 ], "test_run_times": [ 7.69000000000000039079850466805510222911834716796875, 7.839999999999999857891452847979962825775146484375, 7.62999999999999989341858963598497211933135986328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "df4f25f1140a1944a4d4224142d9c532fee4c333": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 13 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 13 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 227.284999999999996589394868351519107818603515625, "raw_values": [ 225.068999999999988403942552395164966583251953125, 231.741000000000013869794202037155628204345703125, 225.04599999999999226929503493010997772216796875 ], "test_run_times": [ 7.6699999999999999289457264239899814128875732421875, 7.6500000000000003552713678800500929355621337890625, 7.70999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 229.556000000000011596057447604835033416748046875, "raw_values": [ 230.986999999999994770405464805662631988525390625, 228.43000000000000682121026329696178436279296875, 229.25 ], "test_run_times": [ 7.57000000000000028421709430404007434844970703125, 7.95000000000000017763568394002504646778106689453125, 7.63999999999999968025576890795491635799407958984375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 229.07499999999998863131622783839702606201171875, "raw_values": [ 229.075999999999993406163412146270275115966796875, 228.739000000000004320099833421409130096435546875, 229.4089999999999918145476840436458587646484375 ], "test_run_times": [ 7.82000000000000028421709430404007434844970703125, 7.8300000000000000710542735760100185871124267578125, 7.589999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "bd60d19ed572aa62476e8604a0a59c0049fea081": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 4 -n 160 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 4 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 20.769999999999999573674358543939888477325439453125, "raw_values": [ 20.812999999999998834709913353435695171356201171875, 20.620000000000000994759830064140260219573974609375, 20.876000000000001222133505507372319698333740234375 ], "test_run_times": [ 10.019999999999999573674358543939888477325439453125, 9.57000000000000028421709430404007434844970703125, 9.5299999999999993605115378159098327159881591796875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 20.586999999999999744204615126363933086395263671875, "raw_values": [ 20.577999999999999403144101961515843868255615234375, 20.57600000000000051159076974727213382720947265625, 20.608000000000000540012479177676141262054443359375 ], "test_run_times": [ 9.8300000000000000710542735760100185871124267578125, 10.089999999999999857891452847979962825775146484375, 9.6300000000000007815970093361102044582366943359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 20.492000000000000881072992342524230480194091796875, "raw_values": [ 20.0270000000000010231815394945442676544189453125, 20.861999999999998323119143606163561344146728515625, 20.58800000000000096633812063373625278472900390625 ], "test_run_times": [ 10.3499999999999996447286321199499070644378662109375, 10, 10.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "721958a2f8fa45aed4031a0de1d146143c6dea10": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 8 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 8 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 139.811000000000007048583938740193843841552734375, "raw_values": [ 139.667000000000001591615728102624416351318359375, 139.64199999999999590727384202182292938232421875, 140.125 ], "test_run_times": [ 6, 5.86000000000000031974423109204508364200592041015625, 5.87000000000000010658141036401502788066864013671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 141.977000000000003865352482534945011138916015625, "raw_values": [ 140.558999999999997498889570124447345733642578125, 148.844999999999998863131622783839702606201171875, 139.717999999999989313437254168093204498291015625, 138.222000000000008412825991399586200714111328125, 143.2649999999999863575794734060764312744140625, 141.46199999999998908606357872486114501953125, 141.770000000000010231815394945442676544189453125 ], "test_run_times": [ 5.9000000000000003552713678800500929355621337890625, 5.57000000000000028421709430404007434844970703125, 5.8499999999999996447286321199499070644378662109375, 5.94000000000000039079850466805510222911834716796875, 5.7400000000000002131628207280300557613372802734375, 5.8300000000000000710542735760100185871124267578125, 5.839999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 141.87299999999999045030563138425350189208984375, "raw_values": [ 143.5049999999999954525264911353588104248046875, 138.1680000000000063664629124104976654052734375, 143.945999999999997953636921010911464691162109375 ], "test_run_times": [ 5.769999999999999573674358543939888477325439453125, 6.03000000000000024868995751603506505489349365234375, 6.30999999999999960920149533194489777088165283203125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "e09e6c5b9d8c57c920eea2cc0fc967c3986b4af8": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 12 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 12 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 545.9099999999999681676854379475116729736328125, "raw_values": [ 545.770999999999958163243718445301055908203125, 554.54700000000002546585164964199066162109375, 537.412000000000034560798667371273040771484375 ], "test_run_times": [ 2.6699999999999999289457264239899814128875732421875, 2.729999999999999982236431605997495353221893310546875, 2.70000000000000017763568394002504646778106689453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 543.7250000000000227373675443232059478759765625, "raw_values": [ 550.654999999999972715158946812152862548828125, 539.200000000000045474735088646411895751953125, 541.3200000000000500222085975110530853271484375 ], "test_run_times": [ 2.649999999999999911182158029987476766109466552734375, 2.680000000000000159872115546022541821002960205078125, 2.7400000000000002131628207280300557613372802734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 546.87699999999995270627550780773162841796875, "raw_values": [ 554.636999999999943611328490078449249267578125, 537.961000000000012732925824820995330810546875, 548.0320000000000391082721762359142303466796875 ], "test_run_times": [ 2.689999999999999946709294817992486059665679931640625, 2.70000000000000017763568394002504646778106689453125, 2.649999999999999911182158029987476766109466552734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "db8fa582a4e071550fc77ccf19f389ba388b3e8d": { "identifier": "pts\/svt-av1-2.11.1", "title": "SVT-AV1", "app_version": "1.8", "arguments": "--preset 13 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 13 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 632.4589999999999463398125953972339630126953125, "raw_values": [ 638.92200000000002546585164964199066162109375, 627.0940000000000509317032992839813232421875, 631.3600000000000136424205265939235687255859375 ], "test_run_times": [ 2.520000000000000017763568394002504646778106689453125, 2.4900000000000002131628207280300557613372802734375, 2.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "b": { "value": 636.9089999999999918145476840436458587646484375, "raw_values": [ 628.7100000000000363797880709171295166015625, 636.5990000000000463842297904193401336669921875, 645.4170000000000300133251585066318511962890625 ], "test_run_times": [ 2.5, 2.430000000000000159872115546022541821002960205078125, 2.4900000000000002131628207280300557613372802734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "c": { "value": 637.33699999999998908606357872486114501953125, "raw_values": [ 646.2540000000000190993887372314929962158203125, 632.8049999999999499777914024889469146728515625, 632.9510000000000218278728425502777099609375 ], "test_run_times": [ 2.520000000000000017763568394002504646778106689453125, 2.529999999999999804600747665972448885440826416015625, 2.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "7177df0983290cc547ee8201e604768da3e0a24a": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 71.986400000000003274180926382541656494140625, "raw_values": [ 71.6875, 72.2104000000000070258465711958706378936767578125, 72.0614000000000061163518694229423999786376953125 ], "test_run_times": [ 50.090000000000003410605131648480892181396484375, 45.25999999999999801048033987171947956085205078125, 45.32000000000000028421709430404007434844970703125 ] }, "b": { "value": 71.6758999999999986130205797962844371795654296875, "raw_values": [ 71.3659999999999996589394868351519107818603515625, 71.944199999999995043253875337541103363037109375, 71.71739999999999781721271574497222900390625 ], "test_run_times": [ 45.88000000000000255795384873636066913604736328125, 46.53999999999999914734871708787977695465087890625, 45.18999999999999772626324556767940521240234375 ] }, "c": { "value": 71.96850000000000591171556152403354644775390625, "raw_values": [ 71.570999999999997953636921010911464691162109375, 72.0935999999999950205165077932178974151611328125, 72.2407999999999930196281638927757740020751953125 ], "test_run_times": [ 45.280000000000001136868377216160297393798828125, 45.280000000000001136868377216160297393798828125, 45.25999999999999801048033987171947956085205078125 ] } } }, "cfea26185bda60cf1bd972198a894017567ea66d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 442.31189999999998008206603117287158966064453125, "raw_values": [ 443.383199999999987994669936597347259521484375, 441.42149999999998044586391188204288482666015625, 442.1308999999999969077180139720439910888671875 ], "test_run_times": [ 50.090000000000003410605131648480892181396484375, 45.25999999999999801048033987171947956085205078125, 45.32000000000000028421709430404007434844970703125 ] }, "b": { "value": 443.3971000000000231011654250323772430419921875, "raw_values": [ 443.780899999999974170350469648838043212890625, 443.27989999999999781721271574497222900390625, 443.130499999999983629095368087291717529296875 ], "test_run_times": [ 45.88000000000000255795384873636066913604736328125, 46.53999999999999914734871708787977695465087890625, 45.18999999999999772626324556767940521240234375 ] }, "c": { "value": 442.75249999999999772626324556767940521240234375, "raw_values": [ 444.25380000000001246007741428911685943603515625, 442.32949999999999590727384202182292938232421875, 441.67410000000000991349224932491779327392578125 ], "test_run_times": [ 45.280000000000001136868377216160297393798828125, 45.280000000000001136868377216160297393798828125, 45.25999999999999801048033987171947956085205078125 ] } } }, "75b6442e296ce0e967a26cd61945f6ce4b61b99d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.47489999999999810142981004901230335235595703125, "raw_values": [ 34.46730000000000160298441187478601932525634765625, 34.51559999999999917008608463220298290252685546875, 34.44180000000000063664629124104976654052734375 ], "test_run_times": [ 44.0499999999999971578290569595992565155029296875, 43.88000000000000255795384873636066913604736328125, 43.96000000000000085265128291212022304534912109375 ] }, "b": { "value": 34.48259999999999791953086969442665576934814453125, "raw_values": [ 34.51809999999999689634933019988238811492919921875, 34.37740000000000151203494169749319553375244140625, 34.55230000000000245563569478690624237060546875 ], "test_run_times": [ 44.99000000000000198951966012828052043914794921875, 44.32000000000000028421709430404007434844970703125, 43.77000000000000312638803734444081783294677734375 ] }, "c": { "value": 34.23769999999999669171302230097353458404541015625, "raw_values": [ 34.31309999999999860165189602412283420562744140625, 34.30409999999999826059138285927474498748779296875, 34.09579999999999699866748414933681488037109375 ], "test_run_times": [ 44.13000000000000255795384873636066913604736328125, 44.38000000000000255795384873636066913604736328125, 43.719999999999998863131622783839702606201171875 ] } } }, "65ae56ceea2f265276e1b95b6a6e3b53119b5ff3": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 29.001599999999999823785401531495153903961181640625, "raw_values": [ 29.00789999999999935198502498678863048553466796875, 28.967500000000001136868377216160297393798828125, 29.0294999999999987494447850622236728668212890625 ], "test_run_times": [ 44.0499999999999971578290569595992565155029296875, 43.88000000000000255795384873636066913604736328125, 43.96000000000000085265128291212022304534912109375 ] }, "b": { "value": 28.9953000000000002955857780762016773223876953125, "raw_values": [ 28.9652999999999991587174008600413799285888671875, 29.083800000000000096633812063373625278472900390625, 28.936800000000001631406121305190026760101318359375 ], "test_run_times": [ 44.99000000000000198951966012828052043914794921875, 44.32000000000000028421709430404007434844970703125, 43.77000000000000312638803734444081783294677734375 ] }, "c": { "value": 29.202999999999999403144101961515843868255615234375, "raw_values": [ 29.13850000000000051159076974727213382720947265625, 29.146300000000000096633812063373625278472900390625, 29.3241000000000013869794202037155628204345703125 ], "test_run_times": [ 44.13000000000000255795384873636066913604736328125, 44.38000000000000255795384873636066913604736328125, 43.719999999999998863131622783839702606201171875 ] } } }, "f524385817c97baf9338a7ff6f39a7c655b03295": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 2323.97989999999981591827236115932464599609375, "raw_values": [ 2319.161799999999857391230762004852294921875, 2325.9257999999999810825102031230926513671875, 2326.85210000000006402842700481414794921875 ], "test_run_times": [ 46.88000000000000255795384873636066913604736328125, 45.89999999999999857891452847979962825775146484375, 45.8599999999999994315658113919198513031005859375 ] }, "b": { "value": 2324.73619999999982610461302101612091064453125, "raw_values": [ 2321.90869999999995343387126922607421875, 2330.56640000000015788828022778034210205078125, 2321.73349999999982173903845250606536865234375 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.89999999999999857891452847979962825775146484375, 45.97999999999999687361196265555918216705322265625 ] }, "c": { "value": 2322.58030000000007930793799459934234619140625, "raw_values": [ 2321.51409999999987121555022895336151123046875, 2323.28710000000000945874489843845367431640625, 2322.93960000000015497789718210697174072265625 ], "test_run_times": [ 46.00999999999999801048033987171947956085205078125, 45.909999999999996589394868351519107818603515625, 46.07000000000000028421709430404007434844970703125 ] } } }, "6d1bc6324fc6f3c201d57050ed8113b8f3aaa20f": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 13.7504000000000008441247700829990208148956298828125, "raw_values": [ 13.7783999999999995367261362844146788120269775390625, 13.73949999999999960209606797434389591217041015625, 13.7332999999999998408384271897375583648681640625 ], "test_run_times": [ 46.88000000000000255795384873636066913604736328125, 45.89999999999999857891452847979962825775146484375, 45.8599999999999994315658113919198513031005859375 ] }, "b": { "value": 13.7461999999999999744204615126363933086395263671875, "raw_values": [ 13.763400000000000744648787076584994792938232421875, 13.7111000000000000653699316899292171001434326171875, 13.7642000000000006565414878423325717449188232421875 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.89999999999999857891452847979962825775146484375, 45.97999999999999687361196265555918216705322265625 ] }, "c": { "value": 13.7597000000000004860112312599085271358489990234375, "raw_values": [ 13.7660000000000000142108547152020037174224853515625, 13.7556999999999991501908880309201776981353759765625, 13.757400000000000517275111633352935314178466796875 ], "test_run_times": [ 46.00999999999999801048033987171947956085205078125, 45.909999999999996589394868351519107818603515625, 46.07000000000000028421709430404007434844970703125 ] } } }, "1414e9d238abf3c69640ae7afe5a8630f728e27e": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 210.96379999999999199644662439823150634765625, "raw_values": [ 213.17050000000000409272615797817707061767578125, 212.1902000000000043655745685100555419921875, 207.53059999999999263309291563928127288818359375 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.780000000000001136868377216160297393798828125, 45.75999999999999801048033987171947956085205078125 ] }, "b": { "value": 210.81000000000000227373675443232059478759765625, "raw_values": [ 211.729500000000001591615728102624416351318359375, 209.148400000000009413270163349807262420654296875, 211.551999999999992496668710373342037200927734375 ], "test_run_times": [ 45.840000000000003410605131648480892181396484375, 45.7999999999999971578290569595992565155029296875, 45.75999999999999801048033987171947956085205078125 ] }, "c": { "value": 209.609499999999997044142219237983226776123046875, "raw_values": [ 208.68999999999999772626324556767940521240234375, 210.345699999999993679011822678148746490478515625, 209.79279999999999972715158946812152862548828125 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.8599999999999994315658113919198513031005859375, 45.85000000000000142108547152020037174224853515625 ] } } }, "4bdc2e856120b16bb5c7704dd9f24c0d445a7eaf": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 4.7354000000000002756905814749188721179962158203125, "raw_values": [ 4.68550000000000022026824808563105762004852294921875, 4.70769999999999999573674358543939888477325439453125, 4.8131000000000003780087354243732988834381103515625 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.780000000000001136868377216160297393798828125, 45.75999999999999801048033987171947956085205078125 ] }, "b": { "value": 4.7385999999999999232613845379091799259185791015625, "raw_values": [ 4.7179000000000002046363078989088535308837890625, 4.7760999999999995679900166578590869903564453125, 4.7217999999999999971578290569595992565155029296875 ], "test_run_times": [ 45.840000000000003410605131648480892181396484375, 45.7999999999999971578290569595992565155029296875, 45.75999999999999801048033987171947956085205078125 ] }, "c": { "value": 4.765399999999999636202119290828704833984375, "raw_values": [ 4.7858999999999998209432305884547531604766845703125, 4.74849999999999994315658113919198513031005859375, 4.76180000000000003268496584496460855007171630859375 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.8599999999999994315658113919198513031005859375, 45.85000000000000142108547152020037174224853515625 ] } } }, "a9114050bf9d19d8068bec56f0849556b5ad7e41": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 934.6523999999999432475306093692779541015625, "raw_values": [ 928.229199999999991632648743689060211181640625, 940.68910000000005311449058353900909423828125, 935.038999999999987267074175179004669189453125 ], "test_run_times": [ 39.32000000000000028421709430404007434844970703125, 38.159999999999996589394868351519107818603515625, 38.21000000000000085265128291212022304534912109375 ] }, "b": { "value": 928.4461999999999761712388135492801666259765625, "raw_values": [ 942.3545000000000300133251585066318511962890625, 931.120400000000017826096154749393463134765625, 911.8636999999999943611328490078449249267578125 ], "test_run_times": [ 38.280000000000001136868377216160297393798828125, 38.17999999999999971578290569595992565155029296875, 38.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 939.536299999999982901499606668949127197265625, "raw_values": [ 941.0583000000000311047188006341457366943359375, 938.1916999999999688952811993658542633056640625, 939.3590000000000372892827726900577545166015625 ], "test_run_times": [ 38.24000000000000198951966012828052043914794921875, 38.21000000000000085265128291212022304534912109375, 38.25 ] } } }, "39697168b3b50cc5be0663ce16b826085d7964b6": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.21260000000000189857018995098769664764404296875, "raw_values": [ 34.4508000000000009777068044058978557586669921875, 33.99040000000000105728759081102907657623291015625, 34.19659999999999655528881703503429889678955078125 ], "test_run_times": [ 39.32000000000000028421709430404007434844970703125, 38.159999999999996589394868351519107818603515625, 38.21000000000000085265128291212022304534912109375 ] }, "b": { "value": 34.44630000000000080717654782347381114959716796875, "raw_values": [ 33.9365999999999985448084771633148193359375, 34.3293000000000034788172342814505100250244140625, 35.0730999999999966121322358958423137664794921875 ], "test_run_times": [ 38.280000000000001136868377216160297393798828125, 38.17999999999999971578290569595992565155029296875, 38.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 34.0379999999999967030817060731351375579833984375, "raw_values": [ 33.9834000000000031604940886609256267547607421875, 34.083899999999999863575794734060764312744140625, 34.0467000000000012960299500264227390289306640625 ], "test_run_times": [ 38.24000000000000198951966012828052043914794921875, 38.21000000000000085265128291212022304534912109375, 38.25 ] } } }, "1654e04c4da2ac25065bfa01530180c82acb03cd": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 286.8881999999999834471964277327060699462890625, "raw_values": [ 285.14780000000001791704562492668628692626953125, 288.53280000000000882209860719740390777587890625, 286.98399999999998044586391188204288482666015625 ], "test_run_times": [ 37.28999999999999914734871708787977695465087890625, 37.38000000000000255795384873636066913604736328125, 37.28999999999999914734871708787977695465087890625 ] }, "b": { "value": 290.28260000000000218278728425502777099609375, "raw_values": [ 289.2549000000000205545802600681781768798828125, 290.1109000000000150976120494306087493896484375, 291.48200000000002773958840407431125640869140625 ], "test_run_times": [ 37.31000000000000227373675443232059478759765625, 37.28999999999999914734871708787977695465087890625, 37.25999999999999801048033987171947956085205078125 ] }, "c": { "value": 287.34690000000000509317032992839813232421875, "raw_values": [ 287.0076000000000249201548285782337188720703125, 289.626899999999977808329276740550994873046875, 285.4062000000000125510268844664096832275390625 ], "test_run_times": [ 37.3299999999999982946974341757595539093017578125, 37.32000000000000028421709430404007434844970703125, 37.340000000000003410605131648480892181396484375 ] } } }, "5dea4cb36afc2938810567625491f7b43ad557cd": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 3.4824999999999999289457264239899814128875732421875, "raw_values": [ 3.503699999999999814548345966613851487636566162109375, 3.462499999999999911182158029987476766109466552734375, 3.48130000000000006110667527536861598491668701171875 ], "test_run_times": [ 37.28999999999999914734871708787977695465087890625, 37.38000000000000255795384873636066913604736328125, 37.28999999999999914734871708787977695465087890625 ] }, "b": { "value": 3.44169999999999998152588887023739516735076904296875, "raw_values": [ 3.45389999999999997015720509807579219341278076171875, 3.443599999999999994315658113919198513031005859375, 3.4275000000000002131628207280300557613372802734375 ], "test_run_times": [ 37.31000000000000227373675443232059478759765625, 37.28999999999999914734871708787977695465087890625, 37.25999999999999801048033987171947956085205078125 ] }, "c": { "value": 3.47670000000000012363443602225743234157562255859375, "raw_values": [ 3.48050000000000014921397450962103903293609619140625, 3.449600000000000221689333557151257991790771484375, 3.5 ], "test_run_times": [ 37.3299999999999982946974341757595539093017578125, 37.32000000000000028421709430404007434844970703125, 37.340000000000003410605131648480892181396484375 ] } } }, "1a8f84ecf131a8f2bb9cf496b58f44a8a27991a2": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5706.6963999999998122802935540676116943359375, "raw_values": [ 5696.47999999999956344254314899444580078125, 5737.302700000000186264514923095703125, 5686.30659999999988940544426441192626953125 ], "test_run_times": [ 37.8299999999999982946974341757595539093017578125, 37.72999999999999687361196265555918216705322265625, 37.68999999999999772626324556767940521240234375 ] }, "b": { "value": 5717.518500000000130967237055301666259765625, "raw_values": [ 5734.587900000000445288605988025665283203125, 5698.336100000000442378222942352294921875, 5719.6315000000004147295840084552764892578125 ], "test_run_times": [ 37.78999999999999914734871708787977695465087890625, 37.6400000000000005684341886080801486968994140625, 37.719999999999998863131622783839702606201171875 ] }, "c": { "value": 5704.9530000000004292814992368221282958984375, "raw_values": [ 5713.3148000000001047737896442413330078125, 5729.124200000000200816430151462554931640625, 5672.4198999999998704879544675350189208984375 ], "test_run_times": [ 37.780000000000001136868377216160297393798828125, 37.81000000000000227373675443232059478759765625, 37.72999999999999687361196265555918216705322265625 ] } } }, "fe8adf6ae3796d52419bec3b9df723076023e933": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5.5952999999999999403144101961515843868255615234375, "raw_values": [ 5.60569999999999968309793985099531710147857666015625, 5.56519999999999992468247000942938029766082763671875, 5.6150999999999999801048033987171947956085205078125 ], "test_run_times": [ 37.8299999999999982946974341757595539093017578125, 37.72999999999999687361196265555918216705322265625, 37.68999999999999772626324556767940521240234375 ] }, "b": { "value": 5.58439999999999958646412778762169182300567626953125, "raw_values": [ 5.56810000000000027142732506035827100276947021484375, 5.60310000000000041353587221237830817699432373046875, 5.58190000000000008384404281969182193279266357421875 ], "test_run_times": [ 37.78999999999999914734871708787977695465087890625, 37.6400000000000005684341886080801486968994140625, 37.719999999999998863131622783839702606201171875 ] }, "c": { "value": 5.59649999999999980815346134477294981479644775390625, "raw_values": [ 5.58940000000000036806113712373189628124237060546875, 5.573100000000000164845914696343243122100830078125, 5.62699999999999977973175191436894237995147705078125 ], "test_run_times": [ 37.780000000000001136868377216160297393798828125, 37.81000000000000227373675443232059478759765625, 37.72999999999999687361196265555918216705322265625 ] } } }, "3b440bbd8e4ccd918716ffc64aa79f6a9429dae7": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 701.791500000000041836756281554698944091796875, "raw_values": [ 699.5648999999999659848981536924839019775390625, 699.874199999999973442754708230495452880859375, 705.9352999999999838109943084418773651123046875 ], "test_run_times": [ 37.25999999999999801048033987171947956085205078125, 37.159999999999996589394868351519107818603515625, 37.10000000000000142108547152020037174224853515625 ] }, "b": { "value": 705.826800000000048385118134319782257080078125, "raw_values": [ 711.6182999999999765350366942584514617919921875, 704.0123999999999568899511359632015228271484375, 701.84979999999995925463736057281494140625 ], "test_run_times": [ 37.14999999999999857891452847979962825775146484375, 37.18999999999999772626324556767940521240234375, 37.1099999999999994315658113919198513031005859375 ] }, "c": { "value": 701.7060999999999921783455647528171539306640625, "raw_values": [ 702.138400000000046929926611483097076416015625, 701.7242999999999710780684836208820343017578125, 701.255499999999983629095368087291717529296875 ], "test_run_times": [ 37.159999999999996589394868351519107818603515625, 37.21000000000000085265128291212022304534912109375, 37.17999999999999971578290569595992565155029296875 ] } } }, "43a4d7c1eff55bcea48516c4a6afc01afa37a084": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1.4199999999999999289457264239899814128875732421875, "raw_values": [ 1.4227000000000000756728013584506697952747344970703125, 1.4248000000000000664357457935693673789501190185546875, 1.4126000000000000778044295657309703528881072998046875 ], "test_run_times": [ 37.25999999999999801048033987171947956085205078125, 37.159999999999996589394868351519107818603515625, 37.10000000000000142108547152020037174224853515625 ] }, "b": { "value": 1.4123000000000001108446667785756289958953857421875, "raw_values": [ 1.40129999999999999005240169935859739780426025390625, 1.41500000000000003552713678800500929355621337890625, 1.4206000000000000849098569233319722115993499755859375 ], "test_run_times": [ 37.14999999999999857891452847979962825775146484375, 37.18999999999999772626324556767940521240234375, 37.1099999999999994315658113919198513031005859375 ] }, "c": { "value": 1.420500000000000095923269327613525092601776123046875, "raw_values": [ 1.4208000000000000628830321147688664495944976806640625, 1.419200000000000017053025658242404460906982421875, 1.4214999999999999857891452847979962825775146484375 ], "test_run_times": [ 37.159999999999996589394868351519107818603515625, 37.21000000000000085265128291212022304534912109375, 37.17999999999999971578290569595992565155029296875 ] } } }, "30a0ae27e6fce0ebd1a53ca1cf7c2475badd4741": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 436.522600000000011277734301984310150146484375, "raw_values": [ 437.18419999999997571649146266281604766845703125, 436.155700000000024374458007514476776123046875, 436.2278999999999768988345749676227569580078125 ], "test_run_times": [ 38.06000000000000227373675443232059478759765625, 37.74000000000000198951966012828052043914794921875, 37.780000000000001136868377216160297393798828125 ] }, "b": { "value": 436.32859999999999445208231918513774871826171875, "raw_values": [ 435.72669999999999390638549812138080596923828125, 436.361400000000003274180926382541656494140625, 436.89769999999998617568053305149078369140625 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.780000000000001136868377216160297393798828125, 37.78999999999999914734871708787977695465087890625 ] }, "c": { "value": 435.4932000000000016370904631912708282470703125, "raw_values": [ 435.1290999999999939973349682986736297607421875, 435.56990000000001828084350563585758209228515625, 435.78050000000001773514668457210063934326171875 ], "test_run_times": [ 37.85000000000000142108547152020037174224853515625, 37.72999999999999687361196265555918216705322265625, 37.719999999999998863131622783839702606201171875 ] } } }, "bf5141edd92c8c1e44875bf4322842f2d565a81a": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 73.2660000000000053432813729159533977508544921875, "raw_values": [ 73.1657000000000010686562745831906795501708984375, 73.3104000000000013415046851150691509246826171875, 73.3220000000000027284841053187847137451171875 ], "test_run_times": [ 38.06000000000000227373675443232059478759765625, 37.74000000000000198951966012828052043914794921875, 37.780000000000001136868377216160297393798828125 ] }, "b": { "value": 73.293499999999994543031789362430572509765625, "raw_values": [ 73.3789000000000015688783605583012104034423828125, 73.2917000000000058435034588910639286041259765625, 73.2099999999999937472239253111183643341064453125 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.780000000000001136868377216160297393798828125, 37.78999999999999914734871708787977695465087890625 ] }, "c": { "value": 73.4266999999999967485564411617815494537353515625, "raw_values": [ 73.4866999999999990222931955941021442413330078125, 73.4131000000000000227373675443232059478759765625, 73.38020000000000209183781407773494720458984375 ], "test_run_times": [ 37.85000000000000142108547152020037174224853515625, 37.72999999999999687361196265555918216705322265625, 37.719999999999998863131622783839702606201171875 ] } } }, "59d928faf884edbadd7e25d023874b40a291e0c0": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 164.939300000000002910383045673370361328125, "raw_values": [ 165.439300000000002910383045673370361328125, 165.76560000000000627551344223320484161376953125, 163.612899999999996225596987642347812652587890625 ], "test_run_times": [ 37.5, 37.47999999999999687361196265555918216705322265625, 37.5 ] }, "b": { "value": 164.896800000000013142198440618813037872314453125, "raw_values": [ 165.07679999999999154169927351176738739013671875, 164.67640000000000100044417195022106170654296875, 164.93729999999999336068867705762386322021484375 ], "test_run_times": [ 37.52000000000000312638803734444081783294677734375, 37.56000000000000227373675443232059478759765625, 37.4500000000000028421709430404007434844970703125 ] }, "c": { "value": 163.971800000000001773514668457210063934326171875, "raw_values": [ 164.2187999999999874489731155335903167724609375, 163.507399999999989859134075231850147247314453125, 164.189300000000002910383045673370361328125 ], "test_run_times": [ 37.530000000000001136868377216160297393798828125, 37.52000000000000312638803734444081783294677734375, 37.60000000000000142108547152020037174224853515625 ] } } }, "462f293f366723d6995e274ef4bcdb1bff660c2d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 6.05769999999999964046537570538930594921112060546875, "raw_values": [ 6.03910000000000035669245335157029330730438232421875, 6.02740000000000009094947017729282379150390625, 6.1066000000000002501110429875552654266357421875 ], "test_run_times": [ 37.5, 37.47999999999999687361196265555918216705322265625, 37.5 ] }, "b": { "value": 6.05890000000000039648284655413590371608734130859375, "raw_values": [ 6.05229999999999979110043568653054535388946533203125, 6.067099999999999937472239253111183643341064453125, 6.05740000000000033963942769332788884639739990234375 ], "test_run_times": [ 37.52000000000000312638803734444081783294677734375, 37.56000000000000227373675443232059478759765625, 37.4500000000000028421709430404007434844970703125 ] }, "c": { "value": 6.0922000000000000596855898038484156131744384765625, "raw_values": [ 6.08349999999999990762944435118697583675384521484375, 6.10850000000000026290081223123706877231597900390625, 6.0846999999999997754684954998083412647247314453125 ], "test_run_times": [ 37.530000000000001136868377216160297393798828125, 37.52000000000000312638803734444081783294677734375, 37.60000000000000142108547152020037174224853515625 ] } } }, "110f1cc60ec0ea7c1af675f5581fd8635260d922": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 86.302400000000005775291356258094310760498046875, "raw_values": [ 86.52469999999999572537490166723728179931640625, 86.330299999999994042809703387320041656494140625, 86.0520999999999958163243718445301055908203125 ], "test_run_times": [ 90.590000000000003410605131648480892181396484375, 75.9899999999999948840923025272786617279052734375, 76.7099999999999937472239253111183643341064453125 ] }, "b": { "value": 86.2913999999999958845364744774997234344482421875, "raw_values": [ 86.4578999999999950887286104261875152587890625, 86.2395000000000067075234255753457546234130859375, 86.1768000000000000682121026329696178436279296875 ], "test_run_times": [ 75.9500000000000028421709430404007434844970703125, 76.68000000000000682121026329696178436279296875, 76.43999999999999772626324556767940521240234375 ] }, "c": { "value": 86.1709000000000031604940886609256267547607421875, "raw_values": [ 86.2651000000000038880898500792682170867919921875, 86.151399999999995316102285869419574737548828125, 86.096100000000006957634468562901020050048828125 ], "test_run_times": [ 77, 76.909999999999996589394868351519107818603515625, 76.599999999999994315658113919198513031005859375 ] } } }, "9ff1e78c5264f23b5224a84b200df72830b13579": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 370.7287000000000034560798667371273040771484375, "raw_values": [ 369.77989999999999781721271574497222900390625, 370.598799999999982901499606668949127197265625, 371.8075000000000045474735088646411895751953125 ], "test_run_times": [ 90.590000000000003410605131648480892181396484375, 75.9899999999999948840923025272786617279052734375, 76.7099999999999937472239253111183643341064453125 ] }, "b": { "value": 370.77609999999998535713530145585536956787109375, "raw_values": [ 370.0656999999999925421434454619884490966796875, 370.99299999999999499777914024889469146728515625, 371.2694999999999936335370875895023345947265625 ], "test_run_times": [ 75.9500000000000028421709430404007434844970703125, 76.68000000000000682121026329696178436279296875, 76.43999999999999772626324556767940521240234375 ] }, "c": { "value": 371.2957000000000107320374809205532073974609375, "raw_values": [ 370.88470000000000936779542826116085052490234375, 371.3863000000000056388671509921550750732421875, 371.61610000000001718944986350834369659423828125 ], "test_run_times": [ 77, 76.909999999999996589394868351519107818603515625, 76.599999999999994315658113919198513031005859375 ] } } }, "b4b0dae41eeea56982616df74c29d8fe7770a0a2": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 31.224599999999998800603862036950886249542236328125, "raw_values": [ 31.194500000000001449507180950604379177093505859375, 31.25150000000000005684341886080801486968994140625, 31.227699999999998681232682429254055023193359375 ], "test_run_times": [ 75.7600000000000051159076974727213382720947265625, 75.7399999999999948840923025272786617279052734375, 75.1700000000000017053025658242404460906982421875 ] }, "b": { "value": 31.146499999999999630517777404747903347015380859375, "raw_values": [ 31.15480000000000160298441187478601932525634765625, 31.19590000000000173940861714072525501251220703125, 31.088899999999998868815964669920504093170166015625 ], "test_run_times": [ 75.1099999999999994315658113919198513031005859375, 75.8599999999999994315658113919198513031005859375, 76.219999999999998863131622783839702606201171875 ] }, "c": { "value": 31.1875, "raw_values": [ 31.03750000000000142108547152020037174224853515625, 31.245400000000000062527760746888816356658935546875, 31.2794999999999987494447850622236728668212890625 ], "test_run_times": [ 75.6099999999999994315658113919198513031005859375, 75.5199999999999960209606797434389591217041015625, 75.9200000000000017053025658242404460906982421875 ] } } }, "ef3131cb650fc5296dcb8c35cc5728d21bc68983": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 32.01970000000000027284841053187847137451171875, "raw_values": [ 32.05049999999999954525264911353588104248046875, 31.99210000000000064801497501321136951446533203125, 32.01639999999999730562194599770009517669677734375 ], "test_run_times": [ 75.7600000000000051159076974727213382720947265625, 75.7399999999999948840923025272786617279052734375, 75.1700000000000017053025658242404460906982421875 ] }, "b": { "value": 32.09989999999999810142981004901230335235595703125, "raw_values": [ 32.091599999999999681676854379475116729736328125, 32.048799999999999954525264911353588104248046875, 32.159300000000001773514668457210063934326171875 ], "test_run_times": [ 75.1099999999999994315658113919198513031005859375, 75.8599999999999994315658113919198513031005859375, 76.219999999999998863131622783839702606201171875 ] }, "c": { "value": 32.05850000000000221689333557151257991790771484375, "raw_values": [ 32.21309999999999718056642450392246246337890625, 31.998999999999998777866494492627680301666259765625, 31.963499999999999801048033987171947956085205078125 ], "test_run_times": [ 75.6099999999999994315658113919198513031005859375, 75.5199999999999960209606797434389591217041015625, 75.9200000000000017053025658242404460906982421875 ] } } }, "59e3c791f39382e6c9e84cf0bd6166c7d7b5ba9e": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 933.00739999999996143742464482784271240234375, "raw_values": [ 925.69219999999995707185007631778717041015625, 938.7341999999999870851752348244190216064453125, 934.5958000000000538420863449573516845703125 ], "test_run_times": [ 38.24000000000000198951966012828052043914794921875, 38.1700000000000017053025658242404460906982421875, 38.22999999999999687361196265555918216705322265625 ] }, "b": { "value": 934.5223999999999477950041182339191436767578125, "raw_values": [ 928.5565000000000281943357549607753753662109375, 931.3125, 943.69830000000001746229827404022216796875 ], "test_run_times": [ 38.280000000000001136868377216160297393798828125, 38.219999999999998863131622783839702606201171875, 38.2000000000000028421709430404007434844970703125 ] }, "c": { "value": 940.2197999999999638021108694374561309814453125, "raw_values": [ 939.83699999999998908606357872486114501953125, 940.4242000000000416548573412001132965087890625, 940.3982999999999492501956410706043243408203125 ], "test_run_times": [ 38.280000000000001136868377216160297393798828125, 38.17999999999999971578290569595992565155029296875, 38.24000000000000198951966012828052043914794921875 ] } } }, "eca4294ef9f65f9eb7e3619864362bb782b221df": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.27499999999999857891452847979962825775146484375, "raw_values": [ 34.54780000000000228510543820448219776153564453125, 34.06790000000000162572177941910922527313232421875, 34.2092999999999989313437254168093204498291015625 ], "test_run_times": [ 38.24000000000000198951966012828052043914794921875, 38.1700000000000017053025658242404460906982421875, 38.22999999999999687361196265555918216705322265625 ] }, "b": { "value": 34.21730000000000160298441187478601932525634765625, "raw_values": [ 34.42549999999999954525264911353588104248046875, 34.33959999999999723740984336473047733306884765625, 33.886899999999997135091689415276050567626953125 ], "test_run_times": [ 38.280000000000001136868377216160297393798828125, 38.219999999999998863131622783839702606201171875, 38.2000000000000028421709430404007434844970703125 ] }, "c": { "value": 34.00800000000000267164068645797669887542724609375, "raw_values": [ 34.0251999999999981127984938211739063262939453125, 34.0022000000000019781509763561189174652099609375, 33.996499999999997498889570124447345733642578125 ], "test_run_times": [ 38.280000000000001136868377216160297393798828125, 38.17999999999999971578290569595992565155029296875, 38.24000000000000198951966012828052043914794921875 ] } } }, "6cffa9ab35b6aef98adc22c9570d27e8498b2cc7": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 290.01330000000001518856151960790157318115234375, "raw_values": [ 287.75119999999998299244907684624195098876953125, 293.1689999999999827196006663143634796142578125, 289.11970000000002301021595485508441925048828125 ], "test_run_times": [ 37.32000000000000028421709430404007434844970703125, 37.25, 37.2000000000000028421709430404007434844970703125 ] }, "b": { "value": 288.68490000000002737579052336513996124267578125, "raw_values": [ 286.70359999999999445208231918513774871826171875, 289.6861000000000103682396002113819122314453125, 289.66500000000002046363078989088535308837890625 ], "test_run_times": [ 37.24000000000000198951966012828052043914794921875, 37.3299999999999982946974341757595539093017578125, 37.31000000000000227373675443232059478759765625 ] }, "c": { "value": 289.80810000000002446540747769176959991455078125, "raw_values": [ 289.132299999999986539478413760662078857421875, 291.74799999999999045030563138425350189208984375, 288.5439000000000078216544352471828460693359375 ], "test_run_times": [ 37.280000000000001136868377216160297393798828125, 37.31000000000000227373675443232059478759765625, 37.38000000000000255795384873636066913604736328125 ] } } }, "753aeb8a274f556289615ead1b33b34309049c95": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 3.4451999999999998181010596454143524169921875, "raw_values": [ 3.47210000000000018616219676914624869823455810546875, 3.4077000000000001733724275254644453525543212890625, 3.455799999999999982946974341757595539093017578125 ], "test_run_times": [ 37.32000000000000028421709430404007434844970703125, 37.25, 37.2000000000000028421709430404007434844970703125 ] }, "b": { "value": 3.460900000000000087396756498492322862148284912109375, "raw_values": [ 3.484599999999999919708670859108678996562957763671875, 3.4489000000000000767386154620908200740814208984375, 3.449199999999999821653773324214853346347808837890625 ], "test_run_times": [ 37.24000000000000198951966012828052043914794921875, 37.3299999999999982946974341757595539093017578125, 37.31000000000000227373675443232059478759765625 ] }, "c": { "value": 3.447299999999999808864004080533050000667572021484375, "raw_values": [ 3.45540000000000002700062395888380706310272216796875, 3.42419999999999991047161529422737658023834228515625, 3.46220000000000016626700016786344349384307861328125 ], "test_run_times": [ 37.280000000000001136868377216160297393798828125, 37.31000000000000227373675443232059478759765625, 37.38000000000000255795384873636066913604736328125 ] } } }, "99fe49a34e19276c2c1e1cabb81232bca03c6b56": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 452.1951000000000249201548285782337188720703125, "raw_values": [ 452.38429999999999608917278237640857696533203125, 451.61079999999998335624695755541324615478515625, 452.5901999999999816282070241868495941162109375 ], "test_run_times": [ 38.030000000000001136868377216160297393798828125, 37.6400000000000005684341886080801486968994140625, 37.77000000000000312638803734444081783294677734375 ] }, "b": { "value": 452.16410000000001900843926705420017242431640625, "raw_values": [ 452.13420000000002119122655130922794342041015625, 452.19229999999998881321516819298267364501953125, 452.165799999999990177457220852375030517578125 ], "test_run_times": [ 37.659999999999996589394868351519107818603515625, 37.64999999999999857891452847979962825775146484375, 37.7000000000000028421709430404007434844970703125 ] }, "c": { "value": 450.491800000000012005330063402652740478515625, "raw_values": [ 449.42779999999999063220457173883914947509765625, 451.15699999999998226485331542789936065673828125, 450.89069999999998117345967330038547515869140625 ], "test_run_times": [ 37.74000000000000198951966012828052043914794921875, 37.75999999999999801048033987171947956085205078125, 37.659999999999996589394868351519107818603515625 ] } } }, "d3a51d2475684402105c9de929d898b8c318d267": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 70.737300000000004729372449219226837158203125, "raw_values": [ 70.708200000000005047695594839751720428466796875, 70.8267000000000024328983272425830364227294921875, 70.6769000000000033878677641041576862335205078125 ], "test_run_times": [ 38.030000000000001136868377216160297393798828125, 37.6400000000000005684341886080801486968994140625, 37.77000000000000312638803734444081783294677734375 ] }, "b": { "value": 70.7412000000000062982508097775280475616455078125, "raw_values": [ 70.743300000000004956746124662458896636962890625, 70.7377999999999929059413261711597442626953125, 70.7425999999999959300112095661461353302001953125 ], "test_run_times": [ 37.659999999999996589394868351519107818603515625, 37.64999999999999857891452847979962825775146484375, 37.7000000000000028421709430404007434844970703125 ] }, "c": { "value": 71.0045999999999963847585604526102542877197265625, "raw_values": [ 71.1744000000000056616045185364782810211181640625, 70.89650000000000318323145620524883270263671875, 70.9429999999999978399500832892954349517822265625 ], "test_run_times": [ 37.74000000000000198951966012828052043914794921875, 37.75999999999999801048033987171947956085205078125, 37.659999999999996589394868351519107818603515625 ] } } }, "184fece0867b0c453d1ea8cbb6c3eeeca294f0fd": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 166.65670000000000072759576141834259033203125, "raw_values": [ 166.06409999999999627107172273099422454833984375, 167.21080000000000609361450187861919403076171875, 166.6951999999999998181010596454143524169921875 ], "test_run_times": [ 37.50999999999999801048033987171947956085205078125, 37.4500000000000028421709430404007434844970703125, 37.469999999999998863131622783839702606201171875 ] }, "b": { "value": 166.512300000000010413714335300028324127197265625, "raw_values": [ 166.666300000000006775735528208315372467041015625, 166.025499999999993860910763032734394073486328125, 166.844999999999998863131622783839702606201171875 ], "test_run_times": [ 37.52000000000000312638803734444081783294677734375, 37.46000000000000085265128291212022304534912109375, 37.469999999999998863131622783839702606201171875 ] }, "c": { "value": 166.30500000000000682121026329696178436279296875, "raw_values": [ 165.945300000000003137756721116602420806884765625, 166.3636999999999943611328490078449249267578125, 166.605899999999991223376127891242504119873046875 ], "test_run_times": [ 37.530000000000001136868377216160297393798828125, 37.56000000000000227373675443232059478759765625, 37.52000000000000312638803734444081783294677734375 ] } } }, "386d3c9c7501657468be0ac976a04b369aced25d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5.9969999999999998863131622783839702606201171875, "raw_values": [ 6.01860000000000017195134205394424498081207275390625, 5.97759999999999980246911945869214832782745361328125, 5.99490000000000033963942769332788884639739990234375 ], "test_run_times": [ 37.50999999999999801048033987171947956085205078125, 37.4500000000000028421709430404007434844970703125, 37.469999999999998863131622783839702606201171875 ] }, "b": { "value": 6.0022999999999999687361196265555918216705322265625, "raw_values": [ 5.9969999999999998863131622783839702606201171875, 6.01930000000000031690206014900468289852142333984375, 5.99059999999999970299313645227812230587005615234375 ], "test_run_times": [ 37.52000000000000312638803734444081783294677734375, 37.46000000000000085265128291212022304534912109375, 37.469999999999998863131622783839702606201171875 ] }, "c": { "value": 6.00959999999999983089082888909615576267242431640625, "raw_values": [ 6.02240000000000019753088054130785167217254638671875, 6.007600000000000051159076974727213382720947265625, 5.99889999999999989910293152206577360630035400390625 ], "test_run_times": [ 37.530000000000001136868377216160297393798828125, 37.56000000000000227373675443232059478759765625, 37.52000000000000312638803734444081783294677734375 ] } } }, "bbe2982cef2af31b6c22d5cc1487ed124ca4ed4b": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 641.1046999999999798092176206409931182861328125, "raw_values": [ 640.200100000000020372681319713592529296875, 641.597999999999956344254314899444580078125, 641.516100000000051295501179993152618408203125 ], "test_run_times": [ 42.8900000000000005684341886080801486968994140625, 40.0799999999999982946974341757595539093017578125, 40.11999999999999744204615126363933086395263671875 ] }, "b": { "value": 637.6091999999999870851752348244190216064453125, "raw_values": [ 633.7439000000000532963895238935947418212890625, 639.8617000000000416548573412001132965087890625, 639.221999999999979991116560995578765869140625 ], "test_run_times": [ 40.11999999999999744204615126363933086395263671875, 40.03999999999999914734871708787977695465087890625, 40.3599999999999994315658113919198513031005859375 ] }, "c": { "value": 637.41750000000001818989403545856475830078125, "raw_values": [ 634.3753000000000383806764148175716400146484375, 636.4083000000000538420863449573516845703125, 641.4687999999999874489731155335903167724609375 ], "test_run_times": [ 40.159999999999996589394868351519107818603515625, 40.17999999999999971578290569595992565155029296875, 40.07000000000000028421709430404007434844970703125 ] } } }, "19d426cc943b00227b564f6813b33d710c2a4615": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 49.895499999999998408384271897375583648681640625, "raw_values": [ 49.9652999999999991587174008600413799285888671875, 49.85759999999999791953086969442665576934814453125, 49.86370000000000146656020660884678363800048828125 ], "test_run_times": [ 42.8900000000000005684341886080801486968994140625, 40.0799999999999982946974341757595539093017578125, 40.11999999999999744204615126363933086395263671875 ] }, "b": { "value": 50.1707999999999998408384271897375583648681640625, "raw_values": [ 50.47540000000000048885340220294892787933349609375, 49.99389999999999645297066308557987213134765625, 50.0431999999999987949195201508700847625732421875 ], "test_run_times": [ 40.11999999999999744204615126363933086395263671875, 40.03999999999999914734871708787977695465087890625, 40.3599999999999994315658113919198513031005859375 ] }, "c": { "value": 50.18639999999999901092451182194054126739501953125, "raw_values": [ 50.4258999999999986130205797962844371795654296875, 50.2659000000000020236257114447653293609619140625, 49.86749999999999971578290569595992565155029296875 ], "test_run_times": [ 40.159999999999996589394868351519107818603515625, 40.17999999999999971578290569595992565155029296875, 40.07000000000000028421709430404007434844970703125 ] } } }, "e9ceeb6664940d8b450401aeeb6cce42adb2afe5": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 186.025700000000000500222085975110530853271484375, "raw_values": [ 189.09489999999999554347596131265163421630859375, 185.225899999999995770849636755883693695068359375, 183.7563000000000101863406598567962646484375 ], "test_run_times": [ 39.280000000000001136868377216160297393798828125, 39.22999999999999687361196265555918216705322265625, 39.22999999999999687361196265555918216705322265625 ] }, "b": { "value": 188.5375999999999976353137753903865814208984375, "raw_values": [ 189.904099999999999681676854379475116729736328125, 188.009999999999990905052982270717620849609375, 187.69859999999999899955582804977893829345703125 ], "test_run_times": [ 39.25999999999999801048033987171947956085205078125, 39.32000000000000028421709430404007434844970703125, 39.24000000000000198951966012828052043914794921875 ] }, "c": { "value": 188.232400000000012596501619555056095123291015625, "raw_values": [ 188.686200000000013687895261682569980621337890625, 187.41280000000000427462509833276271820068359375, 188.5982999999999947249307297170162200927734375 ], "test_run_times": [ 39.2999999999999971578290569595992565155029296875, 39.31000000000000227373675443232059478759765625, 39.38000000000000255795384873636066913604736328125 ] } } }, "2d13c0ebad5488ddc8b194766412ebeba7b497e0": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5.3728999999999995651478457148186862468719482421875, "raw_values": [ 5.28469999999999995310417943983338773250579833984375, 5.39519999999999999573674358543939888477325439453125, 5.438900000000000289901436190120875835418701171875 ], "test_run_times": [ 39.280000000000001136868377216160297393798828125, 39.22999999999999687361196265555918216705322265625, 39.22999999999999687361196265555918216705322265625 ] }, "b": { "value": 5.30050000000000043343106881366111338138580322265625, "raw_values": [ 5.26219999999999998863131622783839702606201171875, 5.315400000000000346744855050928890705108642578125, 5.3239999999999998436805981327779591083526611328125 ], "test_run_times": [ 39.25999999999999801048033987171947956085205078125, 39.32000000000000028421709430404007434844970703125, 39.24000000000000198951966012828052043914794921875 ] }, "c": { "value": 5.30919999999999969730879456619732081890106201171875, "raw_values": [ 5.29629999999999956372676024329848587512969970703125, 5.33239999999999980673237587325274944305419921875, 5.298799999999999954525264911353588104248046875 ], "test_run_times": [ 39.2999999999999971578290569595992565155029296875, 39.31000000000000227373675443232059478759765625, 39.38000000000000255795384873636066913604736328125 ] } } }, "6089d6134855343b042b5ffe9f952c461140c3ab": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 96.13429999999999608917278237640857696533203125, "raw_values": [ 95.9635999999999995679900166578590869903564453125, 96.698700000000002319211489520967006683349609375, 95.74070000000000391082721762359142303466796875 ], "test_run_times": [ 41.469999999999998863131622783839702606201171875, 40.590000000000003410605131648480892181396484375, 40.25 ] }, "b": { "value": 95.63290000000000645741238258779048919677734375, "raw_values": [ 95.904099999999999681676854379475116729736328125, 95.091800000000006320988177321851253509521484375, 95.9029000000000024783730623312294483184814453125 ], "test_run_times": [ 40.28999999999999914734871708787977695465087890625, 40.53999999999999914734871708787977695465087890625, 40.25999999999999801048033987171947956085205078125 ] }, "c": { "value": 96.8520999999999929741534288041293621063232421875, "raw_values": [ 97.01200000000000045474735088646411895751953125, 96.802899999999993951860233210027217864990234375, 96.741500000000002046363078989088535308837890625 ], "test_run_times": [ 40.030000000000001136868377216160297393798828125, 40.60000000000000142108547152020037174224853515625, 40.22999999999999687361196265555918216705322265625 ] } } }, "a2efe4ee2ae3185b2d06fce82479f0651157c55c": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 332.80630000000002155502443201839923858642578125, "raw_values": [ 333.392200000000002546585164964199066162109375, 330.85989999999998190105543471872806549072265625, 334.16680000000002337401383556425571441650390625 ], "test_run_times": [ 41.469999999999998863131622783839702606201171875, 40.590000000000003410605131648480892181396484375, 40.25 ] }, "b": { "value": 334.315299999999979263520799577236175537109375, "raw_values": [ 333.603299999999990177457220852375030517578125, 335.733699999999998908606357872486114501953125, 333.60890000000000554791768081486225128173828125 ], "test_run_times": [ 40.28999999999999914734871708787977695465087890625, 40.53999999999999914734871708787977695465087890625, 40.25999999999999801048033987171947956085205078125 ] }, "c": { "value": 330.33519999999998617568053305149078369140625, "raw_values": [ 329.79059999999998353814589790999889373779296875, 330.50200000000000954969436861574649810791015625, 330.71289999999999054125510156154632568359375 ], "test_run_times": [ 40.030000000000001136868377216160297393798828125, 40.60000000000000142108547152020037174224853515625, 40.22999999999999687361196265555918216705322265625 ] } } }, "783e4fda90b92632a55752f151f8b54fe13bc5a4": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 35.1022999999999996134647517465054988861083984375, "raw_values": [ 35.2888999999999981582732289098203182220458984375, 35.22659999999999769215719425119459629058837890625, 34.7914999999999992041921359486877918243408203125 ], "test_run_times": [ 39.659999999999996589394868351519107818603515625, 39.5799999999999982946974341757595539093017578125, 39.5799999999999982946974341757595539093017578125 ] }, "b": { "value": 34.617400000000003501554601825773715972900390625, "raw_values": [ 34.5664000000000015688783605583012104034423828125, 34.03909999999999769215719425119459629058837890625, 35.24660000000000081854523159563541412353515625 ], "test_run_times": [ 39.64999999999999857891452847979962825775146484375, 39.63000000000000255795384873636066913604736328125, 39.63000000000000255795384873636066913604736328125 ] }, "c": { "value": 33.72460000000000235331754083745181560516357421875, "raw_values": [ 35.007800000000003137756721116602420806884765625, 31.553999999999998493649400188587605953216552734375, 34.93549999999999755573298898525536060333251953125, 34.73559999999999803321770741604268550872802734375, 35.08919999999999816964191268198192119598388671875, 32.59420000000000072759576141834259033203125, 31.261199999999998766497810720466077327728271484375, 34.9380000000000023874235921539366245269775390625, 34.20570000000000021600499167107045650482177734375, 34.67999999999999971578290569595992565155029296875, 34.6931000000000011596057447604835033416748046875, 34.94200000000000017053025658242404460906982421875, 31.81830000000000069348971010185778141021728515625, 33.347700000000003228706191293895244598388671875, 32.0662999999999982492226990871131420135498046875 ], "test_run_times": [ 39.61999999999999744204615126363933086395263671875, 39.71000000000000085265128291212022304534912109375, 39.72999999999999687361196265555918216705322265625, 39.780000000000001136868377216160297393798828125, 39.74000000000000198951966012828052043914794921875, 39.89999999999999857891452847979962825775146484375, 39.659999999999996589394868351519107818603515625, 39.780000000000001136868377216160297393798828125, 39.719999999999998863131622783839702606201171875, 39.659999999999996589394868351519107818603515625, 39.659999999999996589394868351519107818603515625, 39.77000000000000312638803734444081783294677734375, 39.719999999999998863131622783839702606201171875, 39.75, 39.75 ] } } }, "1f417a129a26ca72098c17e5820805ce0e39abde": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 28.461099999999998289013092289678752422332763671875, "raw_values": [ 28.31230000000000046611603465862572193145751953125, 28.361599999999999255351212923415005207061767578125, 28.70949999999999846522769075818359851837158203125 ], "test_run_times": [ 39.659999999999996589394868351519107818603515625, 39.5799999999999982946974341757595539093017578125, 39.5799999999999982946974341757595539093017578125 ] }, "b": { "value": 28.86540000000000105728759081102907657623291015625, "raw_values": [ 28.90050000000000096633812063373625278472900390625, 29.346199999999999619149093632586300373077392578125, 28.349599999999998800603862036950886249542236328125 ], "test_run_times": [ 39.64999999999999857891452847979962825775146484375, 39.63000000000000255795384873636066913604736328125, 39.63000000000000255795384873636066913604736328125 ] }, "c": { "value": 29.679899999999999948840923025272786617279052734375, "raw_values": [ 28.541199999999999903366187936626374721527099609375, 31.671099999999999141664375201798975467681884765625, 28.595900000000000318323145620524883270263671875, 28.763700000000000045474735088646411895751953125, 28.478300000000000835598257253877818584442138671875, 30.656400000000001426769813406281173229217529296875, 31.967099999999998516386767732910811901092529296875, 28.5972000000000008412825991399586200714111328125, 29.20629999999999881765688769519329071044921875, 28.8094999999999998863131622783839702606201171875, 28.799499999999998323119143606163561344146728515625, 28.59080000000000154614099301397800445556640625, 31.39880000000000137561073643155395984649658203125, 29.96130000000000137561073643155395984649658203125, 31.161799999999999499777914024889469146728515625 ], "test_run_times": [ 39.61999999999999744204615126363933086395263671875, 39.71000000000000085265128291212022304534912109375, 39.72999999999999687361196265555918216705322265625, 39.780000000000001136868377216160297393798828125, 39.74000000000000198951966012828052043914794921875, 39.89999999999999857891452847979962825775146484375, 39.659999999999996589394868351519107818603515625, 39.780000000000001136868377216160297393798828125, 39.719999999999998863131622783839702606201171875, 39.659999999999996589394868351519107818603515625, 39.659999999999996589394868351519107818603515625, 39.77000000000000312638803734444081783294677734375, 39.719999999999998863131622783839702606201171875, 39.75, 39.75 ] } } }, "c0672a4955f7b2ab1a405f869c012f764e80097e": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 938.06610000000000582076609134674072265625, "raw_values": [ 937.5078999999999496139935217797756195068359375, 938.0060999999999467036104761064052581787109375, 938.6842000000000325599103234708309173583984375 ], "test_run_times": [ 46.17999999999999971578290569595992565155029296875, 44.8299999999999982946974341757595539093017578125, 44.77000000000000312638803734444081783294677734375 ] }, "b": { "value": 937.5774999999999863575794734060764312744140625, "raw_values": [ 937.7604000000000041836756281554698944091796875, 937.5166000000000394720700569450855255126953125, 937.455400000000054205884225666522979736328125 ], "test_run_times": [ 44.89999999999999857891452847979962825775146484375, 44.7999999999999971578290569595992565155029296875, 44.71000000000000085265128291212022304534912109375 ] }, "c": { "value": 937.863000000000056388671509921550750732421875, "raw_values": [ 937.764400000000023283064365386962890625, 937.8174999999999954525264911353588104248046875, 938.0069999999999481588019989430904388427734375 ], "test_run_times": [ 44.88000000000000255795384873636066913604736328125, 44.8900000000000005684341886080801486968994140625, 44.82000000000000028421709430404007434844970703125 ] } } }, "60f855709ace180c19d54e5d245b05d6b1c7fe03": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.07249999999999801048033987171947956085205078125, "raw_values": [ 34.09400000000000119371179607696831226348876953125, 34.07159999999999655528881703503429889678955078125, 34.0519000000000033878677641041576862335205078125 ], "test_run_times": [ 46.17999999999999971578290569595992565155029296875, 44.8299999999999982946974341757595539093017578125, 44.77000000000000312638803734444081783294677734375 ] }, "b": { "value": 34.09049999999999869260136620141565799713134765625, "raw_values": [ 34.08539999999999992041921359486877918243408203125, 34.08899999999999863575794734060764312744140625, 34.0972000000000008412825991399586200714111328125 ], "test_run_times": [ 44.89999999999999857891452847979962825775146484375, 44.7999999999999971578290569595992565155029296875, 44.71000000000000085265128291212022304534912109375 ] }, "c": { "value": 34.0792000000000001591615728102624416351318359375, "raw_values": [ 34.0852000000000003865352482534945011138916015625, 34.0782999999999987039700499735772609710693359375, 34.0739999999999980673237587325274944305419921875 ], "test_run_times": [ 44.88000000000000255795384873636066913604736328125, 44.8900000000000005684341886080801486968994140625, 44.82000000000000028421709430404007434844970703125 ] } } }, "4b84253f6f74267fbb2b339c2ae5a4541816768d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 67.8693999999999988403942552395164966583251953125, "raw_values": [ 67.511899999999997135091689415276050567626953125, 68.389499999999998181010596454143524169921875, 67.7068000000000012050804798491299152374267578125 ], "test_run_times": [ 43.52000000000000312638803734444081783294677734375, 43.5, 43.340000000000003410605131648480892181396484375 ] }, "b": { "value": 68.1760000000000019326762412674725055694580078125, "raw_values": [ 68.20900000000000318323145620524883270263671875, 68.36660000000000536601874046027660369873046875, 67.9523999999999972487785271368920803070068359375 ], "test_run_times": [ 43.4200000000000017053025658242404460906982421875, 43.3299999999999982946974341757595539093017578125, 43.5799999999999982946974341757595539093017578125 ] }, "c": { "value": 67.5802000000000049340087571181356906890869140625, "raw_values": [ 67.4754999999999967030817060731351375579833984375, 67.466599999999999681676854379475116729736328125, 67.7984000000000008867573342286050319671630859375 ], "test_run_times": [ 43.469999999999998863131622783839702606201171875, 43.56000000000000227373675443232059478759765625, 43.57000000000000028421709430404007434844970703125 ] } } }, "a006a3a5fe1942cc73bba310b95c090a716a2126": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 14.7276000000000006906475391588173806667327880859375, "raw_values": [ 14.80499999999999971578290569595992565155029296875, 14.6150999999999999801048033987171947956085205078125, 14.7627000000000005996980689815245568752288818359375 ], "test_run_times": [ 43.52000000000000312638803734444081783294677734375, 43.5, 43.340000000000003410605131648480892181396484375 ] }, "b": { "value": 14.6611999999999991217691786005161702632904052734375, "raw_values": [ 14.65429999999999921556081972084939479827880859375, 14.62010000000000076170181273482739925384521484375, 14.709199999999999164401742746122181415557861328125 ], "test_run_times": [ 43.4200000000000017053025658242404460906982421875, 43.3299999999999982946974341757595539093017578125, 43.5799999999999982946974341757595539093017578125 ] }, "c": { "value": 14.7897999999999996134647517465054988861083984375, "raw_values": [ 14.81230000000000046611603465862572193145751953125, 14.8147999999999999687361196265555918216705322265625, 14.742399999999999948840923025272786617279052734375 ], "test_run_times": [ 43.469999999999998863131622783839702606201171875, 43.56000000000000227373675443232059478759765625, 43.57000000000000028421709430404007434844970703125 ] } } }, "94d990fdc1f5d799aaa05fc120ac31cf1220b272": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 72.046199999999998908606357872486114501953125, "raw_values": [ 71.856899999999995998223312199115753173828125, 72.38609999999999899955582804977893829345703125, 71.89560000000000172803993336856365203857421875 ], "test_run_times": [ 49.77000000000000312638803734444081783294677734375, 45.10000000000000142108547152020037174224853515625, 45.090000000000003410605131648480892181396484375 ] }, "b": { "value": 72.087500000000005684341886080801486968994140625, "raw_values": [ 72.02559999999999718056642450392246246337890625, 72.0773999999999972487785271368920803070068359375, 72.1594999999999942019712761975824832916259765625 ], "test_run_times": [ 44.969999999999998863131622783839702606201171875, 44.9500000000000028421709430404007434844970703125, 44.93999999999999772626324556767940521240234375 ] }, "c": { "value": 71.782700000000005502442945726215839385986328125, "raw_values": [ 71.6398999999999972487785271368920803070068359375, 71.8823000000000007503331289626657962799072265625, 71.825999999999993406163412146270275115966796875 ], "test_run_times": [ 45.39999999999999857891452847979962825775146484375, 45.10000000000000142108547152020037174224853515625, 45.280000000000001136868377216160297393798828125 ] } } }, "45f6d0177f8c6a689eb02824f962c055c66a9292": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 442.22100000000000363797880709171295166015625, "raw_values": [ 443.49970000000001846274244599044322967529296875, 440.98160000000001446096575818955898284912109375, 442.1816999999999779902282170951366424560546875 ], "test_run_times": [ 49.77000000000000312638803734444081783294677734375, 45.10000000000000142108547152020037174224853515625, 45.090000000000003410605131648480892181396484375 ] }, "b": { "value": 441.47759999999999536157702095806598663330078125, "raw_values": [ 442.65410000000002810338628478348255157470703125, 440.85989999999998190105543471872806549072265625, 440.9189000000000078216544352471828460693359375 ], "test_run_times": [ 44.969999999999998863131622783839702606201171875, 44.9500000000000028421709430404007434844970703125, 44.93999999999999772626324556767940521240234375 ] }, "c": { "value": 443.15820000000002210072125308215618133544921875, "raw_values": [ 443.6589000000000169166014529764652252197265625, 442.9841999999999870851752348244190216064453125, 442.83159999999998035491444170475006103515625 ], "test_run_times": [ 45.39999999999999857891452847979962825775146484375, 45.10000000000000142108547152020037174224853515625, 45.280000000000001136868377216160297393798828125 ] } } }, "a7579910c8f49ef834c189504eac153d4889bd74": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.6092000000000012960299500264227390289306640625, "raw_values": [ 34.53280000000000171667124959640204906463623046875, 34.6313999999999992951416061259806156158447265625, 34.6634999999999990905052982270717620849609375 ], "test_run_times": [ 43.78999999999999914734871708787977695465087890625, 43.7999999999999971578290569595992565155029296875, 43.6700000000000017053025658242404460906982421875 ] }, "b": { "value": 34.625, "raw_values": [ 34.59660000000000223963070311583578586578369140625, 34.67060000000000030695446184836328029632568359375, 34.607900000000000773070496506989002227783203125 ], "test_run_times": [ 43.57000000000000028421709430404007434844970703125, 43.52000000000000312638803734444081783294677734375, 43.60000000000000142108547152020037174224853515625 ] }, "c": { "value": 34.45259999999999678266249247826635837554931640625, "raw_values": [ 34.3980999999999994543031789362430572509765625, 34.45100000000000051159076974727213382720947265625, 34.50880000000000080717654782347381114959716796875 ], "test_run_times": [ 43.8900000000000005684341886080801486968994140625, 44, 44.10000000000000142108547152020037174224853515625 ] } } }, "f685725c528a5d2cf742e05056ea0eefacd5a426": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 28.888999999999999346300683100707828998565673828125, "raw_values": [ 28.952799999999999869260136620141565799713134765625, 28.870400000000000062527760746888816356658935546875, 28.843900000000001426769813406281173229217529296875 ], "test_run_times": [ 43.78999999999999914734871708787977695465087890625, 43.7999999999999971578290569595992565155029296875, 43.6700000000000017053025658242404460906982421875 ] }, "b": { "value": 28.87559999999999860165189602412283420562744140625, "raw_values": [ 28.899499999999999744204615126363933086395263671875, 28.837599999999998345856511150486767292022705078125, 28.889600000000001500666257925331592559814453125 ], "test_run_times": [ 43.57000000000000028421709430404007434844970703125, 43.52000000000000312638803734444081783294677734375, 43.60000000000000142108547152020037174224853515625 ] }, "c": { "value": 29.020499999999998408384271897375583648681640625, "raw_values": [ 29.06660000000000110276232589967548847198486328125, 29.021399999999999863575794734060764312744140625, 28.973400000000001597300069988705217838287353515625 ], "test_run_times": [ 43.8900000000000005684341886080801486968994140625, 44, 44.10000000000000142108547152020037174224853515625 ] } } } } }