7763 2204

AMD EPYC 7763 64-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2308059-NE-77632204529
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 3 Tests
Creator Workloads 3 Tests
Database Test Suite 3 Tests
HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests
Multi-Core 4 Tests
NVIDIA GPU Compute 2 Tests
Server 3 Tests
Server CPU Tests 2 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
a
August 04 2023
  6 Hours, 9 Minutes
b
August 04 2023
  4 Hours, 37 Minutes
c
August 05 2023
  4 Hours, 37 Minutes
Invert Hiding All Results Option
  5 Hours, 7 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "7763 2204", "last_modified": "2023-08-05 08:18:41", "description": "AMD EPYC 7763 64-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.", "systems": { "a": { "identifier": "a", "hardware": { "Processor": "AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores \/ 128 Threads)", "Motherboard": "AMD DAYTONA_X (RYM1009B BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "256GB", "Disk": "800GB INTEL SSDPF21Q800GB", "Graphics": "ASPEED", "Monitor": "VE228", "Network": "2 x Mellanox MT27710" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.2.0-phx (x86_64)", "Desktop": "GNOME Shell 42.5", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.3.224", "Compiler": "GCC 11.3.0 + LLVM 14.0.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2023-08-04 14:20:37", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq performance (Boost: Enabled)", "cpu-microcode": "0xa001173", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.20+8-post-Ubuntu-1ubuntu122.04)", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "b": { "identifier": "b", "hardware": { "Processor": "AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores \/ 128 Threads)", "Motherboard": "AMD DAYTONA_X (RYM1009B BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "256GB", "Disk": "800GB INTEL SSDPF21Q800GB", "Graphics": "ASPEED", "Monitor": "VE228", "Network": "2 x Mellanox MT27710" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.2.0-phx (x86_64)", "Desktop": "GNOME Shell 42.5", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.3.224", "Compiler": "GCC 11.3.0 + LLVM 14.0.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2023-08-04 19:01:39", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq performance (Boost: Enabled)", "cpu-microcode": "0xa001173", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.20+8-post-Ubuntu-1ubuntu122.04)", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "c": { "identifier": "c", "hardware": { "Processor": "AMD EPYC 7763 64-Core @ 2.45GHz (64 Cores \/ 128 Threads)", "Motherboard": "AMD DAYTONA_X (RYM1009B BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "256GB", "Disk": "800GB INTEL SSDPF21Q800GB", "Graphics": "ASPEED", "Monitor": "VE228", "Network": "2 x Mellanox MT27710" }, "software": { "OS": "Ubuntu 22.04", "Kernel": "6.2.0-phx (x86_64)", "Desktop": "GNOME Shell 42.5", "Display Server": "X Server 1.21.1.3", "Vulkan": "1.3.224", "Compiler": "GCC 11.3.0 + LLVM 14.0.0", "File-System": "ext4", "Screen Resolution": "1920x1080" }, "user": "phoronix", "timestamp": "2023-08-05 05:10:30", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-nvptx\/usr,amdgcn-amdhsa=\/build\/gcc-11-xKiWfi\/gcc-11-11.3.0\/debian\/tmp-gcn\/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v", "cpu-scaling-governor": "acpi-cpufreq performance (Boost: Enabled)", "cpu-microcode": "0xa001173", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.20+8-post-Ubuntu-1ubuntu122.04)", "python": "Python 3.10.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "341cb0ab74c0de8516f076bd28a21c39c7ee1ce9": { "identifier": "pts\/srsran-2.1.0", "title": "srsRAN Project", "app_version": "23.5", "arguments": "tests\/benchmarks\/phy\/upper\/downlink_processor_benchmark -R 50000 -P pdsch_scs15_50MHz_256qam_max", "description": "Test: Downlink Processor Benchmark", "scale": "Mbps", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 657.700000000000045474735088646411895751953125, "raw_values": [ 639.799999999999954525264911353588104248046875, 675.5 ], "test_run_times": [ 22.019999999999999573674358543939888477325439453125, 21.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } }, "b": { "value": 658.1000000000000227373675443232059478759765625, "raw_values": [ 630.299999999999954525264911353588104248046875, 685.799999999999954525264911353588104248046875 ], "test_run_times": [ 20.980000000000000426325641456060111522674560546875, 20.8599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } }, "c": { "value": 619.299999999999954525264911353588104248046875, "raw_values": [ 619.6000000000000227373675443232059478759765625, 618.8999999999999772626324556767940521240234375 ], "test_run_times": [ 21.46000000000000085265128291212022304534912109375, 21.35000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } } } }, "fc45f909c9861ed733608939b8d5df123574729f": { "identifier": "pts\/srsran-2.1.0", "title": "srsRAN Project", "app_version": "23.5", "arguments": "tests\/benchmarks\/phy\/upper\/channel_processors\/pusch_processor_benchmark -m throughput_total -R 100 -P pusch_scs15_50MHz_256qam_max", "description": "Test: PUSCH Processor Benchmark, Throughput Total", "scale": "Mbps", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 9682.100000000000363797880709171295166015625, "raw_values": [ 9668.79999999999927240423858165740966796875, 9695.399999999999636202119290828704833984375 ], "test_run_times": [ 40.89999999999999857891452847979962825775146484375, 40.719999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } }, "b": { "value": 9718.600000000000363797880709171295166015625, "raw_values": [ 9674.20000000000072759576141834259033203125, 9762.899999999999636202119290828704833984375 ], "test_run_times": [ 40.75, 40.74000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } }, "c": { "value": 9727.100000000000363797880709171295166015625, "raw_values": [ 9670.600000000000363797880709171295166015625, 9783.5 ], "test_run_times": [ 40.81000000000000227373675443232059478759765625, 40.72999999999999687361196265555918216705322265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } } } }, "e3f75a6d8144ae49eba677245b17607ef789759f": { "identifier": "pts\/srsran-2.1.0", "title": "srsRAN Project", "app_version": "23.5", "arguments": "tests\/benchmarks\/phy\/upper\/channel_processors\/pusch_processor_benchmark -m throughput_thread -R 100 -P pusch_scs15_50MHz_256qam_max -T 1", "description": "Test: PUSCH Processor Benchmark, Throughput Thread", "scale": "Mbps", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 211.099999999999994315658113919198513031005859375, "raw_values": [ 211.19999999999998863131622783839702606201171875, 211 ], "test_run_times": [ 14.519999999999999573674358543939888477325439453125, 14.550000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } }, "b": { "value": 208.19999999999998863131622783839702606201171875, "raw_values": [ 210.099999999999994315658113919198513031005859375, 206.30000000000001136868377216160297393798828125 ], "test_run_times": [ 14.6099999999999994315658113919198513031005859375, 14.8699999999999992184029906638897955417633056640625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } }, "c": { "value": 210.80000000000001136868377216160297393798828125, "raw_values": [ 211, 210.599999999999994315658113919198513031005859375 ], "test_run_times": [ 14.53999999999999914734871708787977695465087890625, 14.57000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mfma -O3 -fno-trapping-math -fno-math-errno -lgtest" } } } } }, "db6d07b5882a86cc58350833c3449ec9e40cd1d7": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_3840x2160.y4m --preset fast", "description": "Video Input: Bosphorus 4K - Video Preset: Fast", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5.9909999999999996589394868351519107818603515625, "raw_values": [ 5.99199999999999999289457264239899814128875732421875, 5.9900000000000002131628207280300557613372802734375 ], "test_run_times": [ 102.0100000000000051159076974727213382720947265625, 102.06999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "b": { "value": 5.9930000000000003268496584496460855007171630859375, "raw_values": [ 5.9870000000000000994759830064140260219573974609375, 5.99800000000000022026824808563105762004852294921875 ], "test_run_times": [ 102.1099999999999994315658113919198513031005859375, 101.93999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "c": { "value": 5.97599999999999997868371792719699442386627197265625, "raw_values": [ 5.9779999999999997584154698415659368038177490234375, 5.97299999999999986499688020558096468448638916015625 ], "test_run_times": [ 102.31000000000000227373675443232059478759765625, 102.3700000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "6791c5c8950ce69f170fbe0f96e43914575e2dd5": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_3840x2160.y4m --preset faster", "description": "Video Input: Bosphorus 4K - Video Preset: Faster", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 10.6460000000000007958078640513122081756591796875, "raw_values": [ 10.4670000000000005258016244624741375446319580078125, 10.8239999999999998436805981327779591083526611328125 ], "test_run_times": [ 59.219999999999998863131622783839702606201171875, 57.32000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "b": { "value": 10.8149999999999995026200849679298698902130126953125, "raw_values": [ 10.7919999999999998152588887023739516735076904296875, 10.8379999999999991899812812334857881069183349609375 ], "test_run_times": [ 57.50999999999999801048033987171947956085205078125, 57.31000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "c": { "value": 10.8179999999999996163069226895458996295928955078125, "raw_values": [ 10.8160000000000007247535904753021895885467529296875, 10.82000000000000028421709430404007434844970703125 ], "test_run_times": [ 57.38000000000000255795384873636066913604736328125, 57.36999999999999744204615126363933086395263671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "2e57bc78ea9a73df2b5a413bbcabefb81816d393": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m --preset fast", "description": "Video Input: Bosphorus 1080p - Video Preset: Fast", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 16.082999999999998408384271897375583648681640625, "raw_values": [ 16.05799999999999982946974341757595539093017578125, 16.106999999999999317878973670303821563720703125 ], "test_run_times": [ 39.11999999999999744204615126363933086395263671875, 39.00999999999999801048033987171947956085205078125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "b": { "value": 16.089999999999999857891452847979962825775146484375, "raw_values": [ 16.07300000000000039790393202565610408782958984375, 16.10600000000000164845914696343243122100830078125 ], "test_run_times": [ 39.10000000000000142108547152020037174224853515625, 39.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "c": { "value": 16.05499999999999971578290569595992565155029296875, "raw_values": [ 16.03699999999999903366187936626374721527099609375, 16.07300000000000039790393202565610408782958984375 ], "test_run_times": [ 39.17999999999999971578290569595992565155029296875, 39.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "6508705f5b2a28d5715fcd2e2d76a235aebb13aa": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m --preset faster", "description": "Video Input: Bosphorus 1080p - Video Preset: Faster", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 29.352000000000000312638803734444081783294677734375, "raw_values": [ 29.280000000000001136868377216160297393798828125, 29.422999999999998266275724745355546474456787109375 ], "test_run_times": [ 22.260000000000001563194018672220408916473388671875, 22.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "b": { "value": 29.3900000000000005684341886080801486968994140625, "raw_values": [ 29.280000000000001136868377216160297393798828125, 29.5 ], "test_run_times": [ 22.260000000000001563194018672220408916473388671875, 22.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "c": { "value": 29.46900000000000119371179607696831226348876953125, "raw_values": [ 29.3990000000000009094947017729282379150390625, 29.5390000000000014779288903810083866119384765625 ], "test_run_times": [ 22.190000000000001278976924368180334568023681640625, 22.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "47f31af1855bb8948e4a92ec26fb39e77910e874": { "identifier": "pts\/build-gcc-1.4.0", "title": "Timed GCC Compilation", "app_version": "13.2", "description": "Time To Compile", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1020.133000000000038198777474462985992431640625, "raw_values": [ 1018.3220000000000027284841053187847137451171875, 1021.94399999999995998223312199115753173828125 ], "test_run_times": [ 1018.3200000000000500222085975110530853271484375, 1021.94000000000005456968210637569427490234375 ] }, "b": { "value": 1020.84600000000000363797880709171295166015625, "raw_values": [ 1020.8129999999999881765688769519329071044921875, 1020.8790000000000190993887372314929962158203125 ], "test_run_times": [ 1020.80999999999994543031789362430572509765625, 1020.8799999999999954525264911353588104248046875 ] }, "c": { "value": 1020.2160000000000081854523159563541412353515625, "raw_values": [ 1019.557000000000016370904631912708282470703125, 1020.875 ], "test_run_times": [ 1019.55999999999994543031789362430572509765625, 1020.8700000000000045474735088646411895751953125 ] } } }, "ae5cc84baa6e9bf11ca5ec1ae4a1669960fbfc1f": { "identifier": "pts\/couchdb-1.3.0", "title": "Apache CouchDB", "app_version": "3.3.2", "arguments": "100 1000 30", "description": "Bulk Size: 100 - Inserts: 1000 - Rounds: 30", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 101.578000000000002955857780762016773223876953125, "raw_values": [ 102.0799999999999982946974341757595539093017578125, 101.0750000000000028421709430404007434844970703125 ], "test_run_times": [ 102.0799999999999982946974341757595539093017578125, 101.06999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD" } } } } }, "06b5687c17f56bab1173d3c382159681066fd3f1": { "identifier": "pts\/couchdb-1.3.0", "title": "Apache CouchDB", "app_version": "3.3.2", "arguments": "100 3000 30", "description": "Bulk Size: 100 - Inserts: 3000 - Rounds: 30", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 346.08499999999997953636921010911464691162109375, "raw_values": [ 346.3319999999999936335370875895023345947265625, 345.83800000000002228262019343674182891845703125 ], "test_run_times": [ 346.32999999999998408384271897375583648681640625, 345.83999999999997498889570124447345733642578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD" } } } } }, "b5e4c69e3e85a378bd2c54f95aa455a1bf2975b9": { "identifier": "pts\/couchdb-1.3.0", "title": "Apache CouchDB", "app_version": "3.3.2", "arguments": "300 1000 30", "description": "Bulk Size: 300 - Inserts: 1000 - Rounds: 30", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 169.5049999999999954525264911353588104248046875, "raw_values": [ 170.145999999999986584953148849308490753173828125, 168.86299999999999954525264911353588104248046875 ], "test_run_times": [ 170.150000000000005684341886080801486968994140625, 168.8600000000000136424205265939235687255859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD" } } } } }, "f6818433a38703f94d8080944323287a840784d7": { "identifier": "pts\/couchdb-1.3.0", "title": "Apache CouchDB", "app_version": "3.3.2", "arguments": "300 3000 30", "description": "Bulk Size: 300 - Inserts: 3000 - Rounds: 30", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 572.125, "raw_values": [ 572.6470000000000482032191939651966094970703125, 571.6019999999999754436430521309375762939453125 ], "test_run_times": [ 572.6499999999999772626324556767940521240234375, 571.6000000000000227373675443232059478759765625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD" } } } } }, "f512da9675bc32dc57d0e19f9f8ef5eb071289e0": { "identifier": "pts\/couchdb-1.3.0", "title": "Apache CouchDB", "app_version": "3.3.2", "arguments": "500 1000 30", "description": "Bulk Size: 500 - Inserts: 1000 - Rounds: 30", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 339.9669999999999845385900698602199554443359375, "raw_values": [ 348.750999999999976353137753903865814208984375, 331.182000000000016370904631912708282470703125 ], "test_run_times": [ 348.75, 331.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD" } } } } }, "f6b1482f56243ef019cd0e92fcde812bf4e2679f": { "identifier": "pts\/couchdb-1.3.0", "title": "Apache CouchDB", "app_version": "3.3.2", "arguments": "500 3000 30", "description": "Bulk Size: 500 - Inserts: 3000 - Rounds: 30", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 2390.9329999999999927240423858165740966796875, "test_run_times": [ 2390.92999999999983629095368087291717529296875, 0.01000000000000000020816681711721685132943093776702880859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++17 -lmozjs-78 -lm -lei -fPIC -MMD" } } } } }, "49f2dc81d7c46feac7f9f009a312d53a7a8bcea1": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 1 200", "description": "Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 644019.71999999997206032276153564453125, "test_run_times": [ 16.64999999999999857891452847979962825775146484375, 15.8900000000000005684341886080801486968994140625 ] }, "b": { "value": 648308.2700000000186264514923095703125, "test_run_times": [ 16.71000000000000085265128291212022304534912109375, 16.089999999999999857891452847979962825775146484375 ] }, "c": { "value": 667880.959999999962747097015380859375, "test_run_times": [ 16.370000000000000994759830064140260219573974609375, 15.96000000000000085265128291212022304534912109375 ] } } }, "628d6e4590da0ec0e25a7ea9f0b8c361809981d5": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 1 200", "description": "Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 200", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 17.449999999999999289457264239899814128875732421875, "max_result": [ "645.35" ], "test_run_times": [ 16.64999999999999857891452847979962825775146484375, 15.8900000000000005684341886080801486968994140625 ] }, "b": { "value": 17.280000000000001136868377216160297393798828125, "max_result": [ "644.33" ], "test_run_times": [ 16.71000000000000085265128291212022304534912109375, 16.089999999999999857891452847979962825775146484375 ] }, "c": { "value": 16.35000000000000142108547152020037174224853515625, "max_result": [ "668.86" ], "test_run_times": [ 16.370000000000000994759830064140260219573974609375, 15.96000000000000085265128291212022304534912109375 ] } } }, "196ed1e5ccfb157b422c9c5ac8120526742254c5": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 1 500", "description": "Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1038515.619999999995343387126922607421875, "test_run_times": [ 19.32000000000000028421709430404007434844970703125, 18.78999999999999914734871708787977695465087890625 ] }, "b": { "value": 1069145.790000000037252902984619140625, "test_run_times": [ 19.28999999999999914734871708787977695465087890625, 17.800000000000000710542735760100185871124267578125 ] }, "c": { "value": 1044153.4399999999441206455230712890625, "test_run_times": [ 19.370000000000000994759830064140260219573974609375, 17.690000000000001278976924368180334568023681640625 ] } } }, "7da5f6471e9cdd243f976d37d7715fa7203ef901": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 1 500", "description": "Device Count: 100 - Batch Size Per Write: 1 - Sensor Count: 500", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.3599999999999994315658113919198513031005859375, "max_result": [ "704.53" ], "test_run_times": [ 19.32000000000000028421709430404007434844970703125, 18.78999999999999914734871708787977695465087890625 ] }, "b": { "value": 32.9200000000000017053025658242404460906982421875, "max_result": [ "728.63" ], "test_run_times": [ 19.28999999999999914734871708787977695465087890625, 17.800000000000000710542735760100185871124267578125 ] }, "c": { "value": 34.0799999999999982946974341757595539093017578125, "max_result": [ "699.28" ], "test_run_times": [ 19.370000000000000994759830064140260219573974609375, 17.690000000000001278976924368180334568023681640625 ] } } }, "8af6818a4d942914600067149415d3ab57da9f6d": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 1 200", "description": "Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 898967.079999999958090484142303466796875, "test_run_times": [ 18.78999999999999914734871708787977695465087890625, 17.949999999999999289457264239899814128875732421875 ] }, "b": { "value": 978176.76000000000931322574615478515625, "test_run_times": [ 18.3299999999999982946974341757595539093017578125, 17.71000000000000085265128291212022304534912109375 ] }, "c": { "value": 870795.920000000041909515857696533203125, "test_run_times": [ 18.92999999999999971578290569595992565155029296875, 17.910000000000000142108547152020037174224853515625 ] } } }, "dee7e97583fc3f176e12c6ab2d2d2c2f50825265": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 1 200", "description": "Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 200", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 15.2400000000000002131628207280300557613372802734375, "max_result": [ "583.94" ], "test_run_times": [ 18.78999999999999914734871708787977695465087890625, 17.949999999999999289457264239899814128875732421875 ] }, "b": { "value": 13.5999999999999996447286321199499070644378662109375, "max_result": [ "586.94" ], "test_run_times": [ 18.3299999999999982946974341757595539093017578125, 17.71000000000000085265128291212022304534912109375 ] }, "c": { "value": 16.07000000000000028421709430404007434844970703125, "max_result": [ "592.48" ], "test_run_times": [ 18.92999999999999971578290569595992565155029296875, 17.910000000000000142108547152020037174224853515625 ] } } }, "86eb05c656c8e9c32c9adfca51c0877de4df7f27": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 1 500", "description": "Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1232509.1899999999441206455230712890625, "test_run_times": [ 24.660000000000000142108547152020037174224853515625, 23.78999999999999914734871708787977695465087890625 ] }, "b": { "value": 1226219.879999999888241291046142578125, "test_run_times": [ 24.9200000000000017053025658242404460906982421875, 23.3299999999999982946974341757595539093017578125 ] }, "c": { "value": 1261385.88999999989755451679229736328125, "test_run_times": [ 24.1700000000000017053025658242404460906982421875, 22.719999999999998863131622783839702606201171875 ] } } }, "493b77d9364ef19500c9a519c755724f04bdf265": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 1 500", "description": "Device Count: 200 - Batch Size Per Write: 1 - Sensor Count: 500", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 33.5, "max_result": [ "690.29" ], "test_run_times": [ 24.660000000000000142108547152020037174224853515625, 23.78999999999999914734871708787977695465087890625 ] }, "b": { "value": 33.8599999999999994315658113919198513031005859375, "max_result": [ "659.59" ], "test_run_times": [ 24.9200000000000017053025658242404460906982421875, 23.3299999999999982946974341757595539093017578125 ] }, "c": { "value": 32.71000000000000085265128291212022304534912109375, "max_result": [ "725.08" ], "test_run_times": [ 24.1700000000000017053025658242404460906982421875, 22.719999999999998863131622783839702606201171875 ] } } }, "8ef5a722096ad6d56fbfa532655544c05923bdd5": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 1 200", "description": "Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1182440.620000000111758708953857421875, "test_run_times": [ 24.839999999999999857891452847979962825775146484375, 24.07000000000000028421709430404007434844970703125 ] }, "b": { "value": 1365831.5, "test_run_times": [ 23.17999999999999971578290569595992565155029296875, 22.1099999999999994315658113919198513031005859375 ] }, "c": { "value": 1367763.48999999999068677425384521484375, "test_run_times": [ 23.449999999999999289457264239899814128875732421875, 21.879999999999999005240169935859739780426025390625 ] } } }, "44e587301517109ac0f9d2319137872dc62bd1b1": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 1 200", "description": "Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 200", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 13.53999999999999914734871708787977695465087890625, "max_result": [ "856.65" ], "test_run_times": [ 24.839999999999999857891452847979962825775146484375, 24.07000000000000028421709430404007434844970703125 ] }, "b": { "value": 11.6300000000000007815970093361102044582366943359375, "max_result": [ "860.78" ], "test_run_times": [ 23.17999999999999971578290569595992565155029296875, 22.1099999999999994315658113919198513031005859375 ] }, "c": { "value": 11.8300000000000000710542735760100185871124267578125, "max_result": [ "836.9" ], "test_run_times": [ 23.449999999999999289457264239899814128875732421875, 21.879999999999999005240169935859739780426025390625 ] } } }, "0951b8914ed9c0426df89a5624fbd53643c73af1": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 1 500", "description": "Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1636128.7299999999813735485076904296875, "test_run_times": [ 35.06000000000000227373675443232059478759765625, 34.469999999999998863131622783839702606201171875 ] }, "b": { "value": 1686943.15999999991618096828460693359375, "test_run_times": [ 35.2000000000000028421709430404007434844970703125, 33.77000000000000312638803734444081783294677734375 ] }, "c": { "value": 1446487.69999999995343387126922607421875, "test_run_times": [ 38.96000000000000085265128291212022304534912109375, 37.75 ] } } }, "4509ab732be5106fd1e101267107bfcbf0cfb23d": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 1 500", "description": "Device Count: 500 - Batch Size Per Write: 1 - Sensor Count: 500", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 27.10000000000000142108547152020037174224853515625, "max_result": [ "934.45" ], "test_run_times": [ 35.06000000000000227373675443232059478759765625, 34.469999999999998863131622783839702606201171875 ] }, "b": { "value": 26, "max_result": [ "873.88" ], "test_run_times": [ 35.2000000000000028421709430404007434844970703125, 33.77000000000000312638803734444081783294677734375 ] }, "c": { "value": 31.39999999999999857891452847979962825775146484375, "max_result": [ "890.05" ], "test_run_times": [ 38.96000000000000085265128291212022304534912109375, 37.75 ] } } }, "2b7a54572da5bf48ab039a06150681b61173414f": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 100 200", "description": "Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 39287432.92000000178813934326171875, "test_run_times": [ 20.230000000000000426325641456060111522674560546875, 18.1099999999999994315658113919198513031005859375 ] }, "b": { "value": 38401769.17000000178813934326171875, "test_run_times": [ 20.280000000000001136868377216160297393798828125, 19.32000000000000028421709430404007434844970703125 ] }, "c": { "value": 39945212.990000002086162567138671875, "test_run_times": [ 19.780000000000001136868377216160297393798828125, 18.469999999999998863131622783839702606201171875 ] } } }, "83fe96573a97f12c0f7b840ae801f73348fb560c": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 100 200", "description": "Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 200", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 36.03999999999999914734871708787977695465087890625, "max_result": [ "804.01" ], "test_run_times": [ 20.230000000000000426325641456060111522674560546875, 18.1099999999999994315658113919198513031005859375 ] }, "b": { "value": 36.85000000000000142108547152020037174224853515625, "max_result": [ "721.27" ], "test_run_times": [ 20.280000000000001136868377216160297393798828125, 19.32000000000000028421709430404007434844970703125 ] }, "c": { "value": 35.00999999999999801048033987171947956085205078125, "max_result": [ "746.4" ], "test_run_times": [ 19.780000000000001136868377216160297393798828125, 18.469999999999998863131622783839702606201171875 ] } } }, "9778a55f19806827b28b3e19b357601fb7e96425": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 100 500", "description": "Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 51316464.439999997615814208984375, "test_run_times": [ 27.620000000000000994759830064140260219573974609375, 26.010000000000001563194018672220408916473388671875 ] }, "b": { "value": 50507747.119999997317790985107421875, "test_run_times": [ 27.39999999999999857891452847979962825775146484375, 26.4200000000000017053025658242404460906982421875 ] }, "c": { "value": 52464142.82999999821186065673828125, "test_run_times": [ 28.1400000000000005684341886080801486968994140625, 25.410000000000000142108547152020037174224853515625 ] } } }, "4351ad64985fa3b9676238e1ef2c023ce56e0530": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "100 100 500", "description": "Device Count: 100 - Batch Size Per Write: 100 - Sensor Count: 500", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 81.2000000000000028421709430404007434844970703125, "max_result": [ "1009.28" ], "test_run_times": [ 27.620000000000000994759830064140260219573974609375, 26.010000000000001563194018672220408916473388671875 ] }, "b": { "value": 82.2600000000000051159076974727213382720947265625, "max_result": [ "864.29" ], "test_run_times": [ 27.39999999999999857891452847979962825775146484375, 26.4200000000000017053025658242404460906982421875 ] }, "c": { "value": 79.159999999999996589394868351519107818603515625, "max_result": [ "1006.03" ], "test_run_times": [ 28.1400000000000005684341886080801486968994140625, 25.410000000000000142108547152020037174224853515625 ] } } }, "651998b39dbeee00ec6157dbbf6daf65346bbf5d": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 100 200", "description": "Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 46437377.67000000178813934326171875, "test_run_times": [ 25.699999999999999289457264239899814128875732421875, 24.25 ] }, "b": { "value": 47245476.7800000011920928955078125, "test_run_times": [ 25.3900000000000005684341886080801486968994140625, 24.339999999999999857891452847979962825775146484375 ] }, "c": { "value": 46674344.689999997615814208984375, "test_run_times": [ 25.5, 24.42999999999999971578290569595992565155029296875 ] } } }, "d9e3eeda1f5aba0164aa5ebb463a0960c3c8d9c6": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 100 200", "description": "Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 200", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 35.090000000000003410605131648480892181396484375, "max_result": [ "804.64" ], "test_run_times": [ 25.699999999999999289457264239899814128875732421875, 24.25 ] }, "b": { "value": 33.840000000000003410605131648480892181396484375, "max_result": [ "773.52" ], "test_run_times": [ 25.3900000000000005684341886080801486968994140625, 24.339999999999999857891452847979962825775146484375 ] }, "c": { "value": 34.78999999999999914734871708787977695465087890625, "max_result": [ "780.01" ], "test_run_times": [ 25.5, 24.42999999999999971578290569595992565155029296875 ] } } }, "eb54d84c2b539abcc76667e78a2e161fde19e111": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 100 500", "description": "Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 42048733.2199999988079071044921875, "test_run_times": [ 47.02000000000000312638803734444081783294677734375, 46.8900000000000005684341886080801486968994140625 ] }, "b": { "value": 41987111.39000000059604644775390625, "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 47.14999999999999857891452847979962825775146484375 ] }, "c": { "value": 43363203.759999997913837432861328125, "test_run_times": [ 46.07000000000000028421709430404007434844970703125, 45.82000000000000028421709430404007434844970703125 ] } } }, "a68593a47f33335060b853860506d9dff4166732": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "200 100 500", "description": "Device Count: 200 - Batch Size Per Write: 100 - Sensor Count: 500", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 109.3799999999999954525264911353588104248046875, "max_result": [ "3597.09" ], "test_run_times": [ 47.02000000000000312638803734444081783294677734375, 46.8900000000000005684341886080801486968994140625 ] }, "b": { "value": 110.8799999999999954525264911353588104248046875, "max_result": [ "3569.78" ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 47.14999999999999857891452847979962825775146484375 ] }, "c": { "value": 106.7300000000000039790393202565610408782958984375, "max_result": [ "3485.91" ], "test_run_times": [ 46.07000000000000028421709430404007434844970703125, 45.82000000000000028421709430404007434844970703125 ] } } }, "d38e33a020b4586d3694ea0f07969d4b7f2f5fa9": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 100 200", "description": "Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 51341708.850000001490116119384765625, "test_run_times": [ 39.1099999999999994315658113919198513031005859375, 40.38000000000000255795384873636066913604736328125 ] }, "b": { "value": 50045888.979999996721744537353515625, "test_run_times": [ 41.77000000000000312638803734444081783294677734375, 41.61999999999999744204615126363933086395263671875 ] }, "c": { "value": 49201448.810000002384185791015625, "test_run_times": [ 40.469999999999998863131622783839702606201171875, 41.3900000000000005684341886080801486968994140625 ] } } }, "95b11dc2f8282f728463d9ca3ff3c40bf84ad621": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 100 200", "description": "Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 200", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 35.0499999999999971578290569595992565155029296875, "max_result": [ "2157.23" ], "test_run_times": [ 39.1099999999999994315658113919198513031005859375, 40.38000000000000255795384873636066913604736328125 ] }, "b": { "value": 36.10000000000000142108547152020037174224853515625, "max_result": [ "1990.15" ], "test_run_times": [ 41.77000000000000312638803734444081783294677734375, 41.61999999999999744204615126363933086395263671875 ] }, "c": { "value": 37.11999999999999744204615126363933086395263671875, "max_result": [ "2182.81" ], "test_run_times": [ 40.469999999999998863131622783839702606201171875, 41.3900000000000005684341886080801486968994140625 ] } } }, "000c5cb5c8afd31ab91616d9e8a9d9b513695a18": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 100 500", "description": "Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500", "scale": "point\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 56935634.54999999701976776123046875, "test_run_times": [ 74.93000000000000682121026329696178436279296875, 77.2600000000000051159076974727213382720947265625 ] }, "b": { "value": 59505306.54999999701976776123046875, "test_run_times": [ 75.1200000000000045474735088646411895751953125, 74.1400000000000005684341886080801486968994140625 ] }, "c": { "value": 56463717.539999999105930328369140625, "test_run_times": [ 75.93999999999999772626324556767940521240234375, 77.840000000000003410605131648480892181396484375 ] } } }, "c196d2c47b0001ea144f46195ded79c82b752bd0": { "identifier": "pts\/apache-iotdb-1.0.0", "title": "Apache IoTDB", "app_version": "1.1.2", "arguments": "500 100 500", "description": "Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 500", "scale": "Average Latency", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 81.81000000000000227373675443232059478759765625, "max_result": [ "3018.16" ], "test_run_times": [ 74.93000000000000682121026329696178436279296875, 77.2600000000000051159076974727213382720947265625 ] }, "b": { "value": 79.8299999999999982946974341757595539093017578125, "max_result": [ "1607.86" ], "test_run_times": [ 75.1200000000000045474735088646411895751953125, 74.1400000000000005684341886080801486968994140625 ] }, "c": { "value": 83.1400000000000005684341886080801486968994140625, "max_result": [ "2932.1" ], "test_run_times": [ 75.93999999999999772626324556767940521240234375, 77.840000000000003410605131648480892181396484375 ] } } }, "8315d249c45b31a380a71ef2c000db2e666a90bd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 37.6144000000000033878677641041576862335205078125, "raw_values": [ 37.70700000000000073896444519050419330596923828125, 37.5217999999999989313437254168093204498291015625 ], "test_run_times": [ 53.2999999999999971578290569595992565155029296875, 53.39999999999999857891452847979962825775146484375 ] }, "b": { "value": 37.53150000000000119371179607696831226348876953125, "raw_values": [ 37.5208999999999974761522025801241397857666015625, 37.542000000000001591615728102624416351318359375 ], "test_run_times": [ 53.49000000000000198951966012828052043914794921875, 53.4500000000000028421709430404007434844970703125 ] }, "c": { "value": 37.581400000000002137312549166381359100341796875, "raw_values": [ 37.56000000000000227373675443232059478759765625, 37.602699999999998681232682429254055023193359375 ], "test_run_times": [ 53.7999999999999971578290569595992565155029296875, 53.31000000000000227373675443232059478759765625 ] } } }, "132dca3d993c38d5a37de8fc72f4591ac7eb1ddd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 840.54160000000001673470251262187957763671875, "raw_values": [ 841.5597999999999956344254314899444580078125, 839.523400000000037834979593753814697265625 ], "test_run_times": [ 53.2999999999999971578290569595992565155029296875, 53.39999999999999857891452847979962825775146484375 ] }, "b": { "value": 840.949299999999993815436027944087982177734375, "raw_values": [ 840.794200000000046202330850064754486083984375, 841.1042999999999665305949747562408447265625 ], "test_run_times": [ 53.49000000000000198951966012828052043914794921875, 53.4500000000000028421709430404007434844970703125 ] }, "c": { "value": 840.12339999999994688550941646099090576171875, "raw_values": [ 840.7105000000000245563569478690624237060546875, 839.53620000000000800355337560176849365234375 ], "test_run_times": [ 53.7999999999999971578290569595992565155029296875, 53.31000000000000227373675443232059478759765625 ] } } }, "3b1bfb7814177424418483748f806f392d017eb6": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 19.946899999999999408828443847596645355224609375, "raw_values": [ 19.953700000000001324451659456826746463775634765625, 19.940100000000001045918907038867473602294921875 ], "test_run_times": [ 48.52000000000000312638803734444081783294677734375, 48.42999999999999971578290569595992565155029296875 ] }, "b": { "value": 20.027899999999998925659383530728518962860107421875, "raw_values": [ 20.07260000000000133013600134290754795074462890625, 19.983200000000000073896444519050419330596923828125 ], "test_run_times": [ 48.469999999999998863131622783839702606201171875, 48.25999999999999801048033987171947956085205078125 ] }, "c": { "value": 20.024499999999999744204615126363933086395263671875, "raw_values": [ 20.04260000000000019326762412674725055694580078125, 20.006299999999999528199623455293476581573486328125 ], "test_run_times": [ 48.38000000000000255795384873636066913604736328125, 48.46000000000000085265128291212022304534912109375 ] } } }, "b07153da5d2186a2c4af44a41f728a2bb4ce2122": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 50.125799999999998135535861365497112274169921875, "raw_values": [ 50.1084000000000031604940886609256267547607421875, 50.14309999999999689634933019988238811492919921875 ], "test_run_times": [ 48.52000000000000312638803734444081783294677734375, 48.42999999999999971578290569595992565155029296875 ] }, "b": { "value": 49.9226000000000027512214728631079196929931640625, "raw_values": [ 49.81089999999999662350091966800391674041748046875, 50.03419999999999845385900698602199554443359375 ], "test_run_times": [ 48.469999999999998863131622783839702606201171875, 48.25999999999999801048033987171947956085205078125 ] }, "c": { "value": 49.93119999999999691908669774420559406280517578125, "raw_values": [ 49.88589999999999946567186270840466022491455078125, 49.9765000000000014779288903810083866119384765625 ], "test_run_times": [ 48.38000000000000255795384873636066913604736328125, 48.46000000000000085265128291212022304534912109375 ] } } }, "484ed76c1448ae8277be5d38b413682792d37712": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1105.379100000000107684172689914703369140625, "raw_values": [ 1104.305000000000063664629124104976654052734375, 1106.453099999999949432094581425189971923828125 ], "test_run_times": [ 53.42999999999999971578290569595992565155029296875, 53.63000000000000255795384873636066913604736328125 ] }, "b": { "value": 1104.037700000000086220097728073596954345703125, "raw_values": [ 1105.183999999999969077180139720439910888671875, 1102.891300000000001091393642127513885498046875 ], "test_run_times": [ 53.57000000000000028421709430404007434844970703125, 53.5499999999999971578290569595992565155029296875 ] }, "c": { "value": 1103.355199999999967985786497592926025390625, "raw_values": [ 1103.5603000000000974978320300579071044921875, 1103.15000000000009094947017729282379150390625 ], "test_run_times": [ 53.24000000000000198951966012828052043914794921875, 53.38000000000000255795384873636066913604736328125 ] } } }, "00a3faa7c0f772066b32e38912d7efd0da6c6479": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 28.91499999999999914734871708787977695465087890625, "raw_values": [ 28.9491000000000013869794202037155628204345703125, 28.880900000000000460431692772544920444488525390625 ], "test_run_times": [ 53.42999999999999971578290569595992565155029296875, 53.63000000000000255795384873636066913604736328125 ] }, "b": { "value": 28.945100000000000051159076974727213382720947265625, "raw_values": [ 28.913599999999998857447280897758901119232177734375, 28.976600000000001244870873051695525646209716796875 ], "test_run_times": [ 53.57000000000000028421709430404007434844970703125, 53.5499999999999971578290569595992565155029296875 ] }, "c": { "value": 28.964400000000001256239556823857128620147705078125, "raw_values": [ 28.94950000000000045474735088646411895751953125, 28.979299999999998505018083960749208927154541015625 ], "test_run_times": [ 53.24000000000000198951966012828052043914794921875, 53.38000000000000255795384873636066913604736328125 ] } } }, "78c1dafa9f71ada1047e6627d9a575398a531a1e": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 173.946200000000004592948243953287601470947265625, "raw_values": [ 172.96490000000000009094947017729282379150390625, 174.927400000000005775291356258094310760498046875 ], "test_run_times": [ 61.57000000000000028421709430404007434844970703125, 61.85000000000000142108547152020037174224853515625 ] }, "b": { "value": 172.7504999999999881765688769519329071044921875, "raw_values": [ 173.3836000000000012732925824820995330810546875, 172.1173000000000001818989403545856475830078125 ], "test_run_times": [ 62, 61.97999999999999687361196265555918216705322265625 ] }, "c": { "value": 172.06589999999999918145476840436458587646484375, "raw_values": [ 172.868999999999999772626324556767940521240234375, 171.262699999999995270627550780773162841796875 ], "test_run_times": [ 61.8599999999999994315658113919198513031005859375, 61.6400000000000005684341886080801486968994140625 ] } } }, "48e2ef91a77c84aaa7b1998dd9c0256d35e1be74": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5.7469999999999998863131622783839702606201171875, "raw_values": [ 5.778999999999999914734871708787977695465087890625, 5.7140000000000004121147867408581078052520751953125 ], "test_run_times": [ 61.57000000000000028421709430404007434844970703125, 61.85000000000000142108547152020037174224853515625 ] }, "b": { "value": 5.78629999999999977688958097132854163646697998046875, "raw_values": [ 5.765100000000000335376171278767287731170654296875, 5.80750000000000010658141036401502788066864013671875 ], "test_run_times": [ 62, 61.97999999999999687361196265555918216705322265625 ] }, "c": { "value": 5.80919999999999969730879456619732081890106201171875, "raw_values": [ 5.7820999999999997953636921010911464691162109375, 5.8362999999999995992538970313034951686859130859375 ], "test_run_times": [ 61.8599999999999994315658113919198513031005859375, 61.6400000000000005684341886080801486968994140625 ] } } }, "52650ab3f436f830a03f98d18570a098bc6a7a3b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario async", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 489.77089999999998326529748737812042236328125, "raw_values": [ 489.09300000000001773514668457210063934326171875, 490.4488000000000056388671509921550750732421875 ], "test_run_times": [ 56.1099999999999994315658113919198513031005859375, 54.7999999999999971578290569595992565155029296875 ] }, "b": { "value": 486.17279999999999517967808060348033905029296875, "raw_values": [ 485.14429999999998699422576464712619781494140625, 487.20130000000000336513039655983448028564453125 ], "test_run_times": [ 54.8900000000000005684341886080801486968994140625, 55.27000000000000312638803734444081783294677734375 ] }, "c": { "value": 482.12740000000002282831701450049877166748046875, "raw_values": [ 474.92009999999999081410351209342479705810546875, 489.3346999999999979991116560995578765869140625 ], "test_run_times": [ 54.82000000000000028421709430404007434844970703125, 55.72999999999999687361196265555918216705322265625 ] } } }, "e98d7f3e55dd7556d5a7e285d585b1f332155a2c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario async", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 65.275000000000005684341886080801486968994140625, "raw_values": [ 65.3755000000000023874235921539366245269775390625, 65.174499999999994770405464805662631988525390625 ], "test_run_times": [ 56.1099999999999994315658113919198513031005859375, 54.7999999999999971578290569595992565155029296875 ] }, "b": { "value": 65.7359000000000008867573342286050319671630859375, "raw_values": [ 65.8365000000000009094947017729282379150390625, 65.635300000000000864019966684281826019287109375 ], "test_run_times": [ 54.8900000000000005684341886080801486968994140625, 55.27000000000000312638803734444081783294677734375 ] }, "c": { "value": 66.2836999999999960664354148320853710174560546875, "raw_values": [ 67.269900000000006912159733474254608154296875, 65.2973999999999961119101499207317829132080078125 ], "test_run_times": [ 54.82000000000000028421709430404007434844970703125, 55.72999999999999687361196265555918216705322265625 ] } } }, "c98a283d125f2494d1f50e0bad82c4f927c75b95": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 86.610399999999998499333742074668407440185546875, "raw_values": [ 87.2017000000000024328983272425830364227294921875, 86.019000000000005456968210637569427490234375 ], "test_run_times": [ 46.88000000000000255795384873636066913604736328125, 47.89999999999999857891452847979962825775146484375 ] }, "b": { "value": 86.390500000000002955857780762016773223876953125, "raw_values": [ 86.47100000000000363797880709171295166015625, 86.309899999999998954081092961132526397705078125 ], "test_run_times": [ 46.82000000000000028421709430404007434844970703125, 46.97999999999999687361196265555918216705322265625 ] }, "c": { "value": 86.321899999999999408828443847596645355224609375, "raw_values": [ 85.90330000000000154614099301397800445556640625, 86.7404999999999972715158946812152862548828125 ], "test_run_times": [ 46.81000000000000227373675443232059478759765625, 46.85000000000000142108547152020037174224853515625 ] } } }, "b397fa132b01b7bad3b20659f8b7c14d37ec6de8": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 11.537800000000000721911419532261788845062255859375, "raw_values": [ 11.458999999999999630517777404747903347015380859375, 11.6166000000000000369482222595252096652984619140625 ], "test_run_times": [ 46.88000000000000255795384873636066913604736328125, 47.89999999999999857891452847979962825775146484375 ] }, "b": { "value": 11.5665999999999993264054864994250237941741943359375, "raw_values": [ 11.5556999999999998607336237910203635692596435546875, 11.577400000000000801492205937393009662628173828125 ], "test_run_times": [ 46.82000000000000028421709430404007434844970703125, 46.97999999999999687361196265555918216705322265625 ] }, "c": { "value": 11.57639999999999957935870043002068996429443359375, "raw_values": [ 11.63250000000000028421709430404007434844970703125, 11.5203000000000006508571459562517702579498291015625 ], "test_run_times": [ 46.81000000000000227373675443232059478759765625, 46.85000000000000142108547152020037174224853515625 ] } } }, "a6f79cb479021f303e5383b047b4c484b249cfe2": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario async", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 143.072499999999990905052982270717620849609375, "raw_values": [ 143.062800000000009958966984413564205169677734375, 143.082099999999996953192749060690402984619140625 ], "test_run_times": [ 58.0799999999999982946974341757595539093017578125, 58.27000000000000312638803734444081783294677734375 ] }, "b": { "value": 143.20580000000001064108801074326038360595703125, "raw_values": [ 143.025000000000005684341886080801486968994140625, 143.38650000000001227817847393453121185302734375 ], "test_run_times": [ 58.25999999999999801048033987171947956085205078125, 58.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 143.571400000000011232259566895663738250732421875, "raw_values": [ 143.54140000000001009539118967950344085693359375, 143.60140000000001236912794411182403564453125 ], "test_run_times": [ 58.42999999999999971578290569595992565155029296875, 57.969999999999998863131622783839702606201171875 ] } } }, "de579f577d229f0340544ebabc145df4a03b1185": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario async", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 223.4714999999999918145476840436458587646484375, "raw_values": [ 223.504400000000003956301952712237834930419921875, 223.43860000000000809450284577906131744384765625 ], "test_run_times": [ 58.0799999999999982946974341757595539093017578125, 58.27000000000000312638803734444081783294677734375 ] }, "b": { "value": 223.366999999999990222931955941021442413330078125, "raw_values": [ 223.62790000000001100488589145243167877197265625, 223.105999999999994543031789362430572509765625 ], "test_run_times": [ 58.25999999999999801048033987171947956085205078125, 58.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 222.8174999999999954525264911353588104248046875, "raw_values": [ 222.865000000000009094947017729282379150390625, 222.769900000000006912159733474254608154296875 ], "test_run_times": [ 58.42999999999999971578290569595992565155029296875, 57.969999999999998863131622783839702606201171875 ] } } }, "01eed3a4e5b49dd8ffb4613c1e496b5c6a35b6d2": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 39.42190000000000082991391536779701709747314453125, "raw_values": [ 39.36290000000000333102434524334967136383056640625, 39.4808000000000021145751816220581531524658203125 ], "test_run_times": [ 48.21000000000000085265128291212022304534912109375, 48.1400000000000005684341886080801486968994140625 ] }, "b": { "value": 39.56309999999999860165189602412283420562744140625, "raw_values": [ 39.45479999999999876081346883438527584075927734375, 39.671300000000002228262019343674182891845703125 ], "test_run_times": [ 48.06000000000000227373675443232059478759765625, 48.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 39.51169999999999760120772407390177249908447265625, "raw_values": [ 39.52120000000000032969182939268648624420166015625, 39.5022000000000019781509763561189174652099609375 ], "test_run_times": [ 48.0499999999999971578290569595992565155029296875, 48.02000000000000312638803734444081783294677734375 ] } } }, "4dd1fc7ebf988ed8441defddd8eb70c4ece07b6c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 25.35600000000000164845914696343243122100830078125, "raw_values": [ 25.39399999999999835154085303656756877899169921875, 25.318000000000001392663762089796364307403564453125 ], "test_run_times": [ 48.21000000000000085265128291212022304534912109375, 48.1400000000000005684341886080801486968994140625 ] }, "b": { "value": 25.265899999999998470912032644264400005340576171875, "raw_values": [ 25.334900000000001085709300241433084011077880859375, 25.196799999999999641886461176909506320953369140625 ], "test_run_times": [ 48.06000000000000227373675443232059478759765625, 48.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 25.298899999999999721467247582040727138519287109375, "raw_values": [ 25.29260000000000019326762412674725055694580078125, 25.305099999999999482724888366647064685821533203125 ], "test_run_times": [ 48.0499999999999971578290569595992565155029296875, 48.02000000000000312638803734444081783294677734375 ] } } }, "86ba9fff7f27b605f3bc0d98b860fab8f58f4e94": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 468.13830000000001518856151960790157318115234375, "raw_values": [ 467.9524999999999863575794734060764312744140625, 468.32400000000001227817847393453121185302734375 ], "test_run_times": [ 38.60000000000000142108547152020037174224853515625, 38.2000000000000028421709430404007434844970703125 ] }, "b": { "value": 467.9696000000000140062184073030948638916015625, "raw_values": [ 468.593200000000024374458007514476776123046875, 467.34600000000000363797880709171295166015625 ], "test_run_times": [ 37.8900000000000005684341886080801486968994140625, 38.0499999999999971578290569595992565155029296875 ] }, "c": { "value": 468.3292999999999892679625190794467926025390625, "raw_values": [ 468.4216000000000121872290037572383880615234375, 468.2368999999999914507498033344745635986328125 ], "test_run_times": [ 38, 38.03999999999999914734871708787977695465087890625 ] } } }, "11f23757bc512e73ec1733c280e61785d8ebeb3b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 68.285200000000003228706191293895244598388671875, "raw_values": [ 68.322599999999994224708643741905689239501953125, 68.2476999999999947021933621726930141448974609375 ], "test_run_times": [ 38.60000000000000142108547152020037174224853515625, 38.2000000000000028421709430404007434844970703125 ] }, "b": { "value": 68.2763000000000062073013396002352237701416015625, "raw_values": [ 68.239900000000005775291356258094310760498046875, 68.312600000000003319655661471188068389892578125 ], "test_run_times": [ 37.8900000000000005684341886080801486968994140625, 38.0499999999999971578290569595992565155029296875 ] }, "c": { "value": 68.2502999999999957481122692115604877471923828125, "raw_values": [ 68.2385000000000019326762412674725055694580078125, 68.262100000000003774403012357652187347412109375 ], "test_run_times": [ 38, 38.03999999999999914734871708787977695465087890625 ] } } }, "e8775641ef6f3b2dd8eb94255569a4c904cb09e8": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 159.8491999999999961801222525537014007568359375, "raw_values": [ 160.275200000000012323653209023177623748779296875, 159.42320000000000845830072648823261260986328125 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.72999999999999687361196265555918216705322265625 ] }, "b": { "value": 159.748099999999993769961292855441570281982421875, "raw_values": [ 159.96850000000000591171556152403354644775390625, 159.527700000000010049916454590857028961181640625 ], "test_run_times": [ 37.57000000000000028421709430404007434844970703125, 37.86999999999999744204615126363933086395263671875 ] }, "c": { "value": 160.593199999999995952748577110469341278076171875, "raw_values": [ 161.391300000000001091393642127513885498046875, 159.79509999999999081410351209342479705810546875 ], "test_run_times": [ 37.71000000000000085265128291212022304534912109375, 37.68999999999999772626324556767940521240234375 ] } } }, "4c7a3e0f5a69b82a2dc52c3ee1b43e3a8fc5abbd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 6.25250000000000039079850466805510222911834716796875, "raw_values": [ 6.23589999999999999857891452847979962825775146484375, 6.2690999999999998948396751075051724910736083984375 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.72999999999999687361196265555918216705322265625 ] }, "b": { "value": 6.25659999999999971720399116748012602329254150390625, "raw_values": [ 6.2478999999999995651478457148186862468719482421875, 6.26520000000000010231815394945442676544189453125 ], "test_run_times": [ 37.57000000000000028421709430404007434844970703125, 37.86999999999999744204615126363933086395263671875 ] }, "c": { "value": 6.22379999999999977688958097132854163646697998046875, "raw_values": [ 6.1929999999999996163069226895458996295928955078125, 6.25450000000000017053025658242404460906982421875 ], "test_run_times": [ 37.71000000000000085265128291212022304534912109375, 37.68999999999999772626324556767940521240234375 ] } } }, "df293935a009e2c2ffe482dba5113c2b25ca2f7b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 3814.5194000000001324224285781383514404296875, "raw_values": [ 3813.976599999999962165020406246185302734375, 3815.06219999999984793248586356639862060546875 ], "test_run_times": [ 37.75, 37.6099999999999994315658113919198513031005859375 ] }, "b": { "value": 3824.304500000000189174897968769073486328125, "raw_values": [ 3813.76569999999992433004081249237060546875, 3834.84319999999979700078256428241729736328125 ], "test_run_times": [ 37.5799999999999982946974341757595539093017578125, 37.63000000000000255795384873636066913604736328125 ] }, "c": { "value": 3823.08329999999978099367581307888031005859375, "raw_values": [ 3805.85500000000001818989403545856475830078125, 3840.3115999999999985448084771633148193359375 ], "test_run_times": [ 37.6099999999999994315658113919198513031005859375, 37.74000000000000198951966012828052043914794921875 ] } } }, "e11820ae0bc99a49e33ece786f4e8d3fff5a72b3": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.3665000000000002700062395888380706310272216796875, "raw_values": [ 8.3678000000000007929656931082718074321746826171875, 8.3651999999999997470467860694043338298797607421875 ], "test_run_times": [ 37.75, 37.6099999999999994315658113919198513031005859375 ] }, "b": { "value": 8.3440999999999991842969393474049866199493408203125, "raw_values": [ 8.3652999999999995139887687400914728641510009765625, 8.322900000000000630961949354968965053558349609375 ], "test_run_times": [ 37.5799999999999982946974341757595539093017578125, 37.63000000000000255795384873636066913604736328125 ] }, "c": { "value": 8.3467999999999999971578290569595992565155029296875, "raw_values": [ 8.3833999999999999630517777404747903347015380859375, 8.3101000000000002643218977027572691440582275390625 ], "test_run_times": [ 37.6099999999999994315658113919198513031005859375, 37.74000000000000198951966012828052043914794921875 ] } } }, "b4dbc793940b7f30198f2e87377c997b6c3db06e": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 723.7148999999999432475306093692779541015625, "raw_values": [ 734.42830000000003565219230949878692626953125, 713.0014999999999645297066308557987213134765625 ], "test_run_times": [ 37.469999999999998863131622783839702606201171875, 37.5 ] }, "b": { "value": 732.1100999999999885403667576611042022705078125, "raw_values": [ 729.197300000000041109160520136356353759765625, 735.0229000000000496584107168018817901611328125 ], "test_run_times": [ 37.39999999999999857891452847979962825775146484375, 37.340000000000003410605131648480892181396484375 ] }, "c": { "value": 731.5099000000000160071067512035369873046875, "raw_values": [ 731.02809999999999490682967007160186767578125, 731.9915999999999485225998796522617340087890625 ], "test_run_times": [ 37.340000000000003410605131648480892181396484375, 44.32000000000000028421709430404007434844970703125 ] } } }, "7bd81c6e1afc248cd0227631400de567023b9e0d": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1.37840000000000006963318810448981821537017822265625, "raw_values": [ 1.3579000000000001069366817318950779736042022705078125, 1.398800000000000043343106881366111338138580322265625 ], "test_run_times": [ 37.469999999999998863131622783839702606201171875, 37.5 ] }, "b": { "value": 1.3623000000000000664357457935693673789501190185546875, "raw_values": [ 1.36779999999999990478727340814657509326934814453125, 1.3568000000000000060396132539608515799045562744140625 ], "test_run_times": [ 37.39999999999999857891452847979962825775146484375, 37.340000000000003410605131648480892181396484375 ] }, "c": { "value": 1.363399999999999945288209346472285687923431396484375, "raw_values": [ 1.3643000000000000682121026329696178436279296875, 1.36240000000000005542233338928781449794769287109375 ], "test_run_times": [ 37.340000000000003410605131648480892181396484375, 44.32000000000000028421709430404007434844970703125 ] } } }, "04dc16cdb3e5ac095dfb8d008bb8116fa6ac559a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 225.310399999999987130649969913065433502197265625, "raw_values": [ 225.10439999999999827196006663143634796142578125, 225.516300000000001091393642127513885498046875 ], "test_run_times": [ 38.57000000000000028421709430404007434844970703125, 38.61999999999999744204615126363933086395263671875 ] }, "b": { "value": 225.459200000000009822542779147624969482421875, "raw_values": [ 225.3555000000000063664629124104976654052734375, 225.5629000000000132786226458847522735595703125 ], "test_run_times": [ 38.780000000000001136868377216160297393798828125, 38.63000000000000255795384873636066913604736328125 ] }, "c": { "value": 225.800700000000006184563972055912017822265625, "raw_values": [ 225.580600000000004001776687800884246826171875, 226.020800000000008367351256310939788818359375 ], "test_run_times": [ 38.77000000000000312638803734444081783294677734375, 38.6400000000000005684341886080801486968994140625 ] } } }, "4eaee16613e7ebe05edc8651c848b583666fb211": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 141.70359999999999445208231918513774871826171875, "raw_values": [ 141.83359999999998990460881032049655914306640625, 141.573499999999995679900166578590869903564453125 ], "test_run_times": [ 38.57000000000000028421709430404007434844970703125, 38.61999999999999744204615126363933086395263671875 ] }, "b": { "value": 141.618500000000011596057447604835033416748046875, "raw_values": [ 141.710700000000002773958840407431125640869140625, 141.52629999999999199644662439823150634765625 ], "test_run_times": [ 38.780000000000001136868377216160297393798828125, 38.63000000000000255795384873636066913604736328125 ] }, "c": { "value": 141.477499999999992041921359486877918243408203125, "raw_values": [ 141.52510000000000900399754755198955535888671875, 141.4298000000000001818989403545856475830078125 ], "test_run_times": [ 38.77000000000000312638803734444081783294677734375, 38.6400000000000005684341886080801486968994140625 ] } } }, "2f6b21ec02b77d2f7af4ef1858ff7a5c06cd9522": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 119.80410000000000536601874046027660369873046875, "raw_values": [ 119.8798000000000030240698833949863910675048828125, 119.728399999999993497112882323563098907470703125 ], "test_run_times": [ 38.47999999999999687361196265555918216705322265625, 38.6099999999999994315658113919198513031005859375 ] }, "b": { "value": 119.8817999999999983629095368087291717529296875, "raw_values": [ 119.8606999999999942474460112862288951873779296875, 119.9029000000000024783730623312294483184814453125 ], "test_run_times": [ 38.50999999999999801048033987171947956085205078125, 38.409999999999996589394868351519107818603515625 ] }, "c": { "value": 119.9789999999999992041921359486877918243408203125, "raw_values": [ 119.98439999999999372448655776679515838623046875, 119.973600000000004683897714130580425262451171875 ], "test_run_times": [ 38.52000000000000312638803734444081783294677734375, 38.39999999999999857891452847979962825775146484375 ] } } }, "b15e2cdef9f8dae62220fd77b33538b51c63d2ef": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.3422999999999998266275724745355546474456787109375, "raw_values": [ 8.33670000000000044337866711430251598358154296875, 8.347899999999999209876477834768593311309814453125 ], "test_run_times": [ 38.47999999999999687361196265555918216705322265625, 38.6099999999999994315658113919198513031005859375 ] }, "b": { "value": 8.336800000000000210320649784989655017852783203125, "raw_values": [ 8.3379999999999991899812812334857881069183349609375, 8.3355999999999994543031789362430572509765625 ], "test_run_times": [ 38.50999999999999801048033987171947956085205078125, 38.409999999999996589394868351519107818603515625 ] }, "c": { "value": 8.3300000000000000710542735760100185871124267578125, "raw_values": [ 8.3297000000000007702283255639486014842987060546875, 8.3302999999999993718802215880714356899261474609375 ], "test_run_times": [ 38.52000000000000312638803734444081783294677734375, 38.39999999999999857891452847979962825775146484375 ] } } }, "baff18ee56137338b81c500dab60fff22ca5d02c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 46.7203999999999979308995534665882587432861328125, "raw_values": [ 46.62349999999999994315658113919198513031005859375, 46.8173000000000030240698833949863910675048828125 ], "test_run_times": [ 137.039999999999992041921359486877918243408203125, 137.31999999999999317878973670303821563720703125 ] }, "b": { "value": 46.57390000000000185309545486234128475189208984375, "raw_values": [ 46.5474999999999994315658113919198513031005859375, 46.600200000000000954969436861574649810791015625 ], "test_run_times": [ 136.969999999999998863131622783839702606201171875, 136.68999999999999772626324556767940521240234375 ] }, "c": { "value": 46.90209999999999723740984336473047733306884765625, "raw_values": [ 46.8830999999999988858689903281629085540771484375, 46.92099999999999937472239253111183643341064453125 ], "test_run_times": [ 136.55000000000001136868377216160297393798828125, 136.539999999999992041921359486877918243408203125 ] } } }, "0e601820a058a056ca591d76030131475bde0280": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 681.2756000000000540239852853119373321533203125, "raw_values": [ 681.6426000000000158252078108489513397216796875, 680.908599999999978535925038158893585205078125 ], "test_run_times": [ 137.039999999999992041921359486877918243408203125, 137.31999999999999317878973670303821563720703125 ] }, "b": { "value": 679.8239999999999554347596131265163421630859375, "raw_values": [ 679.6508000000000038198777474462985992431640625, 679.99710000000004583853296935558319091796875 ], "test_run_times": [ 136.969999999999998863131622783839702606201171875, 136.68999999999999772626324556767940521240234375 ] }, "c": { "value": 679.81179999999994834070093929767608642578125, "raw_values": [ 680.1543000000000347426976077258586883544921875, 679.469299999999975625541992485523223876953125 ], "test_run_times": [ 136.55000000000001136868377216160297393798828125, 136.539999999999992041921359486877918243408203125 ] } } }, "040da5621f340d57abe8e4592fecbcda224b19fc": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 24.4421999999999997044142219237983226776123046875, "raw_values": [ 24.447900000000000630961949354968965053558349609375, 24.436499999999998777866494492627680301666259765625 ], "test_run_times": [ 103.1099999999999994315658113919198513031005859375, 102.5 ] }, "b": { "value": 24.5655000000000001136868377216160297393798828125, "raw_values": [ 24.558299999999999130295691429637372493743896484375, 24.57260000000000133013600134290754795074462890625 ], "test_run_times": [ 102.849999999999994315658113919198513031005859375, 107.3799999999999954525264911353588104248046875 ] }, "c": { "value": 24.528400000000001313082975684665143489837646484375, "raw_values": [ 24.531800000000000494537744089029729366302490234375, 24.52499999999999857891452847979962825775146484375 ], "test_run_times": [ 102.31000000000000227373675443232059478759765625, 102.2699999999999960209606797434389591217041015625 ] } } }, "8e486ecd6f9817231cd10cd2c0cad2dfe8694dc5": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 40.90480000000000160298441187478601932525634765625, "raw_values": [ 40.89540000000000219415596802718937397003173828125, 40.91409999999999769215719425119459629058837890625 ], "test_run_times": [ 103.1099999999999994315658113919198513031005859375, 102.5 ] }, "b": { "value": 40.69930000000000092086338554508984088897705078125, "raw_values": [ 40.710700000000002773958840407431125640869140625, 40.68780000000000285353962681256234645843505859375 ], "test_run_times": [ 102.849999999999994315658113919198513031005859375, 107.3799999999999954525264911353588104248046875 ] }, "c": { "value": 40.7605999999999966121322358958423137664794921875, "raw_values": [ 40.75500000000000255795384873636066913604736328125, 40.766199999999997771737980656325817108154296875 ], "test_run_times": [ 102.31000000000000227373675443232059478759765625, 102.2699999999999960209606797434389591217041015625 ] } } }, "0ecd3fd90f51a32796ec6eaa16bbf44f503ba5c3": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 467.98480000000000700310920365154743194580078125, "raw_values": [ 467.61989999999997280610841698944568634033203125, 468.349699999999984356691129505634307861328125 ], "test_run_times": [ 38.090000000000003410605131648480892181396484375, 38.030000000000001136868377216160297393798828125 ] }, "b": { "value": 468.108699999999998908606357872486114501953125, "raw_values": [ 466.87740000000002282831701450049877166748046875, 469.33999999999997498889570124447345733642578125 ], "test_run_times": [ 38.00999999999999801048033987171947956085205078125, 38.06000000000000227373675443232059478759765625 ] }, "c": { "value": 467.63959999999997307895682752132415771484375, "raw_values": [ 467.899400000000014188117347657680511474609375, 467.37979999999998881321516819298267364501953125 ], "test_run_times": [ 38.25999999999999801048033987171947956085205078125, 37.909999999999996589394868351519107818603515625 ] } } }, "a206800656ca18c80dcdf9fcf46e5a86b142079b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 68.3187999999999959754859446547925472259521484375, "raw_values": [ 68.3559000000000054342308430932462215423583984375, 68.28170000000000072759576141834259033203125 ], "test_run_times": [ 38.090000000000003410605131648480892181396484375, 38.030000000000001136868377216160297393798828125 ] }, "b": { "value": 68.271600000000006502887117676436901092529296875, "raw_values": [ 68.3971999999999979991116560995578765869140625, 68.1460000000000007958078640513122081756591796875 ], "test_run_times": [ 38.00999999999999801048033987171947956085205078125, 38.06000000000000227373675443232059478759765625 ] }, "c": { "value": 68.3388000000000062073013396002352237701416015625, "raw_values": [ 68.344300000000004047251422889530658721923828125, 68.3332999999999941564965411089360713958740234375 ], "test_run_times": [ 38.25999999999999801048033987171947956085205078125, 37.909999999999996589394868351519107818603515625 ] } } }, "2d7585a5ae6658d7bdf7ef0deb976bde66d2c652": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 159.9660000000000081854523159563541412353515625, "raw_values": [ 159.724299999999999499777914024889469146728515625, 160.20760000000001355147105641663074493408203125 ], "test_run_times": [ 37.67999999999999971578290569595992565155029296875, 37.719999999999998863131622783839702606201171875 ] }, "b": { "value": 159.923799999999999954525264911353588104248046875, "raw_values": [ 160.24209999999999354258761741220951080322265625, 159.6055000000000063664629124104976654052734375 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.67999999999999971578290569595992565155029296875 ] }, "c": { "value": 160.698499999999995679900166578590869903564453125, "raw_values": [ 161.319400000000001682565198279917240142822265625, 160.0774999999999863575794734060764312744140625 ], "test_run_times": [ 37.71000000000000085265128291212022304534912109375, 37.5799999999999982946974341757595539093017578125 ] } } }, "4f0efa0181011344574983ec95a9367f1b1c7da5": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 6.24809999999999998721023075631819665431976318359375, "raw_values": [ 6.257799999999999585043042316101491451263427734375, 6.23829999999999973425701682572253048419952392578125 ], "test_run_times": [ 37.67999999999999971578290569595992565155029296875, 37.719999999999998863131622783839702606201171875 ] }, "b": { "value": 6.24950000000000027711166694643907248973846435546875, "raw_values": [ 6.23740000000000005542233338928781449794769287109375, 6.2615999999999996106225808034650981426239013671875 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.67999999999999971578290569595992565155029296875 ] }, "c": { "value": 6.219500000000000028421709430404007434844970703125, "raw_values": [ 6.195100000000000051159076974727213382720947265625, 6.24380000000000023874235921539366245269775390625 ], "test_run_times": [ 37.71000000000000085265128291212022304534912109375, 37.5799999999999982946974341757595539093017578125 ] } } }, "33b9489f8519e53fc10cce34d84394a5ca653816": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 227.418800000000004501998773775994777679443359375, "raw_values": [ 227.310699999999997089616954326629638671875, 227.52690000000001191438059322535991668701171875 ], "test_run_times": [ 38.7000000000000028421709430404007434844970703125, 38.77000000000000312638803734444081783294677734375 ] }, "b": { "value": 227.642300000000005866240826435387134552001953125, "raw_values": [ 227.447300000000012687451089732348918914794921875, 227.83719999999999572537490166723728179931640625 ], "test_run_times": [ 38.86999999999999744204615126363933086395263671875, 38.5799999999999982946974341757595539093017578125 ] }, "c": { "value": 227.57400000000001227817847393453121185302734375, "raw_values": [ 227.351799999999997226041159592568874359130859375, 227.796099999999995588950696401298046112060546875 ], "test_run_times": [ 38.72999999999999687361196265555918216705322265625, 38.659999999999996589394868351519107818603515625 ] } } }, "460c01e2574e71030ea2d5f4f8acbdc1acaffb5c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 140.39789999999999281499185599386692047119140625, "raw_values": [ 140.47169999999999845385900698602199554443359375, 140.32409999999998717612470500171184539794921875 ], "test_run_times": [ 38.7000000000000028421709430404007434844970703125, 38.77000000000000312638803734444081783294677734375 ] }, "b": { "value": 140.260700000000014142642612569034099578857421875, "raw_values": [ 140.384399999999999408828443847596645355224609375, 140.13700000000000045474735088646411895751953125 ], "test_run_times": [ 38.86999999999999744204615126363933086395263671875, 38.5799999999999982946974341757595539093017578125 ] }, "c": { "value": 140.303599999999988767740433104336261749267578125, "raw_values": [ 140.53170000000000072759576141834259033203125, 140.075500000000005229594535194337368011474609375 ], "test_run_times": [ 38.72999999999999687361196265555918216705322265625, 38.659999999999996589394868351519107818603515625 ] } } }, "3c57eba0b1738a72717e08ba85ec7daf504891f8": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 120.3645000000000067075234255753457546234130859375, "raw_values": [ 120.177899999999993951860233210027217864990234375, 120.5511000000000052523319027386605739593505859375 ], "test_run_times": [ 38.38000000000000255795384873636066913604736328125, 38.409999999999996589394868351519107818603515625 ] }, "b": { "value": 120.1761999999999943611328490078449249267578125, "raw_values": [ 120.1954999999999955662133288569748401641845703125, 120.156800000000004047251422889530658721923828125 ], "test_run_times": [ 38.3599999999999994315658113919198513031005859375, 38.3900000000000005684341886080801486968994140625 ] }, "c": { "value": 120.58129999999999881765688769519329071044921875, "raw_values": [ 120.66100000000000136424205265939235687255859375, 120.50159999999999627107172273099422454833984375 ], "test_run_times": [ 38.25999999999999801048033987171947956085205078125, 38.53999999999999914734871708787977695465087890625 ] } } }, "f3f5d4a6329a80736dc12cdd5b3481b3696bb5af": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.3056000000000000937916411203332245349884033203125, "raw_values": [ 8.31830000000000069348971010185778141021728515625, 8.292899999999999494093572138808667659759521484375 ], "test_run_times": [ 38.38000000000000255795384873636066913604736328125, 38.409999999999996589394868351519107818603515625 ] }, "b": { "value": 8.3181999999999991501908880309201776981353759765625, "raw_values": [ 8.31680000000000063664629124104976654052734375, 8.3195999999999994400923242210410535335540771484375 ], "test_run_times": [ 38.3599999999999994315658113919198513031005859375, 38.3900000000000005684341886080801486968994140625 ] }, "c": { "value": 8.2903000000000002245315045001916587352752685546875, "raw_values": [ 8.285000000000000142108547152020037174224853515625, 8.295500000000000540012479177676141262054443359375 ], "test_run_times": [ 38.25999999999999801048033987171947956085205078125, 38.53999999999999914734871708787977695465087890625 ] } } }, "83ed68ebf3a3a3b2b9436b45ecb77f255be36c9b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 326.31229999999999336068867705762386322021484375, "raw_values": [ 326.43360000000001264197635464370250701904296875, 326.19099999999997407940099947154521942138671875 ], "test_run_times": [ 40.86999999999999744204615126363933086395263671875, 41.00999999999999801048033987171947956085205078125 ] }, "b": { "value": 326.5439000000000078216544352471828460693359375, "raw_values": [ 327.02550000000002228262019343674182891845703125, 326.06229999999999336068867705762386322021484375 ], "test_run_times": [ 40.75999999999999801048033987171947956085205078125, 40.9500000000000028421709430404007434844970703125 ] }, "c": { "value": 326.4107999999999947249307297170162200927734375, "raw_values": [ 326.8990999999999758074409328401088714599609375, 325.92239999999998190105543471872806549072265625 ], "test_run_times": [ 40.8299999999999982946974341757595539093017578125, 40.81000000000000227373675443232059478759765625 ] } } }, "3fe07981233683701958382bf8ad2a4f73d4b77e": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 97.8710999999999984311216394416987895965576171875, "raw_values": [ 97.869900000000001227817847393453121185302734375, 97.8722000000000065256244852207601070404052734375 ], "test_run_times": [ 40.86999999999999744204615126363933086395263671875, 41.00999999999999801048033987171947956085205078125 ] }, "b": { "value": 97.843400000000002592059900052845478057861328125, "raw_values": [ 97.690799999999995861799106933176517486572265625, 97.9959000000000060026650317013263702392578125 ], "test_run_times": [ 40.75999999999999801048033987171947956085205078125, 40.9500000000000028421709430404007434844970703125 ] }, "c": { "value": 97.86979999999999790816218592226505279541015625, "raw_values": [ 97.707099999999996953192749060690402984619140625, 98.032499999999998863131622783839702606201171875 ], "test_run_times": [ 40.8299999999999982946974341757595539093017578125, 40.81000000000000227373675443232059478759765625 ] } } }, "8d7cb28d68cd32fe88cedc09ca57f67417a948aa": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 97.356099999999997862687450833618640899658203125, "raw_values": [ 97.39650000000000318323145620524883270263671875, 97.3157000000000067529981606639921665191650390625 ], "test_run_times": [ 40.47999999999999687361196265555918216705322265625, 40.36999999999999744204615126363933086395263671875 ] }, "b": { "value": 97.61209999999999809006112627685070037841796875, "raw_values": [ 97.7857999999999947249307297170162200927734375, 97.438299999999998135535861365497112274169921875 ], "test_run_times": [ 40.28999999999999914734871708787977695465087890625, 40.50999999999999801048033987171947956085205078125 ] }, "c": { "value": 96.8821999999999974306774674914777278900146484375, "raw_values": [ 96.9602000000000003865352482534945011138916015625, 96.80410000000000536601874046027660369873046875 ], "test_run_times": [ 40.13000000000000255795384873636066913604736328125, 40.219999999999998863131622783839702606201171875 ] } } }, "f64b9bf4bd890119030c8b6a8b0c7b7032df3a8a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 10.2644999999999999573674358543939888477325439453125, "raw_values": [ 10.260799999999999698729880037717521190643310546875, 10.26820000000000021600499167107045650482177734375 ], "test_run_times": [ 40.47999999999999687361196265555918216705322265625, 40.36999999999999744204615126363933086395263671875 ] }, "b": { "value": 10.23799999999999954525264911353588104248046875, "raw_values": [ 10.2201000000000004064304448547773063182830810546875, 10.25580000000000069348971010185778141021728515625 ], "test_run_times": [ 40.28999999999999914734871708787977695465087890625, 40.50999999999999801048033987171947956085205078125 ] }, "c": { "value": 10.3146000000000004348521542851813137531280517578125, "raw_values": [ 10.3061000000000007048583938740193843841552734375, 10.323100000000000164845914696343243122100830078125 ], "test_run_times": [ 40.13000000000000255795384873636066913604736328125, 40.219999999999998863131622783839702606201171875 ] } } }, "4a6fa7a8b3679b981efd8457ed37e9f3d1dc5d74": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 53.48310000000000030695446184836328029632568359375, "raw_values": [ 53.47959999999999780584403197281062602996826171875, 53.48649999999999948840923025272786617279052734375 ], "test_run_times": [ 53.71000000000000085265128291212022304534912109375, 53.97999999999999687361196265555918216705322265625 ] }, "b": { "value": 53.553100000000000591171556152403354644775390625, "raw_values": [ 53.60079999999999955662133288569748401641845703125, 53.50540000000000162572177941910922527313232421875 ], "test_run_times": [ 54.1700000000000017053025658242404460906982421875, 53.8599999999999994315658113919198513031005859375 ] }, "c": { "value": 53.61659999999999826059138285927474498748779296875, "raw_values": [ 53.61670000000000158024704433046281337738037109375, 53.616500000000002046363078989088535308837890625 ], "test_run_times": [ 53.93999999999999772626324556767940521240234375, 54 ] } } }, "69f7a9e17c576c747b057ded335a977ba6460c5f": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 597.9678999999999859937815926969051361083984375, "raw_values": [ 598.0185000000000172803993336856365203857421875, 597.9172999999999547071638517081737518310546875 ], "test_run_times": [ 53.71000000000000085265128291212022304534912109375, 53.97999999999999687361196265555918216705322265625 ] }, "b": { "value": 596.80909999999994397512637078762054443359375, "raw_values": [ 596.684700000000020736479200422763824462890625, 596.9334000000000060026650317013263702392578125 ], "test_run_times": [ 54.1700000000000017053025658242404460906982421875, 53.8599999999999994315658113919198513031005859375 ] }, "c": { "value": 596.534300000000030195224098861217498779296875, "raw_values": [ 596.5279000000000451109372079372406005859375, 596.540600000000040381564758718013763427734375 ], "test_run_times": [ 53.93999999999999772626324556767940521240234375, 54 ] } } }, "0d3e0460c5932505654a7338c7b258bafeb733b0": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 28.631000000000000227373675443232059478759765625, "raw_values": [ 28.6570999999999997953636921010911464691162109375, 28.604800000000000892441676114685833454132080078125 ], "test_run_times": [ 42.81000000000000227373675443232059478759765625, 42.6400000000000005684341886080801486968994140625 ] }, "b": { "value": 28.63289999999999935198502498678863048553466796875, "raw_values": [ 28.673300000000001119815351557917892932891845703125, 28.592400000000001369926394545473158359527587890625 ], "test_run_times": [ 42.6400000000000005684341886080801486968994140625, 42.50999999999999801048033987171947956085205078125 ] }, "c": { "value": 28.641600000000000392219590139575302600860595703125, "raw_values": [ 28.6210999999999984311216394416987895965576171875, 28.66199999999999903366187936626374721527099609375 ], "test_run_times": [ 42.52000000000000312638803734444081783294677734375, 42.60000000000000142108547152020037174224853515625 ] } } }, "82f44cc7280eea070a5243bbcdd819ead21bdb49": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 34.91040000000000276259015663526952266693115234375, "raw_values": [ 34.878500000000002501110429875552654266357421875, 34.9421999999999997044142219237983226776123046875 ], "test_run_times": [ 42.81000000000000227373675443232059478759765625, 42.6400000000000005684341886080801486968994140625 ] }, "b": { "value": 34.90820000000000078443918027915060520172119140625, "raw_values": [ 34.858800000000002228262019343674182891845703125, 34.95750000000000312638803734444081783294677734375 ], "test_run_times": [ 42.6400000000000005684341886080801486968994140625, 42.50999999999999801048033987171947956085205078125 ] }, "c": { "value": 34.89779999999999660076355212368071079254150390625, "raw_values": [ 34.92280000000000228510543820448219776153564453125, 34.87270000000000180762071977369487285614013671875 ], "test_run_times": [ 42.52000000000000312638803734444081783294677734375, 42.60000000000000142108547152020037174224853515625 ] } } }, "fba263fade4e645387cfa338b609a9838531a63f": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 574.9550000000000409272615797817707061767578125, "raw_values": [ 574.9876000000000431100488640367984771728515625, 574.9224000000000387444742955267429351806640625 ], "test_run_times": [ 86.6299999999999954525264911353588104248046875, 87.2399999999999948840923025272786617279052734375 ] }, "b": { "value": 575.2858999999999696228769607841968536376953125, "raw_values": [ 574.609400000000050567905418574810028076171875, 575.9624000000000023646862246096134185791015625 ], "test_run_times": [ 86.4800000000000039790393202565610408782958984375, 86.659999999999996589394868351519107818603515625 ] }, "c": { "value": 575.11580000000003565219230949878692626953125, "raw_values": [ 574.8020000000000209183781407773494720458984375, 575.4296000000000503860064782202243804931640625 ], "test_run_times": [ 86.6200000000000045474735088646411895751953125, 86.4599999999999937472239253111183643341064453125 ] } } }, "bebb62f45ff7622efad92194d1ad4a2932098244": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 55.5816999999999978854248183779418468475341796875, "raw_values": [ 55.55590000000000117097442853264510631561279296875, 55.6073999999999983856469043530523777008056640625 ], "test_run_times": [ 86.6299999999999954525264911353588104248046875, 87.2399999999999948840923025272786617279052734375 ] }, "b": { "value": 55.56009999999999848796505830250680446624755859375, "raw_values": [ 55.6218999999999965666575008071959018707275390625, 55.498300000000000409272615797817707061767578125 ], "test_run_times": [ 86.4800000000000039790393202565610408782958984375, 86.659999999999996589394868351519107818603515625 ] }, "c": { "value": 55.5835000000000007958078640513122081756591796875, "raw_values": [ 55.6203000000000002955857780762016773223876953125, 55.5465999999999979763742885552346706390380859375 ], "test_run_times": [ 86.6200000000000045474735088646411895751953125, 86.4599999999999937472239253111183643341064453125 ] } } }, "eba161c303a44b46f72cb85f8b16da8797954de2": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 94.5096999999999951569407130591571331024169921875, "raw_values": [ 94.4558999999999997498889570124447345733642578125, 94.5634000000000014551915228366851806640625 ], "test_run_times": [ 110.6400000000000005684341886080801486968994140625, 110.7600000000000051159076974727213382720947265625 ] }, "b": { "value": 94.044499999999999317878973670303821563720703125, "raw_values": [ 93.40240000000000009094947017729282379150390625, 94.6865999999999985448084771633148193359375 ], "test_run_times": [ 116.0400000000000062527760746888816356658935546875, 110.849999999999994315658113919198513031005859375 ] }, "c": { "value": 94.5548000000000001818989403545856475830078125, "raw_values": [ 94.733599999999995588950696401298046112060546875, 94.376000000000004774847184307873249053955078125 ], "test_run_times": [ 110.840000000000003410605131648480892181396484375, 110.5100000000000051159076974727213382720947265625 ] } } }, "9291f99c55ae8b7f172514da44fccba0414eac1a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 10.5769999999999999573674358543939888477325439453125, "raw_values": [ 10.5831999999999997186250766390003263950347900390625, 10.5707000000000004291678123991005122661590576171875 ], "test_run_times": [ 110.6400000000000005684341886080801486968994140625, 110.7600000000000051159076974727213382720947265625 ] }, "b": { "value": 10.62989999999999923829818726517260074615478515625, "raw_values": [ 10.7022999999999992581933838664554059505462646484375, 10.5573999999999994514610079932026565074920654296875 ], "test_run_times": [ 116.0400000000000062527760746888816356658935546875, 110.849999999999994315658113919198513031005859375 ] }, "c": { "value": 10.571999999999999175770426518283784389495849609375, "raw_values": [ 10.551700000000000301270119962282478809356689453125, 10.5922000000000000596855898038484156131744384765625 ], "test_run_times": [ 110.840000000000003410605131648480892181396484375, 110.5100000000000051159076974727213382720947265625 ] } } }, "20c1c51e2bfbc591aaabf47cf063228f6ada73fd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 165.99799999999999045030563138425350189208984375, "raw_values": [ 166.049700000000001409716787748038768768310546875, 165.946200000000004592948243953287601470947265625 ], "test_run_times": [ 54.2999999999999971578290569595992565155029296875, 54.0499999999999971578290569595992565155029296875 ] }, "b": { "value": 166.22309999999998808561940677464008331298828125, "raw_values": [ 166.280499999999989313437254168093204498291015625, 166.165699999999986857801559381186962127685546875 ], "test_run_times": [ 53.93999999999999772626324556767940521240234375, 53.81000000000000227373675443232059478759765625 ] }, "c": { "value": 166.0579999999999927240423858165740966796875, "raw_values": [ 165.97800000000000864019966684281826019287109375, 166.13700000000000045474735088646411895751953125 ], "test_run_times": [ 53.85000000000000142108547152020037174224853515625, 53.78999999999999914734871708787977695465087890625 ] } } }, "c140dfec0018fc181a99a409aabde3dfc60b3338": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 192.3546000000000049112713895738124847412109375, "raw_values": [ 192.2984999999999899955582804977893829345703125, 192.410699999999991405275068245828151702880859375 ], "test_run_times": [ 54.2999999999999971578290569595992565155029296875, 54.0499999999999971578290569595992565155029296875 ] }, "b": { "value": 192.164500000000003865352482534945011138916015625, "raw_values": [ 192.161399999999986221155268140137195587158203125, 192.167499999999989768184605054557323455810546875 ], "test_run_times": [ 53.93999999999999772626324556767940521240234375, 53.81000000000000227373675443232059478759765625 ] }, "c": { "value": 192.214799999999996771293808706104755401611328125, "raw_values": [ 192.42869999999999208739609457552433013916015625, 192.0009000000000014551915228366851806640625 ], "test_run_times": [ 53.85000000000000142108547152020037174224853515625, 53.78999999999999914734871708787977695465087890625 ] } } }, "1a040d88fe38299e97475896381fcc8c2c75f6bc": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 53.78450000000000130739863379858434200286865234375, "raw_values": [ 53.86919999999999930651028989814221858978271484375, 53.69969999999999998863131622783839702606201171875 ], "test_run_times": [ 54.42999999999999971578290569595992565155029296875, 50.1099999999999994315658113919198513031005859375 ] }, "b": { "value": 53.70230000000000103455022326670587062835693359375, "raw_values": [ 53.71690000000000253521648119203746318817138671875, 53.68769999999999953388396534137427806854248046875 ], "test_run_times": [ 50.0799999999999982946974341757595539093017578125, 50.00999999999999801048033987171947956085205078125 ] }, "c": { "value": 53.951999999999998181010596454143524169921875, "raw_values": [ 54.048000000000001818989403545856475830078125, 53.85600000000000164845914696343243122100830078125 ], "test_run_times": [ 49.7999999999999971578290569595992565155029296875, 49.9200000000000017053025658242404460906982421875 ] } } }, "0fa3ad6972acbbc94e8cade3c5b1ae33c0fc79a7": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 18.58579999999999898818714427761733531951904296875, "raw_values": [ 18.556599999999999539568307227455079555511474609375, 18.614999999999998436805981327779591083526611328125 ], "test_run_times": [ 54.42999999999999971578290569595992565155029296875, 50.1099999999999994315658113919198513031005859375 ] }, "b": { "value": 18.614399999999999835154085303656756877899169921875, "raw_values": [ 18.60940000000000082991391536779701709747314453125, 18.6193999999999988403942552395164966583251953125 ], "test_run_times": [ 50.0799999999999982946974341757595539093017578125, 50.00999999999999801048033987171947956085205078125 ] }, "c": { "value": 18.52799999999999869260136620141565799713134765625, "raw_values": [ 18.495000000000000994759830064140260219573974609375, 18.56099999999999994315658113919198513031005859375 ], "test_run_times": [ 49.7999999999999971578290569595992565155029296875, 49.9200000000000017053025658242404460906982421875 ] } } }, "ae0eb01689f3661bfb3f5549d4f6a3b68092849c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 37.6109000000000008867573342286050319671630859375, "raw_values": [ 37.646399999999999863575794734060764312744140625, 37.575299999999998590283212251961231231689453125 ], "test_run_times": [ 53.1400000000000005684341886080801486968994140625, 53.3900000000000005684341886080801486968994140625 ] }, "b": { "value": 37.535200000000003228706191293895244598388671875, "raw_values": [ 37.524799999999999045030563138425350189208984375, 37.54549999999999698729880037717521190643310546875 ], "test_run_times": [ 53.43999999999999772626324556767940521240234375, 53.27000000000000312638803734444081783294677734375 ] }, "c": { "value": 37.57549999999999812416717759333550930023193359375, "raw_values": [ 37.55319999999999680539986002258956432342529296875, 37.597700000000003228706191293895244598388671875 ], "test_run_times": [ 53.590000000000003410605131648480892181396484375, 53.25999999999999801048033987171947956085205078125 ] } } }, "85372d2cddb591feb38946fd4fac427c4412616c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 841.4778999999999768988345749676227569580078125, "raw_values": [ 841.9654000000000451109372079372406005859375, 840.9904000000000223735696636140346527099609375 ], "test_run_times": [ 53.1400000000000005684341886080801486968994140625, 53.3900000000000005684341886080801486968994140625 ] }, "b": { "value": 840.257299999999986539478413760662078857421875, "raw_values": [ 840.262899999999945066520012915134429931640625, 840.25160000000005311449058353900909423828125 ], "test_run_times": [ 53.43999999999999772626324556767940521240234375, 53.27000000000000312638803734444081783294677734375 ] }, "c": { "value": 840.43499999999994543031789362430572509765625, "raw_values": [ 840.8701999999999543433659709990024566650390625, 839.9996999999999616193235851824283599853515625 ], "test_run_times": [ 53.590000000000003410605131648480892181396484375, 53.25999999999999801048033987171947956085205078125 ] } } }, "523cc885ff74f9e08d52648fa01d46136540daeb": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 20.071999999999999175770426518283784389495849609375, "raw_values": [ 20.092800000000000437694325228221714496612548828125, 20.051100000000001699618223938159644603729248046875 ], "test_run_times": [ 48.21000000000000085265128291212022304534912109375, 48.1400000000000005684341886080801486968994140625 ] }, "b": { "value": 20.03150000000000119371179607696831226348876953125, "raw_values": [ 20.03320000000000078443918027915060520172119140625, 20.02980000000000160298441187478601932525634765625 ], "test_run_times": [ 48.2000000000000028421709430404007434844970703125, 48.14999999999999857891452847979962825775146484375 ] }, "c": { "value": 20.053599999999999425881469505839049816131591796875, "raw_values": [ 20.077000000000001733724275254644453525543212890625, 20.03020000000000067075234255753457546234130859375 ], "test_run_times": [ 48.0799999999999982946974341757595539093017578125, 48.1700000000000017053025658242404460906982421875 ] } } }, "5338300038b8dfdcff4dbbb4467411012e1eda2a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 49.81320000000000192130755749531090259552001953125, "raw_values": [ 49.76140000000000185309545486234128475189208984375, 49.86489999999999866986399865709245204925537109375 ], "test_run_times": [ 48.21000000000000085265128291212022304534912109375, 48.1400000000000005684341886080801486968994140625 ] }, "b": { "value": 49.9144000000000005456968210637569427490234375, "raw_values": [ 49.90990000000000037516656448133289813995361328125, 49.91879999999999739657141617499291896820068359375 ], "test_run_times": [ 48.2000000000000028421709430404007434844970703125, 48.14999999999999857891452847979962825775146484375 ] }, "c": { "value": 49.85799999999999698729880037717521190643310546875, "raw_values": [ 49.8008999999999986130205797962844371795654296875, 49.91499999999999914734871708787977695465087890625 ], "test_run_times": [ 48.0799999999999982946974341757595539093017578125, 48.1700000000000017053025658242404460906982421875 ] } } }, "5ff8ad00befa8021f2a426750fd7961d10d1674a": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: mobilenet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 14.1099999999999994315658113919198513031005859375, "raw_values": [ 14.0600000000000004973799150320701301097869873046875, 14.1500000000000003552713678800500929355621337890625 ], "min_result": [ "13.76" ], "max_result": [ "19.75" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 13.9700000000000006394884621840901672840118408203125, "raw_values": [ 13.9900000000000002131628207280300557613372802734375, 13.9399999999999995026200849679298698902130126953125 ], "min_result": [ "13.64" ], "max_result": [ "19.68" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 14.0299999999999993605115378159098327159881591796875, "raw_values": [ 14.1199999999999992184029906638897955417633056640625, 13.9399999999999995026200849679298698902130126953125 ], "min_result": [ "13.68" ], "max_result": [ "18.14" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "8656c230522cbc01a88e3065ab3d9b1bc1a67b1d": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU-v2-v2 - Model: mobilenet-v2", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 6.3499999999999996447286321199499070644378662109375, "raw_values": [ 6.36000000000000031974423109204508364200592041015625, 6.339999999999999857891452847979962825775146484375 ], "min_result": [ "6.19" ], "max_result": [ "12.45" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 6.2599999999999997868371792719699442386627197265625, "raw_values": [ 6.25, 6.2599999999999997868371792719699442386627197265625 ], "min_result": [ "6.11" ], "max_result": [ "12.76" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 6.1699999999999999289457264239899814128875732421875, "raw_values": [ 6.230000000000000426325641456060111522674560546875, 6.0999999999999996447286321199499070644378662109375 ], "min_result": [ "6.02" ], "max_result": [ "6.83" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "07e777e4685ac22999efb7fac8544a07f83af440": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU-v3-v3 - Model: mobilenet-v3", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 7, "raw_values": [ 7.54000000000000003552713678800500929355621337890625, 6.45000000000000017763568394002504646778106689453125 ], "min_result": [ "6.3" ], "max_result": [ "10.2" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 6.54999999999999982236431605997495353221893310546875, "raw_values": [ 6.37000000000000010658141036401502788066864013671875, 6.730000000000000426325641456060111522674560546875 ], "min_result": [ "6.24" ], "max_result": [ "7.61" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 6.339999999999999857891452847979962825775146484375, "raw_values": [ 6.37999999999999989341858963598497211933135986328125, 6.29999999999999982236431605997495353221893310546875 ], "min_result": [ "6.15" ], "max_result": [ "11.57" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "3bb2c9bc420514b1433ab26476dc85829ffec86e": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: shufflenet-v2", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 9.089999999999999857891452847979962825775146484375, "raw_values": [ 10.32000000000000028421709430404007434844970703125, 7.86000000000000031974423109204508364200592041015625 ], "min_result": [ "7.74" ], "max_result": [ "15.92" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 7.92999999999999971578290569595992565155029296875, "raw_values": [ 7.62000000000000010658141036401502788066864013671875, 8.230000000000000426325641456060111522674560546875 ], "min_result": [ "7.51" ], "max_result": [ "11.45" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 7.5999999999999996447286321199499070644378662109375, "raw_values": [ 7.63999999999999968025576890795491635799407958984375, 7.55999999999999960920149533194489777088165283203125 ], "min_result": [ "7.44" ], "max_result": [ "11.6" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "34d8b6c8389b29062d57510f7dbc42c15d65d711": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: mnasnet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 6.089999999999999857891452847979962825775146484375, "raw_values": [ 6.20000000000000017763568394002504646778106689453125, 5.980000000000000426325641456060111522674560546875 ], "min_result": [ "5.89" ], "max_result": [ "10.35" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 5.9000000000000003552713678800500929355621337890625, "raw_values": [ 5.9000000000000003552713678800500929355621337890625, 5.9000000000000003552713678800500929355621337890625 ], "min_result": [ "5.81" ], "max_result": [ "12.33" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 5.86000000000000031974423109204508364200592041015625, "raw_values": [ 5.9000000000000003552713678800500929355621337890625, 5.80999999999999960920149533194489777088165283203125 ], "min_result": [ "5.73" ], "max_result": [ "11.67" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "cecdff538032dfa900ef54a8fe2de4713eaa0668": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: efficientnet-b0", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 9.980000000000000426325641456060111522674560546875, "raw_values": [ 9.949999999999999289457264239899814128875732421875, 10 ], "min_result": [ "9.82" ], "max_result": [ "10.96" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 9.7799999999999993605115378159098327159881591796875, "raw_values": [ 9.7599999999999997868371792719699442386627197265625, 9.78999999999999914734871708787977695465087890625 ], "min_result": [ "9.64" ], "max_result": [ "16.01" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 9.75, "raw_values": [ 9.78999999999999914734871708787977695465087890625, 9.699999999999999289457264239899814128875732421875 ], "min_result": [ "9.58" ], "max_result": [ "13.38" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "0542b60a3b2abf049d6d0d3a1c1116caa394bd37": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: blazeface", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 3.970000000000000195399252334027551114559173583984375, "raw_values": [ 4.05999999999999960920149533194489777088165283203125, 3.87999999999999989341858963598497211933135986328125 ], "min_result": [ "3.5" ], "max_result": [ "7.61" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 3.430000000000000159872115546022541821002960205078125, "raw_values": [ 3.4199999999999999289457264239899814128875732421875, 3.430000000000000159872115546022541821002960205078125 ], "min_result": [ "3.35" ], "max_result": [ "3.83" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 3.479999999999999982236431605997495353221893310546875, "raw_values": [ 3.529999999999999804600747665972448885440826416015625, 3.4199999999999999289457264239899814128875732421875 ], "min_result": [ "3.32" ], "max_result": [ "8.58" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "ea820002b3c0fa4dce3ea08621eed76719fcffed": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: googlenet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 14.6199999999999992184029906638897955417633056640625, "raw_values": [ 14.589999999999999857891452847979962825775146484375, 14.6500000000000003552713678800500929355621337890625 ], "min_result": [ "14.46" ], "max_result": [ "25.51" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 14.5299999999999993605115378159098327159881591796875, "raw_values": [ 14.5099999999999997868371792719699442386627197265625, 14.550000000000000710542735760100185871124267578125 ], "min_result": [ "14.31" ], "max_result": [ "24.11" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 14.4700000000000006394884621840901672840118408203125, "raw_values": [ 14.5299999999999993605115378159098327159881591796875, 14.410000000000000142108547152020037174224853515625 ], "min_result": [ "14.26" ], "max_result": [ "20.57" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "0724da0b0dda01834a98fb1e7ef4f1eab5b69c72": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: vgg16", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 23.839999999999999857891452847979962825775146484375, "raw_values": [ 23.78999999999999914734871708787977695465087890625, 23.8900000000000005684341886080801486968994140625 ], "min_result": [ "23.45" ], "max_result": [ "28.55" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 23.6400000000000005684341886080801486968994140625, "raw_values": [ 23.57000000000000028421709430404007434844970703125, 23.699999999999999289457264239899814128875732421875 ], "min_result": [ "23.33" ], "max_result": [ "28.05" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 23.910000000000000142108547152020037174224853515625, "raw_values": [ 23.8299999999999982946974341757595539093017578125, 23.989999999999998436805981327779591083526611328125 ], "min_result": [ "23.48" ], "max_result": [ "30.63" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "6ca58910a4b457c01f4ab8c6009ba86380075cd1": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: resnet18", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.5, "raw_values": [ 8.4700000000000006394884621840901672840118408203125, 8.5299999999999993605115378159098327159881591796875 ], "min_result": [ "8.33" ], "max_result": [ "14.69" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 8.4199999999999999289457264239899814128875732421875, "raw_values": [ 8.3800000000000007815970093361102044582366943359375, 8.46000000000000085265128291212022304534912109375 ], "min_result": [ "8.27" ], "max_result": [ "14.6" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 8.5099999999999997868371792719699442386627197265625, "raw_values": [ 8.480000000000000426325641456060111522674560546875, 8.53999999999999914734871708787977695465087890625 ], "min_result": [ "8.3" ], "max_result": [ "13.61" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "5366daf62d3b532ed18dcc2a01966f0441e167a6": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: alexnet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 5.230000000000000426325641456060111522674560546875, "raw_values": [ 5.230000000000000426325641456060111522674560546875, 5.21999999999999975131004248396493494510650634765625 ], "min_result": [ "5.12" ], "max_result": [ "11.62" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 5.21999999999999975131004248396493494510650634765625, "raw_values": [ 5.19000000000000039079850466805510222911834716796875, 5.2400000000000002131628207280300557613372802734375 ], "min_result": [ "5.11" ], "max_result": [ "5.77" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 5.21999999999999975131004248396493494510650634765625, "raw_values": [ 5.230000000000000426325641456060111522674560546875, 5.20000000000000017763568394002504646778106689453125 ], "min_result": [ "5.12" ], "max_result": [ "7.84" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "e65d0aa2ac68b8fcd9ab577886319ba2215b0c59": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: resnet50", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 15.4900000000000002131628207280300557613372802734375, "raw_values": [ 15.410000000000000142108547152020037174224853515625, 15.5600000000000004973799150320701301097869873046875 ], "min_result": [ "15.24" ], "max_result": [ "21.82" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 15.339999999999999857891452847979962825775146484375, "raw_values": [ 15.2400000000000002131628207280300557613372802734375, 15.4399999999999995026200849679298698902130126953125 ], "min_result": [ "15.07" ], "max_result": [ "21.69" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 15.53999999999999914734871708787977695465087890625, "raw_values": [ 15.4000000000000003552713678800500929355621337890625, 15.67999999999999971578290569595992565155029296875 ], "min_result": [ "15.15" ], "max_result": [ "27.2" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "fcfde517d809537718f6b7731dc8d0f7ed0716d7": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: yolov4-tiny", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 20.660000000000000142108547152020037174224853515625, "raw_values": [ 20.6400000000000005684341886080801486968994140625, 20.67999999999999971578290569595992565155029296875 ], "min_result": [ "20.04" ], "max_result": [ "25.04" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 20.510000000000001563194018672220408916473388671875, "raw_values": [ 20.42999999999999971578290569595992565155029296875, 20.589999999999999857891452847979962825775146484375 ], "min_result": [ "19.87" ], "max_result": [ "24.86" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 20.800000000000000710542735760100185871124267578125, "raw_values": [ 20.6700000000000017053025658242404460906982421875, 20.92999999999999971578290569595992565155029296875 ], "min_result": [ "20.01" ], "max_result": [ "96.45" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "d30734f9e7275c871b9c30d1fd50cbcbb7c78000": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: squeezenet_ssd", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 14.1699999999999999289457264239899814128875732421875, "raw_values": [ 14.1500000000000003552713678800500929355621337890625, 14.17999999999999971578290569595992565155029296875 ], "min_result": [ "13.53" ], "max_result": [ "18.45" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 14.1099999999999994315658113919198513031005859375, "raw_values": [ 14.019999999999999573674358543939888477325439453125, 14.1899999999999995026200849679298698902130126953125 ], "min_result": [ "13.32" ], "max_result": [ "18.63" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 14.589999999999999857891452847979962825775146484375, "raw_values": [ 15.21000000000000085265128291212022304534912109375, 13.9700000000000006394884621840901672840118408203125 ], "min_result": [ "13.37" ], "max_result": [ "277.61" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "7dfd7f7d2f0f740fb22ed51af320da0e1eb8b7bf": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: regnety_400m", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 35.24000000000000198951966012828052043914794921875, "raw_values": [ 41.22999999999999687361196265555918216705322265625, 29.25 ], "min_result": [ "27.86" ], "max_result": [ "47.9" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 27.53999999999999914734871708787977695465087890625, "raw_values": [ 27.690000000000001278976924368180334568023681640625, 27.3900000000000005684341886080801486968994140625 ], "min_result": [ "26.96" ], "max_result": [ "33.56" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 27.589999999999999857891452847979962825775146484375, "raw_values": [ 27.660000000000000142108547152020037174224853515625, 27.519999999999999573674358543939888477325439453125 ], "min_result": [ "26.64" ], "max_result": [ "33.41" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "a6798cc12f260d29684f4d89a4fe5a2ad67923de": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: vision_transformer", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 48.78999999999999914734871708787977695465087890625, "raw_values": [ 48.8599999999999994315658113919198513031005859375, 48.71000000000000085265128291212022304534912109375 ], "min_result": [ "47.65" ], "max_result": [ "78.36" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 48.49000000000000198951966012828052043914794921875, "raw_values": [ 48.4500000000000028421709430404007434844970703125, 48.530000000000001136868377216160297393798828125 ], "min_result": [ "47.44" ], "max_result": [ "58.53" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 48.42999999999999971578290569595992565155029296875, "raw_values": [ 48.72999999999999687361196265555918216705322265625, 48.13000000000000255795384873636066913604736328125 ], "min_result": [ "47.33" ], "max_result": [ "85.35" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "713c7a1c2393887a1c94baa186568a86c4eb5b15": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: FastestDet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 10.25, "raw_values": [ 11.1899999999999995026200849679298698902130126953125, 9.300000000000000710542735760100185871124267578125 ], "min_result": [ "8.95" ], "max_result": [ "17.14" ], "test_run_times": [ 101.8299999999999982946974341757595539093017578125, 96.1200000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "b": { "value": 9.03999999999999914734871708787977695465087890625, "raw_values": [ 8.92999999999999971578290569595992565155029296875, 9.1400000000000005684341886080801486968994140625 ], "min_result": [ "8.65" ], "max_result": [ "15.19" ], "test_run_times": [ 93.8900000000000005684341886080801486968994140625, 94.7699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "c": { "value": 8.8800000000000007815970093361102044582366943359375, "raw_values": [ 8.8800000000000007815970093361102044582366943359375, 8.8699999999999992184029906638897955417633056640625 ], "min_result": [ "8.58" ], "max_result": [ "13.34" ], "test_run_times": [ 94.8700000000000045474735088646411895751953125, 93.849999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "351f556195f128aec13f5c66c67fbf70f78ab21a": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/bmw27_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: BMW27 - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 27.269999999999999573674358543939888477325439453125, "raw_values": [ 27.3299999999999982946974341757595539093017578125, 27.21000000000000085265128291212022304534912109375 ], "test_run_times": [ 28.280000000000001136868377216160297393798828125, 27.64999999999999857891452847979962825775146484375 ] }, "b": { "value": 27.5, "raw_values": [ 27.300000000000000710542735760100185871124267578125, 27.60000000000000142108547152020037174224853515625 ], "test_run_times": [ 27.730000000000000426325641456060111522674560546875, 28.030000000000001136868377216160297393798828125 ] }, "c": { "value": 27.239999999999998436805981327779591083526611328125, "raw_values": [ 27.280000000000001136868377216160297393798828125, 27.199999999999999289457264239899814128875732421875 ], "test_run_times": [ 27.71000000000000085265128291212022304534912109375, 27.629999999999999005240169935859739780426025390625 ] } } }, "2c548f2af84ef1dbd95bf756cd644be502a7f366": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/classroom_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Classroom - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 68.7999999999999971578290569595992565155029296875, "raw_values": [ 68.659999999999996589394868351519107818603515625, 68.93999999999999772626324556767940521240234375 ], "test_run_times": [ 69.0799999999999982946974341757595539093017578125, 69.3700000000000045474735088646411895751953125 ] }, "b": { "value": 68.5, "raw_values": [ 68.469999999999998863131622783839702606201171875, 68.530000000000001136868377216160297393798828125 ], "test_run_times": [ 68.8900000000000005684341886080801486968994140625, 68.9599999999999937472239253111183643341064453125 ] }, "c": { "value": 68.7000000000000028421709430404007434844970703125, "raw_values": [ 68.81999999999999317878973670303821563720703125, 68.56999999999999317878973670303821563720703125 ], "test_run_times": [ 69.219999999999998863131622783839702606201171875, 68.9800000000000039790393202565610408782958984375 ] } } }, "588a47d7b846a429886849ab34c1b1b922e347e1": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/fishy_cat_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Fishy Cat - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 33.7000000000000028421709430404007434844970703125, "raw_values": [ 33.67999999999999971578290569595992565155029296875, 33.71000000000000085265128291212022304534912109375 ], "test_run_times": [ 34.47999999999999687361196265555918216705322265625, 34.50999999999999801048033987171947956085205078125 ] }, "b": { "value": 33.75999999999999801048033987171947956085205078125, "raw_values": [ 33.50999999999999801048033987171947956085205078125, 34.00999999999999801048033987171947956085205078125 ], "test_run_times": [ 34.32000000000000028421709430404007434844970703125, 34.82000000000000028421709430404007434844970703125 ] }, "c": { "value": 33.719999999999998863131622783839702606201171875, "raw_values": [ 33.7000000000000028421709430404007434844970703125, 33.72999999999999687361196265555918216705322265625 ], "test_run_times": [ 34.50999999999999801048033987171947956085205078125, 34.53999999999999914734871708787977695465087890625 ] } } }, "183e901ae00912487a56d83fffbd8270c582ca7a": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/barbershop_interior_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Barbershop - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 253.490000000000009094947017729282379150390625, "raw_values": [ 253.599999999999994315658113919198513031005859375, 253.3700000000000045474735088646411895751953125 ], "test_run_times": [ 255.340000000000003410605131648480892181396484375, 255.1399999999999863575794734060764312744140625 ] }, "b": { "value": 253.770000000000010231815394945442676544189453125, "raw_values": [ 253.539999999999992041921359486877918243408203125, 253.990000000000009094947017729282379150390625 ], "test_run_times": [ 255.270000000000010231815394945442676544189453125, 255.759999999999990905052982270717620849609375 ] }, "c": { "value": 253.43000000000000682121026329696178436279296875, "raw_values": [ 252.909999999999996589394868351519107818603515625, 253.94999999999998863131622783839702606201171875 ], "test_run_times": [ 254.6299999999999954525264911353588104248046875, 255.69999999999998863131622783839702606201171875 ] } } }, "a496aea62829d000b6c9e48cf6119133a70311b8": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/pavillon_barcelone_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Pabellon Barcelona - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 84.5499999999999971578290569595992565155029296875, "raw_values": [ 84.150000000000005684341886080801486968994140625, 84.9500000000000028421709430404007434844970703125 ], "test_run_times": [ 84.81000000000000227373675443232059478759765625, 85.6200000000000045474735088646411895751953125 ] }, "b": { "value": 84.349999999999994315658113919198513031005859375, "raw_values": [ 84.2000000000000028421709430404007434844970703125, 84.4899999999999948840923025272786617279052734375 ], "test_run_times": [ 84.849999999999994315658113919198513031005859375, 85.18000000000000682121026329696178436279296875 ] }, "c": { "value": 84.1700000000000017053025658242404460906982421875, "raw_values": [ 84.1299999999999954525264911353588104248046875, 84.2099999999999937472239253111183643341064453125 ], "test_run_times": [ 84.780000000000001136868377216160297393798828125, 84.8700000000000045474735088646411895751953125 ] } } }, "8ea678615fa624d393004c9476f4ed32c0ddcea2": { "identifier": "pts\/cassandra-1.2.0", "title": "Apache Cassandra", "app_version": "4.1.3", "arguments": "WRITE", "description": "Test: Writes", "scale": "Op\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 236650, "raw_values": [ 237283, 236016 ], "test_run_times": [ 127.75, 127.31000000000000227373675443232059478759765625 ] }, "b": { "value": 238161, "raw_values": [ 238978, 237343 ], "test_run_times": [ 127.68000000000000682121026329696178436279296875, 127.2000000000000028421709430404007434844970703125 ] }, "c": { "value": 234887, "raw_values": [ 234218, 235556 ], "test_run_times": [ 127.719999999999998863131622783839702606201171875, 127.2000000000000028421709430404007434844970703125 ] } } }, "5e299ac9eb6dc8128090876199acb4affc6cec21": { "identifier": "pts\/brl-cad-1.5.0", "title": "BRL-CAD", "app_version": "7.36", "description": "VGR Performance Metric", "scale": "VGR Performance Metric", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 734386, "raw_values": [ 732580, 736191 ], "test_run_times": [ 780.759999999999990905052982270717620849609375, 661.700000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6" } } }, "b": { "value": 729876, "raw_values": [ 729518, 730233 ], "test_run_times": [ 739.1499999999999772626324556767940521240234375, 780.299999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6" } } }, "c": { "value": 730434, "raw_values": [ 731397, 729470 ], "test_run_times": [ 773.4099999999999681676854379475116729736328125, 778.69000000000005456968210637569427490234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6" } } } } } } }