extra tests

benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2310231-NE-EXTRATEST13
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

AV1 2 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 5 Tests
Creator Workloads 8 Tests
Database Test Suite 3 Tests
Encoding 3 Tests
Game Development 2 Tests
HPC - High Performance Computing 4 Tests
Java Tests 2 Tests
Machine Learning 2 Tests
Multi-Core 9 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 4 Tests
Renderers 2 Tests
Server 3 Tests
Server CPU Tests 4 Tests
Video Encoding 3 Tests
Common Workstation Benchmarks 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
RESET
October 23 2023
  6 Hours, 8 Minutes
RESET2
October 23 2023
  1 Hour, 18 Minutes
RESET3
October 23 2023
  5 Hours, 18 Minutes
Invert Hiding All Results Option
  4 Hours, 15 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "extra tests", "last_modified": "2023-10-24 00:58:49", "description": "benchmarks for a future article.", "systems": { "RESET": { "identifier": "RESET", "hardware": { "Processor": "AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores \/ 32 Threads)", "Motherboard": "Supermicro H13SSW (1.1 BIOS)", "Memory": "12 x 64 GB DDR5-4800MT\/s HMCG94MEBRA123N", "Disk": "2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07", "Graphics": "astdrmfb" }, "software": { "OS": "AlmaLinux 9.2", "Kernel": "5.14.0-284.25.1.el9_2.x86_64 (x86_64)", "Compiler": "GCC 11.3.1 20221121", "File-System": "ext4", "Screen Resolution": "1024x768" }, "timestamp": "2023-10-23 02:49:02", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=\/usr\/share\/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl", "cpu-scaling-governor": "acpi-cpufreq performance (Boost: Enabled)", "cpu-microcode": "0xa101111", "kernel-extra-details": "Transparent Huge Pages: always", "java": "OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)", "python": "Python 3.9.16", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "RESET2": { "identifier": "RESET2", "hardware": { "Processor": "AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores \/ 32 Threads)", "Motherboard": "Supermicro H13SSW (1.1 BIOS)", "Memory": "12 x 64 GB DDR5-4800MT\/s HMCG94MEBRA123N", "Disk": "2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07", "Graphics": "astdrmfb" }, "software": { "OS": "AlmaLinux 9.2", "Kernel": "5.14.0-284.25.1.el9_2.x86_64 (x86_64)", "Compiler": "GCC 11.3.1 20221121", "File-System": "ext4", "Screen Resolution": "1024x768" }, "timestamp": "2023-10-23 12:52:07", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=\/usr\/share\/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl", "cpu-scaling-governor": "acpi-cpufreq performance (Boost: Enabled)", "cpu-microcode": "0xa101111", "kernel-extra-details": "Transparent Huge Pages: always", "java": "OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)", "python": "Python 3.9.16", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "RESET3": { "identifier": "RESET3", "hardware": { "Processor": "AMD EPYC 9334 32-Core @ 2.70GHz (32 Cores \/ 64 Threads)", "Motherboard": "Supermicro H13SSW (1.1 BIOS)", "Memory": "12 x 64 GB DDR5-4800MT\/s HMCG94MEBRA123N", "Disk": "2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07", "Graphics": "astdrmfb", "Monitor": "DELL E207WFP" }, "software": { "OS": "AlmaLinux 9.2", "Kernel": "5.14.0-284.25.1.el9_2.x86_64 (x86_64)", "Compiler": "GCC 11.3.1 20221121", "File-System": "ext4", "Screen Resolution": "1680x1050" }, "timestamp": "2023-10-23 19:20:39", "client_version": "10.8.4", "data": { "compiler-configuration": "--build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=\/usr\/share\/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl", "cpu-scaling-governor": "acpi-cpufreq performance (Boost: Enabled)", "cpu-microcode": "0xa101111", "kernel-extra-details": "Transparent Huge Pages: always", "java": "OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)", "python": "Python 3.9.16", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "c670af39d68c729d38734ca6363acf2a2b16af89": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 50 -files 1000000", "description": "Operation: Open - Threads: 50 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 264831, "raw_values": [ 264830.508474580012261867523193359375 ], "test_run_times": [ 39.25999999999999801048033987171947956085205078125 ] }, "RESET3": { "value": 1256281, "raw_values": [ 1256281.40703519992530345916748046875 ], "test_run_times": [ 34.9500000000000028421709430404007434844970703125 ] } } }, "cb041086537a85d6df22ccc233ed408a96702616": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--malloc -1 --no-rand-seed", "description": "Test: Malloc", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 31210490.9100000001490116119384765625, "test_run_times": [ 30.550000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 137709065.86000001430511474609375, "test_run_times": [ 30.660000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "6663ade01a0ff502311fb25a4a939eb314f098d7": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 20 -files 1000000", "description": "Operation: File Status - Threads: 20 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1879699, "raw_values": [ 1879699.2481203000061213970184326171875 ], "test_run_times": [ 34.63000000000000255795384873636066913604736328125 ] }, "RESET3": { "value": 428816, "raw_values": [ 428816.4665523199946619570255279541015625 ], "test_run_times": [ 34.24000000000000198951966012828052043914794921875 ] } } }, "01c28b91a25b506aa8a5f97b0b209775da210668": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 50 -files 1000000", "description": "Operation: File Status - Threads: 50 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 593120, "raw_values": [ 593119.81020166003145277500152587890625 ], "test_run_times": [ 36.93999999999999772626324556767940521240234375 ] }, "RESET3": { "value": 1890359, "raw_values": [ 1890359.168242000043392181396484375 ], "test_run_times": [ 34.6700000000000017053025658242404460906982421875 ] } } }, "9546ccf2ee8b0879ffaa6db9ab0cbdb581e16ea6": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 500 -files 100000", "description": "Operation: File Status - Threads: 500 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 215517, "raw_values": [ 215517.24137930999859236180782318115234375 ], "test_run_times": [ 14.949999999999999289457264239899814128875732421875 ] }, "RESET3": { "value": 598802, "raw_values": [ 598802.39520957996137440204620361328125 ], "test_run_times": [ 13.980000000000000426325641456060111522674560546875 ] } } }, "2554cd561885706a23fe9fc5501b9dbbcf481a66": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 20 --ratio=1:100", "description": "Clients Per Thread: 20 - Set To Get Ratio: 1:100", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 9932666.11999999918043613433837890625, "test_run_times": [ 66.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 9367141.1999999992549419403076171875, "test_run_times": [ 66.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "value": 21025616.3000000007450580596923828125, "test_run_times": [ 67.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } } } }, "5ea64b6f5e083c46d6beb6bc34015363ab7cf13b": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--sem -1 --no-rand-seed", "description": "Test: Semaphores", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 42481788.679999999701976776123046875, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 92985304.75, "test_run_times": [ 30.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "de05856c29b5fccf0ccb9b92600c350ac42c622d": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 500 -files 1000000", "description": "Operation: File Status - Threads: 500 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1779359, "raw_values": [ 1779359.43060499988496303558349609375 ], "test_run_times": [ 38.28999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 816327, "raw_values": [ 816326.530612239963375031948089599609375 ], "test_run_times": [ 36.89999999999999857891452847979962825775146484375 ] } } }, "20cfb1e719a0f950989b9fb3bf17cce2082220e6": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--rdrand -1 --no-rand-seed", "description": "Test: x86_64 RdRand", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 6022050.429999999701976776123046875, "test_run_times": [ 30.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 12951786.68999999947845935821533203125, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "ed5303021383a899d4d7fd2f836890a59630b7d9": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--hash -1 --no-rand-seed", "description": "Test: Hash", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 3622490.5299999997951090335845947265625, "test_run_times": [ 30.129999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 7756366.799999999813735485076904296875, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "2d1b4d825553f48db9685c205ace0d0bbecc2575": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--vecshuf -1 --no-rand-seed", "description": "Test: Vector Shuffle", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 12554.84000000000014551915228366851806640625, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 26692.65999999999985448084771633148193359375, "test_run_times": [ 30.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "17975b39888cbb2510f4f74c461ce9cb6dab5fb4": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--cpu -1 --cpu-method all --no-rand-seed", "description": "Test: CPU Stress", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 41635.4300000000002910383045673370361328125, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 87949.710000000006402842700481414794921875, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "061bded68213a002cd7a12bb7a9d71fd77239065": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--fp -1 --no-rand-seed", "description": "Test: Floating Point", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5845.739999999999781721271574497222900390625, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 12241.129999999999199644662439823150634765625, "test_run_times": [ 30.059999999999998721023075631819665431976318359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "df293935a009e2c2ffe482dba5113c2b25ca2f7b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1591.1703999999999723513610661029815673828125, "test_run_times": [ 37.17999999999999971578290569595992565155029296875 ] }, "RESET2": { "value": 1588.204899999999952342477627098560333251953125, "test_run_times": [ 36.969999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 3312.51150000000006912159733474254608154296875, "test_run_times": [ 36.9500000000000028421709430404007434844970703125 ] } } }, "70d00df31a8a9a550c1dff4ebc9167830c4bea0e": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--poll -1 --no-rand-seed", "description": "Test: Poll", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 2214330.7799999997951090335845947265625, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 4603498.16999999992549419403076171875, "test_run_times": [ 30.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "2c92f6ef93dd08f2c0cb51796a9f3a8edb26a24a": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--funccall -1 --no-rand-seed", "description": "Test: Function Call", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 13421.190000000000509317032992839813232421875, "test_run_times": [ 30.059999999999998721023075631819665431976318359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 27709.79999999999927240423858165740966796875, "test_run_times": [ 30.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "b1fcda50039bc798d428e67f8a3d2c63353fdb0b": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 20 --ratio=1:10", "description": "Clients Per Thread: 20 - Set To Get Ratio: 1:10", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 10162330.85999999940395355224609375, "test_run_times": [ 66.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 9527420.8000000007450580596923828125, "test_run_times": [ 66.219999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "value": 19505101.2300000004470348358154296875, "test_run_times": [ 67.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } } } }, "38705419f3099859abe7c83283297da771f0e599": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 10 --ratio=1:10", "description": "Clients Per Thread: 10 - Set To Get Ratio: 1:10", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 8302009.41999999992549419403076171875, "test_run_times": [ 66.2399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 8584414.13000000081956386566162109375, "test_run_times": [ 66.2099999999999937472239253111183643341064453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "value": 16927170.4800000004470348358154296875, "test_run_times": [ 66.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } } } }, "052a56dda112d94f774312d929fb0117f42d63b4": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--zlib -1 --no-rand-seed", "description": "Test: Zlib", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1466.40000000000009094947017729282379150390625, "test_run_times": [ 30.379999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 2988.69000000000005456968210637569427490234375, "test_run_times": [ 30.25 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "afb5da000c88c92cc11225f21366fb1a1fd8f60f": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 50 --ratio=1:10", "description": "Clients Per Thread: 50 - Set To Get Ratio: 1:10", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 12469755.59999999962747097015380859375, "test_run_times": [ 67.25 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 11249348.9100000001490116119384765625, "test_run_times": [ 67.25 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "value": 22835296.8399999998509883880615234375, "test_run_times": [ 67.2399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } } } }, "52bc42bc9fc5b42341df43ab62801b95201fdc13": { "identifier": "pts\/embree-1.5.0", "title": "Embree", "app_version": "4.1", "arguments": "pathtracer -c crown\/crown.ecs", "description": "Binary: Pathtracer - Model: Crown", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 21.576200000000000045474735088646411895751953125, "min_result": [ "21.45" ], "max_result": [ "21.93" ], "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ] }, "RESET2": { "value": 21.42699999999999960209606797434389591217041015625, "min_result": [ "21.27" ], "max_result": [ "21.76" ], "test_run_times": [ 30.280000000000001136868377216160297393798828125 ] }, "RESET3": { "value": 43.3980999999999994543031789362430572509765625, "min_result": [ "42.87" ], "max_result": [ "44.59" ], "test_run_times": [ 15.1199999999999992184029906638897955417633056640625 ] } } }, "fba263fade4e645387cfa338b609a9838531a63f": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 240.376299999999986312104738317430019378662109375, "test_run_times": [ 52.719999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 486.727399999999988722265698015689849853515625, "test_run_times": [ 51.99000000000000198951966012828052043914794921875 ] } } }, "7a4c40872db747de6628900bdd6de28bf98dbc3d": { "identifier": "pts\/embree-1.5.0", "title": "Embree", "app_version": "4.1", "arguments": "pathtracer_ispc -c crown\/crown.ecs", "description": "Binary: Pathtracer ISPC - Model: Crown", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 22.67999999999999971578290569595992565155029296875, "min_result": [ "22.49" ], "max_result": [ "22.98" ], "test_run_times": [ 28.629999999999999005240169935859739780426025390625 ] }, "RESET2": { "value": 22.672899999999998499333742074668407440185546875, "min_result": [ "22.51" ], "max_result": [ "23.04" ], "test_run_times": [ 28.6400000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 45.67609999999999814690454513765871524810791015625, "min_result": [ "45.1" ], "max_result": [ "46.91" ], "test_run_times": [ 14.3599999999999994315658113919198513031005859375 ] } } }, "86ba9fff7f27b605f3bc0d98b860fab8f58f4e94": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 163.1825000000000045474735088646411895751953125, "test_run_times": [ 36.909999999999996589394868351519107818603515625 ] }, "RESET2": { "value": 162.9542999999999892679625190794467926025390625, "test_run_times": [ 37.24000000000000198951966012828052043914794921875 ] }, "RESET3": { "value": 327.96940000000000736690708436071872711181640625, "test_run_times": [ 37.090000000000003410605131648480892181396484375 ] } } }, "0ecd3fd90f51a32796ec6eaa16bbf44f503ba5c3": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 163.08490000000000463842297904193401336669921875, "test_run_times": [ 37.39999999999999857891452847979962825775146484375 ] }, "RESET3": { "value": 327.78910000000001900843926705420017242431640625, "test_run_times": [ 37.28999999999999914734871708787977695465087890625 ] } } }, "8d99b93bece0c44e909a0074606b87f40db38f6c": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 50 --ratio=1:100", "description": "Clients Per Thread: 50 - Set To Get Ratio: 1:100", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 11746361.86999999918043613433837890625, "test_run_times": [ 67.25 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 12138788.9499999992549419403076171875, "test_run_times": [ 67.2600000000000051159076974727213382720947265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "value": 23607335.0100000016391277313232421875, "test_run_times": [ 67.2399999999999948840923025272786617279052734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } } } }, "04dc16cdb3e5ac095dfb8d008bb8116fa6ac559a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 71.84399999999999408828443847596645355224609375, "test_run_times": [ 37.67999999999999971578290569595992565155029296875 ] }, "RESET2": { "value": 72.1606000000000022964741219766438007354736328125, "test_run_times": [ 37.60000000000000142108547152020037174224853515625 ] }, "RESET3": { "value": 143.76929999999998699422576464712619781494140625, "test_run_times": [ 37.67999999999999971578290569595992565155029296875 ] } } }, "eb33f1cc5166af47c25ece88950cbede51436a22": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--memcpy -1 --no-rand-seed", "description": "Test: Memory Copying", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7269.1999999999998181010596454143524169921875, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 14537.110000000000582076609134674072265625, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "7152c6019287629777f677b176930e9016e2f654": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--switch -1 --no-rand-seed", "description": "Test: Context Switching", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 10072239.6600000001490116119384765625, "test_run_times": [ 30.120000000000000994759830064140260219573974609375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 20135718.92000000178813934326171875, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "e3db567bc996ec9c93114c7c9578e9f0b9adfa65": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--crypt -1 --no-rand-seed", "description": "Test: Crypto", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 39959.41000000000349245965480804443359375, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 79692.919999999998253770172595977783203125, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "33b9489f8519e53fc10cce34d84394a5ca653816": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 72.733599999999995588950696401298046112060546875, "test_run_times": [ 37.68999999999999772626324556767940521240234375 ] }, "RESET3": { "value": 145.01429999999999154169927351176738739013671875, "test_run_times": [ 37.61999999999999744204615126363933086395263671875 ] } } }, "fda054757e37af2f52c795e2ea4c6a8f9737f907": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--str -1 --no-rand-seed", "description": "Test: Glibc C String Functions", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 19957308.600000001490116119384765625, "test_run_times": [ 30.120000000000000994759830064140260219573974609375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 39779508.189999997615814208984375, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "fcb6b4454075a22273515d3b2208b63a8e4576e0": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--tree -1 --tree-method avl --no-rand-seed", "description": "Test: AVL Tree", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 205.06999999999999317878973670303821563720703125, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 407.92000000000001591615728102624416351318359375, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "baff18ee56137338b81c500dab60fff22ca5d02c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 16.15690000000000026147972675971686840057373046875, "test_run_times": [ 98.1200000000000045474735088646411895751953125 ] }, "RESET3": { "value": 32.0656000000000034333424991928040981292724609375, "test_run_times": [ 97.659999999999996589394868351519107818603515625 ] } } }, "898ab5f8006f162a67c2ed1a14d2505eb1d4f718": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 10 --ratio=1:100", "description": "Clients Per Thread: 10 - Set To Get Ratio: 1:100", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 8637294.179999999701976776123046875, "test_run_times": [ 66.2000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 8951592.93999999947845935821533203125, "test_run_times": [ 66.2000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "value": 17116522.17000000178813934326171875, "test_run_times": [ 66.159999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } } } }, "83ed68ebf3a3a3b2b9436b45ecb77f255be36c9b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 109.08129999999999881765688769519329071044921875, "test_run_times": [ 38.93999999999999772626324556767940521240234375 ] }, "RESET3": { "value": 215.918499999999994543031789362430572509765625, "test_run_times": [ 38.840000000000003410605131648480892181396484375 ] } } }, "484ed76c1448ae8277be5d38b413682792d37712": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 505.27969999999999117790139280259609222412109375, "test_run_times": [ 48.93999999999999772626324556767940521240234375 ] }, "RESET2": { "value": 505.4125999999999976353137753903865814208984375, "test_run_times": [ 49.4500000000000028421709430404007434844970703125 ] }, "RESET3": { "value": 999.0564000000000532963895238935947418212890625, "test_run_times": [ 49.32000000000000028421709430404007434844970703125 ] } } }, "52650ab3f436f830a03f98d18570a098bc6a7a3b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario async", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 257.5670000000000072759576141834259033203125, "test_run_times": [ 40.63000000000000255795384873636066913604736328125 ] }, "RESET2": { "value": 257.39499999999998181010596454143524169921875, "test_run_times": [ 41.090000000000003410605131648480892181396484375 ] }, "RESET3": { "value": 508.34480000000002064552973024547100067138671875, "test_run_times": [ 41.42999999999999971578290569595992565155029296875 ] } } }, "8315d249c45b31a380a71ef2c000db2e666a90bd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 13.13700000000000045474735088646411895751953125, "test_run_times": [ 47.840000000000003410605131648480892181396484375 ] }, "RESET2": { "value": 13.0345999999999992979837770690210163593292236328125, "test_run_times": [ 47.71000000000000085265128291212022304534912109375 ] }, "RESET3": { "value": 25.699999999999999289457264239899814128875732421875, "test_run_times": [ 47.61999999999999744204615126363933086395263671875 ] } } }, "20c1c51e2bfbc591aaabf47cf063228f6ada73fd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 55.53540000000000276259015663526952266693115234375, "test_run_times": [ 47.56000000000000227373675443232059478759765625 ] }, "RESET3": { "value": 109.2793999999999954297891235910356044769287109375, "test_run_times": [ 47.13000000000000255795384873636066913604736328125 ] } } }, "ae0eb01689f3661bfb3f5549d4f6a3b68092849c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 13.102399999999999380406734417192637920379638671875, "test_run_times": [ 47.11999999999999744204615126363933086395263671875 ] }, "RESET3": { "value": 25.721800000000001773514668457210063934326171875, "test_run_times": [ 47.50999999999999801048033987171947956085205078125 ] } } }, "31900b48c41cf5d9d4bb8d9fd1203b3d04d2ccf9": { "identifier": "pts\/embree-1.5.0", "title": "Embree", "app_version": "4.1", "arguments": "pathtracer -c asian_dragon_obj\/asian_dragon.ecs", "description": "Binary: Pathtracer - Model: Asian Dragon Obj", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 22.24810000000000087538865045644342899322509765625, "min_result": [ "22.17" ], "max_result": [ "22.47" ], "test_run_times": [ 37.77000000000000312638803734444081783294677734375 ] }, "RESET2": { "value": 22.19460000000000121644916362129151821136474609375, "min_result": [ "22.12" ], "max_result": [ "22.35" ], "test_run_times": [ 37.8599999999999994315658113919198513031005859375 ] }, "RESET3": { "value": 43.51469999999999771489456179551780223846435546875, "min_result": [ "43.25" ], "max_result": [ "44.05" ], "test_run_times": [ 23.339999999999999857891452847979962825775146484375 ] } } }, "72548d1d3fe968838db72e9de4ac76ea43462462": { "identifier": "pts\/embree-1.5.0", "title": "Embree", "app_version": "4.1", "arguments": "pathtracer_ispc -c asian_dragon_obj\/asian_dragon.ecs", "description": "Binary: Pathtracer ISPC - Model: Asian Dragon Obj", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 23.83310000000000172803993336856365203857421875, "min_result": [ "23.74" ], "max_result": [ "24.04" ], "test_run_times": [ 35.969999999999998863131622783839702606201171875 ] }, "RESET2": { "value": 23.92490000000000094360075308941304683685302734375, "min_result": [ "23.83" ], "max_result": [ "24.22" ], "test_run_times": [ 35.8900000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 46.46220000000000283080225926823914051055908203125, "min_result": [ "46.18" ], "max_result": [ "47.04" ], "test_run_times": [ 22.370000000000000994759830064140260219573974609375 ] } } }, "f3503c240b61e21a781e05948a4fb23ef30eac3d": { "identifier": "pts\/ospray-2.12.0", "title": "OSPRay", "app_version": "2.12", "arguments": "--benchmark_filter=gravity_spheres_volume\/dim_512\/ao\/real_time", "description": "Benchmark: gravity_spheres_volume\/dim_512\/ao\/real_time", "scale": "Items Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5.61038000000000014466650100075639784336090087890625, "test_run_times": [ 67.1200000000000045474735088646411895751953125 ] }, "RESET2": { "value": 5.60813999999999968082420309656299650669097900390625, "test_run_times": [ 67.1099999999999994315658113919198513031005859375 ] }, "RESET3": { "value": 10.9153000000000002245315045001916587352752685546875, "test_run_times": [ 56.99000000000000198951966012828052043914794921875 ] } } }, "4ba06e1a0b64c8c0f4a4cad0e4eacd63a99a7041": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 64 -b 256 -f 32", "description": "Threads: 64 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1056400000, "test_run_times": [ 30.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 1056700000, "test_run_times": [ 30.10000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 2053800000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "271eecda32c87461e61b67c400410acd85220428": { "identifier": "pts\/ospray-2.12.0", "title": "OSPRay", "app_version": "2.12", "arguments": "--benchmark_filter=gravity_spheres_volume\/dim_512\/scivis\/real_time", "description": "Benchmark: gravity_spheres_volume\/dim_512\/scivis\/real_time", "scale": "Items Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5.465270000000000294448909698985517024993896484375, "test_run_times": [ 67.8900000000000005684341886080801486968994140625 ] }, "RESET2": { "value": 5.44882000000000044082071326556615531444549560546875, "test_run_times": [ 67.7600000000000051159076974727213382720947265625 ] }, "RESET3": { "value": 10.5907999999999997697841536137275397777557373046875, "test_run_times": [ 57.27000000000000312638803734444081783294677734375 ] } } }, "d7a2430e1fdeff0cbadf25024a877f19794ef1a6": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--mmap -1 --no-rand-seed", "description": "Test: MMAP", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 297.29000000000002046363078989088535308837890625, "test_run_times": [ 30.629999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 577.779999999999972715158946812152862548828125, "test_run_times": [ 30.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "b9117dc1a8560333ed4d7767063550b906fce898": { "identifier": "pts\/embree-1.5.0", "title": "Embree", "app_version": "4.1", "arguments": "pathtracer -c asian_dragon\/asian_dragon.ecs", "description": "Binary: Pathtracer - Model: Asian Dragon", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 24.814299999999999357669366872869431972503662109375, "min_result": [ "24.73" ], "max_result": [ "25.07" ], "test_run_times": [ 26.17999999999999971578290569595992565155029296875 ] }, "RESET2": { "value": 24.8241000000000013869794202037155628204345703125, "min_result": [ "24.74" ], "max_result": [ "24.99" ], "test_run_times": [ 26.14999999999999857891452847979962825775146484375 ] }, "RESET3": { "value": 48.1475999999999970668795867823064327239990234375, "min_result": [ "47.9" ], "max_result": [ "48.87" ], "test_run_times": [ 13.6400000000000005684341886080801486968994140625 ] } } }, "d7bec6d7bca28043ef7a4ec24ffbafb5fa9d7cae": { "identifier": "pts\/ospray-2.12.0", "title": "OSPRay", "app_version": "2.12", "arguments": "--benchmark_filter=particle_volume\/ao\/real_time", "description": "Benchmark: particle_volume\/ao\/real_time", "scale": "Items Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5.5677000000000003154809746774844825267791748046875, "test_run_times": [ 120.3599999999999994315658113919198513031005859375 ] }, "RESET2": { "value": 5.571130000000000137561073643155395984649658203125, "test_run_times": [ 120.2300000000000039790393202565610408782958984375 ] }, "RESET3": { "value": 10.7934999999999998721023075631819665431976318359375, "test_run_times": [ 103.0199999999999960209606797434389591217041015625 ] } } }, "2a31ae0634dbb96a7c2974d1e2dec7f88f0b1468": { "identifier": "pts\/ospray-2.12.0", "title": "OSPRay", "app_version": "2.12", "arguments": "--benchmark_filter=particle_volume\/scivis\/real_time", "description": "Benchmark: particle_volume\/scivis\/real_time", "scale": "Items Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5.56275000000000030553337637684307992458343505859375, "test_run_times": [ 169.729999999999989768184605054557323455810546875 ] }, "RESET2": { "value": 5.5595499999999997697841536137275397777557373046875, "test_run_times": [ 169.789999999999992041921359486877918243408203125 ] }, "RESET3": { "value": 10.754200000000000869704308570362627506256103515625, "test_run_times": [ 151.020000000000010231815394945442676544189453125 ] } } }, "a6f79cb479021f303e5383b047b4c484b249cfe2": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario async", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 70.922100000000000363797880709171295166015625, "test_run_times": [ 41.14999999999999857891452847979962825775146484375 ] }, "RESET2": { "value": 71.142300000000005866240826435387134552001953125, "test_run_times": [ 41.50999999999999801048033987171947956085205078125 ] }, "RESET3": { "value": 136.89199999999999590727384202182292938232421875, "test_run_times": [ 42.50999999999999801048033987171947956085205078125 ] } } }, "65c91f08811178714d8504fd3594268a349d8d98": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--sock -1 --no-rand-seed --sock-zerocopy", "description": "Test: Socket Activity", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 10472.149999999999636202119290828704833984375, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 20183.09000000000014551915228366851806640625, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "9307cbab69d1353d248cf9775eedd5d20eef793e": { "identifier": "pts\/embree-1.5.0", "title": "Embree", "app_version": "4.1", "arguments": "pathtracer_ispc -c asian_dragon\/asian_dragon.ecs", "description": "Binary: Pathtracer ISPC - Model: Asian Dragon", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 28.286799999999999499777914024889469146728515625, "min_result": [ "28.19" ], "max_result": [ "28.56" ], "test_run_times": [ 23 ] }, "RESET2": { "value": 28.41590000000000060254023992456495761871337890625, "min_result": [ "28.3" ], "max_result": [ "28.73" ], "test_run_times": [ 22.8900000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 54.501800000000002910383045673370361328125, "min_result": [ "54.24" ], "max_result": [ "54.99" ], "test_run_times": [ 12.0600000000000004973799150320701301097869873046875 ] } } }, "4a6fa7a8b3679b981efd8457ed37e9f3d1dc5d74": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 24.4932000000000016370904631912708282470703125, "test_run_times": [ 48.5799999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 47.15050000000000096633812063373625278472900390625, "test_run_times": [ 49.32000000000000028421709430404007434844970703125 ] } } }, "5e299ac9eb6dc8128090876199acb4affc6cec21": { "identifier": "pts\/brl-cad-1.5.0", "title": "BRL-CAD", "app_version": "7.36", "description": "VGR Performance Metric", "scale": "VGR Performance Metric", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 295626, "test_run_times": [ 779.44000000000005456968210637569427490234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6" } } }, "RESET3": { "value": 569090, "test_run_times": [ 627.8899999999999863575794734060764312744140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6" } } } } }, "e89ab32d7cd1077b429f68a8a32ad69b37e4a8e2": { "identifier": "pts\/oidn-2.0.0", "title": "Intel Open Image Denoise", "app_version": "2.0", "arguments": "-r RT.ldr_alb_nrm.3840x2160 -d cpu", "description": "Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only", "scale": "Images \/ Sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 0.7199999999999999733546474089962430298328399658203125, "raw_values": [ 0.72036248640316002944672391095082275569438934326171875 ], "test_run_times": [ 27.949999999999999289457264239899814128875732421875 ] }, "RESET2": { "value": 0.7199999999999999733546474089962430298328399658203125, "raw_values": [ 0.72002534489213998458723153817118145525455474853515625 ], "test_run_times": [ 27.96000000000000085265128291212022304534912109375 ] }, "RESET3": { "value": 1.37999999999999989341858963598497211933135986328125, "raw_values": [ 1.3761859282236998947013262295513413846492767333984375 ], "test_run_times": [ 14.7200000000000006394884621840901672840118408203125 ] } } }, "0521c28879f273d525d399f25422fa83934e721a": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--numa -1 --no-rand-seed", "description": "Test: NUMA", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 664.8700000000000045474735088646411895751953125, "test_run_times": [ 30.059999999999998721023075631819665431976318359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 1272.740000000000009094947017729282379150390625, "test_run_times": [ 30.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "6d54d50e9932b6bd7234f873c1e8ca83e1267b89": { "identifier": "pts\/oidn-2.0.0", "title": "Intel Open Image Denoise", "app_version": "2.0", "arguments": "-r RTLightmap.hdr.4096x4096 -d cpu", "description": "Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only", "scale": "Images \/ Sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 0.340000000000000024424906541753443889319896697998046875, "raw_values": [ 0.34098154948836001398859707478550262749195098876953125 ], "test_run_times": [ 58.78999999999999914734871708787977695465087890625 ] }, "RESET2": { "value": 0.340000000000000024424906541753443889319896697998046875, "raw_values": [ 0.34102806319931999734507144239614717662334442138671875 ], "test_run_times": [ 58.78999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 0.65000000000000002220446049250313080847263336181640625, "raw_values": [ 0.65120277151899996770367806675494648516178131103515625 ], "test_run_times": [ 30.839999999999999857891452847979962825775146484375 ] } } }, "183e901ae00912487a56d83fffbd8270c582ca7a": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/barbershop_interior_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Barbershop - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 670.7100000000000363797880709171295166015625, "test_run_times": [ 672.240000000000009094947017729282379150390625 ] }, "RESET3": { "value": 351.79000000000002046363078989088535308837890625, "test_run_times": [ 353.06000000000000227373675443232059478759765625 ] } } }, "77824117f44a6cd2eb1178cc90fba84a54a146f1": { "identifier": "pts\/oidn-2.0.0", "title": "Intel Open Image Denoise", "app_version": "2.0", "arguments": "-r RT.hdr_alb_nrm.3840x2160 -d cpu", "description": "Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only", "scale": "Images \/ Sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 0.7199999999999999733546474089962430298328399658203125, "raw_values": [ 0.71892276612724004269949773515691049396991729736328125 ], "test_run_times": [ 28 ] }, "RESET2": { "value": 0.7199999999999999733546474089962430298328399658203125, "raw_values": [ 0.718995132402949987948659327230416238307952880859375 ], "test_run_times": [ 28 ] }, "RESET3": { "value": 1.37000000000000010658141036401502788066864013671875, "raw_values": [ 1.3743720837541999468811582119087688624858856201171875 ], "test_run_times": [ 14.75 ] } } }, "ad2b308316b6b785ff3d7fd0bf79041221d196ba": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--vecfp -1 --no-rand-seed", "description": "Test: Vector Floating Point", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 53844.4800000000032014213502407073974609375, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 102433.039999999993597157299518585205078125, "test_run_times": [ 30.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "cf6994179c89cfea6b8cf843144b1d9b65cad952": { "identifier": "pts\/ospray-2.12.0", "title": "OSPRay", "app_version": "2.12", "arguments": "--benchmark_filter=gravity_spheres_volume\/dim_512\/pathtracer\/real_time", "description": "Benchmark: gravity_spheres_volume\/dim_512\/pathtracer\/real_time", "scale": "Items Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 6.60071000000000029928060030215419828891754150390625, "test_run_times": [ 64.1400000000000005684341886080801486968994140625 ] }, "RESET2": { "value": 6.5866600000000001813305061659775674343109130859375, "test_run_times": [ 64.2300000000000039790393202565610408782958984375 ] }, "RESET3": { "value": 12.50750000000000028421709430404007434844970703125, "test_run_times": [ 55.780000000000001136868377216160297393798828125 ] } } }, "a496aea62829d000b6c9e48cf6119133a70311b8": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/pavillon_barcelone_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Pabellon Barcelona - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 223.599999999999994315658113919198513031005859375, "test_run_times": [ 224.1299999999999954525264911353588104248046875 ] }, "RESET3": { "value": 119.18999999999999772626324556767940521240234375, "test_run_times": [ 119.68999999999999772626324556767940521240234375 ] } } }, "1710da1a6a17558c0a6c22da9c1ba8080bc18fe4": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--vecmath -1 --no-rand-seed", "description": "Test: Vector Math", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 117532.1900000000023283064365386962890625, "test_run_times": [ 30.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 219207.6799999999930150806903839111328125, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "588a47d7b846a429886849ab34c1b1b922e347e1": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/fishy_cat_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Fishy Cat - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 90.4599999999999937472239253111183643341064453125, "test_run_times": [ 91.0799999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 48.67999999999999971578290569595992565155029296875, "test_run_times": [ 49.28999999999999914734871708787977695465087890625 ] } } }, "90524f99f4ceae248cfe06da54288e10164efde2": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--qsort -1 --no-rand-seed", "description": "Test: Glibc Qsort Data Sorting", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 463.1100000000000136424205265939235687255859375, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 858.220000000000027284841053187847137451171875, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "351f556195f128aec13f5c66c67fbf70f78ab21a": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/bmw27_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: BMW27 - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 71.8900000000000005684341886080801486968994140625, "test_run_times": [ 72.2300000000000039790393202565610408782958984375 ] }, "RESET3": { "value": 38.909999999999996589394868351519107818603515625, "test_run_times": [ 39.3599999999999994315658113919198513031005859375 ] } } }, "ea8e61cb29f178f7b4678470221feb6f38974a41": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--fma -1 --no-rand-seed", "description": "Test: Fused Multiply-Add", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 16158855.40000000037252902984619140625, "test_run_times": [ 30.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 29786647.25, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "249680fc2a695f2bef760c8b6eb004a79684cd53": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--vecwide -1 --no-rand-seed", "description": "Test: Wide Vector Math", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 772551.48999999999068677425384521484375, "test_run_times": [ 30.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 1424072.34000000008381903171539306640625, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "2c548f2af84ef1dbd95bf756cd644be502a7f366": { "identifier": "pts\/blender-3.6.0", "title": "Blender", "app_version": "3.6", "arguments": "-b ..\/classroom_gpu.blend -o output.test -x 1 -F JPEG -f 1 -- --cycles-device CPU", "description": "Blend File: Classroom - Compute: CPU-Only", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 183.1100000000000136424205265939235687255859375, "test_run_times": [ 183.419999999999987494447850622236728668212890625 ] }, "RESET3": { "value": 99.349999999999994315658113919198513031005859375, "test_run_times": [ 99.6700000000000017053025658242404460906982421875 ] } } }, "35d367bc1cf6aa3e5ab6f02a65dec10fb7d79268": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--matrix -1 --no-rand-seed", "description": "Test: Matrix Math", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 87537.460000000006402842700481414794921875, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 160597.82999999998719431459903717041015625, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "9d8aeac1a6f6465847f0233f43d301465302d925": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--pipe -1 --no-rand-seed", "description": "Test: Pipe", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 13860878.0899999998509883880615234375, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 25368697.899999998509883880615234375, "test_run_times": [ 30.14999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "f12db41a92b6424abded4080ffce5f7f56c5e0c0": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--vnni -1", "description": "Test: AVX-512 VNNI", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1851108.7700000000186264514923095703125, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 3384972.4399999999441206455230712890625, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "012b8a85f6a8fcc5de04ddd5c0dac405489ff52d": { "identifier": "pts\/specfem3d-1.0.0", "title": "SPECFEM3D", "app_version": "4.0", "arguments": "Mount_StHelens", "description": "Model: Mount St. Helens", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 27.1059134999999997717168298549950122833251953125, "test_run_times": [ 30.940000000000001278976924368180334568023681640625 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET2": { "value": 26.340764967999998447112375288270413875579833984375, "test_run_times": [ 30.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET3": { "value": 14.862106087000000798070686869323253631591796875, "test_run_times": [ 18.96000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } } } }, "eaff32f7726539ae9ccfcb9fc3eb53b0c05e2f73": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 64 -b 256 -f 512", "description": "Threads: 64 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 282490000, "test_run_times": [ 30.309999999999998721023075631819665431976318359375 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 282060000, "test_run_times": [ 30.300000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 510160000, "test_run_times": [ 30.21000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "1ab9ac03c763525745a7dbd27a09ed2a46a84609": { "identifier": "pts\/specfem3d-1.0.0", "title": "SPECFEM3D", "app_version": "4.0", "arguments": "tomographic_model", "description": "Model: Tomographic Model", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 27.094676107000001508140485384501516819000244140625, "test_run_times": [ 31.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET2": { "value": 27.37365288699999865684731048531830310821533203125, "test_run_times": [ 31.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET3": { "value": 15.275376628000000067686414695344865322113037109375, "test_run_times": [ 19.620000000000000994759830064140260219573974609375 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } } } }, "3c57eba0b1738a72717e08ba85ec7daf504891f8": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 69.631200000000006866684998385608196258544921875, "test_run_times": [ 37.52000000000000312638803734444081783294677734375 ] }, "RESET3": { "value": 124.3654999999999972715158946812152862548828125, "test_run_times": [ 37.36999999999999744204615126363933086395263671875 ] } } }, "f3f5d4a6329a80736dc12cdd5b3481b3696bb5af": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 14.355000000000000426325641456060111522674560546875, "test_run_times": [ 37.52000000000000312638803734444081783294677734375 ] }, "RESET3": { "value": 8.0374999999999996447286321199499070644378662109375, "test_run_times": [ 37.36999999999999744204615126363933086395263671875 ] } } }, "3ea521b4ea3cea9e8083eb484343bbfff1cd5891": { "identifier": "pts\/specfem3d-1.0.0", "title": "SPECFEM3D", "app_version": "4.0", "arguments": "homogeneous_halfspace", "description": "Model: Homogeneous Halfspace", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 35.6787491420000009156865417025983333587646484375, "test_run_times": [ 40.159999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET2": { "value": 35.3200258910000002288143150508403778076171875, "test_run_times": [ 39.82000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET3": { "value": 20.00627169399999871757245273329317569732666015625, "test_run_times": [ 24.5799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } } } }, "b15e2cdef9f8dae62220fd77b33538b51c63d2ef": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 14.42530000000000001136868377216160297393798828125, "test_run_times": [ 37.5 ] }, "RESET3": { "value": 8.11110000000000042064129956997931003570556640625, "test_run_times": [ 37.469999999999998863131622783839702606201171875 ] } } }, "2f6b21ec02b77d2f7af4ef1858ff7a5c06cd9522": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 69.273899999999997589839040301740169525146484375, "test_run_times": [ 37.5 ] }, "RESET3": { "value": 123.1967000000000069803718361072242259979248046875, "test_run_times": [ 37.469999999999998863131622783839702606201171875 ] } } }, "b1499f6b4e88c6caecffc43156a95d1043ff44ed": { "identifier": "pts\/specfem3d-1.0.0", "title": "SPECFEM3D", "app_version": "4.0", "arguments": "layered_halfspace", "description": "Model: Layered Halfspace", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 69.7419955130000062126782722771167755126953125, "test_run_times": [ 74.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET2": { "value": 69.1824229040000062695980886928737163543701171875, "test_run_times": [ 73.8799999999999954525264911353588104248046875 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET3": { "value": 39.27637257800000014640318113379180431365966796875, "test_run_times": [ 44.25999999999999801048033987171947956085205078125 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } } } }, "4dd1fc7ebf988ed8441defddd8eb70c4ece07b6c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 20.506099999999999994315658113919198513031005859375, "test_run_times": [ 39.6700000000000017053025658242404460906982421875 ] }, "RESET2": { "value": 20.474900000000001654143488849513232707977294921875, "test_run_times": [ 40 ] }, "RESET3": { "value": 11.5649999999999995026200849679298698902130126953125, "test_run_times": [ 39.68999999999999772626324556767940521240234375 ] } } }, "01eed3a4e5b49dd8ffb4613c1e496b5c6a35b6d2": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 48.74680000000000035242919693700969219207763671875, "test_run_times": [ 39.6700000000000017053025658242404460906982421875 ] }, "RESET2": { "value": 48.8205999999999988858689903281629085540771484375, "test_run_times": [ 40 ] }, "RESET3": { "value": 86.4111999999999937926986603997647762298583984375, "test_run_times": [ 39.68999999999999772626324556767940521240234375 ] } } }, "d2e98348c1ee417aeb8fab2854f0cb98340ad6f0": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_read_write 256", "description": "Test: oltp_read_write - Threads: 256", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 62965, "raw_values": [ 62965.4599999999991268850862979888916015625 ], "test_run_times": [ 608.3799999999999954525264911353588104248046875 ] }, "RESET3": { "value": 111354, "raw_values": [ 111354.229999999995925463736057281494140625 ], "test_run_times": [ 595.6299999999999954525264911353588104248046875 ] } } }, "3aecabc01c6da7b07fa8d371c030a823b4b05ff5": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 64 -b 256 -f 57", "description": "Threads: 64 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1100900000, "test_run_times": [ 30.190000000000001278976924368180334568023681640625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 1098600000, "test_run_times": [ 30.129999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 1911400000, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "b07153da5d2186a2c4af44a41f728a2bb4ce2122": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 68.03260000000000218278728425502777099609375, "test_run_times": [ 44.8599999999999994315658113919198513031005859375 ] }, "RESET2": { "value": 68.3817999999999983629095368087291717529296875, "test_run_times": [ 45.3299999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 39.464100000000001955413608811795711517333984375, "test_run_times": [ 44.96000000000000085265128291212022304534912109375 ] } } }, "3b1bfb7814177424418483748f806f392d017eb6": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 14.6974999999999997868371792719699442386627197265625, "test_run_times": [ 44.8599999999999994315658113919198513031005859375 ] }, "RESET2": { "value": 14.6225000000000004973799150320701301097869873046875, "test_run_times": [ 45.3299999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 25.3359999999999985220711096189916133880615234375, "test_run_times": [ 44.96000000000000085265128291212022304534912109375 ] } } }, "5338300038b8dfdcff4dbbb4467411012e1eda2a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 68.084599999999994679455994628369808197021484375, "test_run_times": [ 45.28999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 39.3076999999999969759301166050136089324951171875, "test_run_times": [ 44.659999999999996589394868351519107818603515625 ] } } }, "523cc885ff74f9e08d52648fa01d46136540daeb": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 14.6865000000000005542233338928781449794769287109375, "test_run_times": [ 45.28999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 25.4365999999999985448084771633148193359375, "test_run_times": [ 44.659999999999996589394868351519107818603515625 ] } } }, "8e486ecd6f9817231cd10cd2c0cad2dfe8694dc5": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 56.28999999999999914734871708787977695465087890625, "test_run_times": [ 90.719999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 32.8273999999999972487785271368920803070068359375, "test_run_times": [ 87.8599999999999994315658113919198513031005859375 ] } } }, "040da5621f340d57abe8e4592fecbcda224b19fc": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 17.76310000000000144382283906452357769012451171875, "test_run_times": [ 90.719999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 30.45609999999999928377292235381901264190673828125, "test_run_times": [ 87.8599999999999994315658113919198513031005859375 ] } } }, "a7bb214b190a7ecc900abc3b5a245a6c4945283f": { "identifier": "pts\/specfem3d-1.0.0", "title": "SPECFEM3D", "app_version": "4.0", "arguments": "waterlayered_halfspace", "description": "Model: Water-layered Halfspace", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 64.31798313699999880554969422519207000732421875, "test_run_times": [ 70.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET2": { "value": 63.1980537820000023430111468769609928131103515625, "test_run_times": [ 69.2300000000000039790393202565610408782958984375 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } }, "RESET3": { "value": 37.54996530999999748701156931929290294647216796875, "test_run_times": [ 43.280000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "F9X", "compiler": "gfortran", "compiler-options": "-O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi" } } } } }, "e8de0c46b41f1adfb9255798765a2be9068f2eb5": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 100 -files 100000", "description": "Operation: Open - Threads: 100 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 305810, "raw_values": [ 305810.3975535199861042201519012451171875 ], "test_run_times": [ 14.6899999999999995026200849679298698902130126953125 ] }, "RESET3": { "value": 518135, "raw_values": [ 518134.7150259100017137825489044189453125 ], "test_run_times": [ 13.7799999999999993605115378159098327159881591796875 ] } } }, "d5f4c34cf97f4b43701c431d0f2fca791d2c34d8": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--fork -1 --no-rand-seed", "description": "Test: Forking", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 32071.18999999999869032762944698333740234375, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 54137.33999999999650754034519195556640625, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "8ea678615fa624d393004c9476f4ed32c0ddcea2": { "identifier": "pts\/cassandra-1.2.0", "title": "Apache Cassandra", "app_version": "4.1.3", "arguments": "WRITE", "description": "Test: Writes", "scale": "Op\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 194642, "test_run_times": [ 127.2999999999999971578290569595992565155029296875 ] }, "RESET3": { "value": 318052, "test_run_times": [ 127 ] } } }, "9cdcd82c9c47af9df17263e4312f634338dbf476": { "identifier": "pts\/build-linux-kernel-1.15.0", "title": "Timed Linux Kernel Compilation", "app_version": "6.1", "arguments": "defconfig", "description": "Build: defconfig", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 55.15899999999999891997504164464771747589111328125, "test_run_times": [ 55.159999999999996589394868351519107818603515625 ] }, "RESET2": { "value": 55.21000000000000085265128291212022304534912109375, "test_run_times": [ 55.21000000000000085265128291212022304534912109375 ] }, "RESET3": { "value": 33.90400000000000346744855050928890705108642578125, "test_run_times": [ 33.89999999999999857891452847979962825775146484375 ] } } }, "4664e14072f334baaf25491b527041f5fafcd524": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 50 -files 100000", "description": "Operation: File Status - Threads: 50 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 476190, "raw_values": [ 476190.4761904799961484968662261962890625 ], "test_run_times": [ 14.339999999999999857891452847979962825775146484375 ] }, "RESET3": { "value": 769231, "raw_values": [ 769230.76923076994717121124267578125 ], "test_run_times": [ 13.8100000000000004973799150320701301097869873046875 ] } } }, "82f44cc7280eea070a5243bbcdd819ead21bdb49": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 38.5655000000000001136868377216160297393798828125, "test_run_times": [ 43.1099999999999994315658113919198513031005859375 ] }, "RESET3": { "value": 23.9806999999999987949195201508700847625732421875, "test_run_times": [ 41.25999999999999801048033987171947956085205078125 ] } } }, "0d3e0460c5932505654a7338c7b258bafeb733b0": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 25.91929999999999978399500832892954349517822265625, "test_run_times": [ 43.1099999999999994315658113919198513031005859375 ] }, "RESET3": { "value": 41.6732999999999975671016727574169635772705078125, "test_run_times": [ 41.25999999999999801048033987171947956085205078125 ] } } }, "e8775641ef6f3b2dd8eb94255569a4c904cb09e8": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 143.261899999999997135091689415276050567626953125, "test_run_times": [ 36.75 ] }, "RESET2": { "value": 143.333300000000008367351256310939788818359375, "test_run_times": [ 37.02000000000000312638803734444081783294677734375 ] }, "RESET3": { "value": 229.693500000000000227373675443232059478759765625, "test_run_times": [ 36.86999999999999744204615126363933086395263671875 ] } } }, "4c7a3e0f5a69b82a2dc52c3ee1b43e3a8fc5abbd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 6.97299999999999986499688020558096468448638916015625, "test_run_times": [ 36.75 ] }, "RESET2": { "value": 6.96929999999999960635932438890449702739715576171875, "test_run_times": [ 37.02000000000000312638803734444081783294677734375 ] }, "RESET3": { "value": 4.34940000000000015489831639570184051990509033203125, "test_run_times": [ 36.86999999999999744204615126363933086395263671875 ] } } }, "2d7585a5ae6658d7bdf7ef0deb976bde66d2c652": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 143.6947000000000116415321826934814453125, "test_run_times": [ 37.03999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 229.1517000000000052750692702829837799072265625, "test_run_times": [ 36.9200000000000017053025658242404460906982421875 ] } } }, "4f0efa0181011344574983ec95a9367f1b1c7da5": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 6.9519999999999999573674358543939888477325439453125, "test_run_times": [ 37.03999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 4.35949999999999970867747833835892379283905029296875, "test_run_times": [ 36.9200000000000017053025658242404460906982421875 ] } } }, "f5d658fee9a345547aea8a585f3b48e725770568": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_read_write 32", "description": "Test: oltp_read_write - Threads: 32", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 46972, "raw_values": [ 46972.2399999999979627318680286407470703125 ], "test_run_times": [ 608.700000000000045474735088646411895751953125 ] }, "RESET3": { "value": 74741, "raw_values": [ 74741.3099999999976716935634613037109375 ], "test_run_times": [ 600.549999999999954525264911353588104248046875 ] } } }, "fecf002882e0b61be6cc7816547a1b669c3d8edd": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--sendfile -1 --no-rand-seed", "description": "Test: SENDFILE", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 419265.75, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 665723.579999999958090484142303466796875, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "6c25ce584d2fc40635870197723939b149aa43e6": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_update_non_index 128", "description": "Test: oltp_update_non_index - Threads: 128", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 41635, "raw_values": [ 41635.169999999998253770172595977783203125 ], "test_run_times": [ 615.7899999999999636202119290828704833984375 ] }, "RESET3": { "value": 65674, "raw_values": [ 65674.25 ], "test_run_times": [ 595.5 ] } } }, "10db890ee10e21a2efd80adf2c2d68cf2cb42ca4": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 100 -files 1000000", "description": "Operation: Open - Threads: 100 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1256281, "raw_values": [ 1256281.40703519992530345916748046875 ], "test_run_times": [ 36.719999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 805802, "raw_values": [ 805801.7727638999931514263153076171875 ], "test_run_times": [ 35.7000000000000028421709430404007434844970703125 ] } } }, "b78515accb4d5001b1bd97a68f4e6f3b56f55f0b": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--matrix-3d -1 --no-rand-seed", "description": "Test: Matrix 3D Math", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5817.579999999999927240423858165740966796875, "test_run_times": [ 30.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 9028.110000000000582076609134674072265625, "test_run_times": [ 30.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "26e33105f0cea652d55cc78f99ed4151024d06cd": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_update_non_index 64", "description": "Test: oltp_update_non_index - Threads: 64", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 34234, "raw_values": [ 34233.9400000000023283064365386962890625 ], "test_run_times": [ 608.98000000000001818989403545856475830078125 ] }, "RESET3": { "value": 51897, "raw_values": [ 51897.16000000000349245965480804443359375 ], "test_run_times": [ 595.990000000000009094947017729282379150390625 ] } } }, "d48e25ed67ce3fe15ceaff59baeaeacc8acf1cbb": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_point_select 128", "description": "Test: oltp_point_select - Threads: 128", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 131165, "raw_values": [ 131164.92000000001280568540096282958984375 ], "test_run_times": [ 608.5 ] }, "RESET3": { "value": 197386, "raw_values": [ 197385.70999999999185092747211456298828125 ], "test_run_times": [ 595.1799999999999499777914024889469146728515625 ] } } }, "9291f99c55ae8b7f172514da44fccba0414eac1a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 10.7278000000000002245315045001916587352752685546875, "test_run_times": [ 102.2099999999999937472239253111183643341064453125 ] }, "RESET3": { "value": 7.1439000000000003609557097661308944225311279296875, "test_run_times": [ 98.9800000000000039790393202565610408782958984375 ] } } }, "eba161c303a44b46f72cb85f8b16da8797954de2": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 93.124899999999996680344338528811931610107421875, "test_run_times": [ 102.2099999999999937472239253111183643341064453125 ] }, "RESET3": { "value": 139.834200000000009822542779147624969482421875, "test_run_times": [ 98.9800000000000039790393202565610408782958984375 ] } } }, "65b2848f49bc1d461712e3defeecaee109226330": { "identifier": "pts\/remhos-1.0.0", "title": "Remhos", "app_version": "1.0", "arguments": "-m .\/data\/inline-quad.mesh -p 14 -rs 2 -rp 1 -dt 0.0005 -tf 0.6 -ho 1 -lo 2 -fct 3", "description": "Test: Sample Remap Example", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 31.016999999999999459987520822323858737945556640625, "test_run_times": [ 31.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi" } } }, "RESET2": { "value": 30.93599999999999994315658113919198513031005859375, "test_run_times": [ 30.940000000000001278976924368180334568023681640625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi" } } }, "RESET3": { "value": 20.687999999999998834709913353435695171356201171875, "test_run_times": [ 20.690000000000001278976924368180334568023681640625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi" } } } } }, "b397fa132b01b7bad3b20659f8b7c14d37ec6de8": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7.0815000000000001278976924368180334568023681640625, "test_run_times": [ 39.340000000000003410605131648480892181396484375 ] }, "RESET2": { "value": 6.95939999999999958646412778762169182300567626953125, "test_run_times": [ 39.72999999999999687361196265555918216705322265625 ] }, "RESET3": { "value": 4.751400000000000289901436190120875835418701171875, "test_run_times": [ 39.56000000000000227373675443232059478759765625 ] } } }, "c98a283d125f2494d1f50e0bad82c4f927c75b95": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario sync", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 141.086000000000012732925824820995330810546875, "test_run_times": [ 39.340000000000003410605131648480892181396484375 ] }, "RESET2": { "value": 143.560699999999997089616954326629638671875, "test_run_times": [ 39.72999999999999687361196265555918216705322265625 ] }, "RESET3": { "value": 210.205299999999994042809703387320041656494140625, "test_run_times": [ 39.56000000000000227373675443232059478759765625 ] } } }, "5ed437f7c0ad98c5647c03ecbde3826536b1e733": { "identifier": "pts\/kripke-1.2.0", "title": "Kripke", "app_version": "1.2.6", "scale": "Throughput FoM", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 237641100, "test_run_times": [ 35.43999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -fopenmp -ldl" } } }, "RESET3": { "value": 351062800, "test_run_times": [ 24.690000000000001278976924368180334568023681640625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -fopenmp -ldl" } } } } }, "ecb12f09c9f9402d834da5684a76f529f906d3f0": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_point_select 256", "description": "Test: oltp_point_select - Threads: 256", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 143244, "raw_values": [ 143243.98999999999068677425384521484375 ], "test_run_times": [ 608.7899999999999636202119290828704833984375 ] }, "RESET3": { "value": 210553, "raw_values": [ 210552.9299999999930150806903839111328125 ], "test_run_times": [ 594.5800000000000409272615797817707061767578125 ] } } }, "5fc3574e3be9cfce86e8b0b29ec5f8b6d9afdf8e": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 8 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 8 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 67.59600000000000363797880709171295166015625, "test_run_times": [ 9.550000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 97.7639999999999957935870043002068996429443359375, "test_run_times": [ 7.20000000000000017763568394002504646778106689453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "4718963217a08c42cecffeaa5bc83b9a14234ded": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 32 -b 256 -f 512", "description": "Threads: 32 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 273720000, "test_run_times": [ 30.120000000000000994759830064140260219573974609375 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 274570000, "test_run_times": [ 30.120000000000000994759830064140260219573974609375 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 393800000, "test_run_times": [ 30.1099999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "78c1dafa9f71ada1047e6627d9a575398a531a1e": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 202.7450000000000045474735088646411895751953125, "test_run_times": [ 48.46000000000000085265128291212022304534912109375 ] }, "RESET2": { "value": 203.21899999999999408828443847596645355224609375, "test_run_times": [ 48.99000000000000198951966012828052043914794921875 ] }, "RESET3": { "value": 291.468200000000024374458007514476776123046875, "test_run_times": [ 48.280000000000001136868377216160297393798828125 ] } } }, "48e2ef91a77c84aaa7b1998dd9c0256d35e1be74": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 4.92729999999999979110043568653054535388946533203125, "test_run_times": [ 48.46000000000000085265128291212022304534912109375 ] }, "RESET2": { "value": 4.91570000000000018047785488306544721126556396484375, "test_run_times": [ 48.99000000000000198951966012828052043914794921875 ] }, "RESET3": { "value": 3.42870000000000008100187187665142118930816650390625, "test_run_times": [ 48.280000000000001136868377216160297393798828125 ] } } }, "f64b9bf4bd890119030c8b6a8b0c7b7032df3a8a": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 9.806400000000000005684341886080801486968994140625, "test_run_times": [ 38.6400000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 6.945299999999999585043042316101491451263427734375, "test_run_times": [ 38.3299999999999982946974341757595539093017578125 ] } } }, "8d7cb28d68cd32fe88cedc09ca57f67417a948aa": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 101.91009999999999990905052982270717620849609375, "test_run_times": [ 38.6400000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 143.869599999999991268850862979888916015625, "test_run_times": [ 38.3299999999999982946974341757595539093017578125 ] } } }, "12c0fcafa7096609e7a2f63d80a0348e7b2c61f7": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 12 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 12 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 165.650000000000005684341886080801486968994140625, "test_run_times": [ 4.37000000000000010658141036401502788066864013671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 164.10300000000000864019966684281826019287109375, "test_run_times": [ 4.4000000000000003552713678800500929355621337890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 231.171999999999997044142219237983226776123046875, "test_run_times": [ 3.609999999999999875655021241982467472553253173828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "4eb2eb86043ebaaef323683e5ea92f024dc1fc7a": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 100 -files 100000", "description": "Operation: File Status - Threads: 100 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 531915, "raw_values": [ 531914.893617019988596439361572265625 ], "test_run_times": [ 14.3800000000000007815970093361102044582366943359375 ] }, "RESET3": { "value": 740741, "raw_values": [ 740740.74074073997326195240020751953125 ], "test_run_times": [ 13.699999999999999289457264239899814128875732421875 ] } } }, "11c6895438f117b9b52c48dcec291beb0ba99e0f": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 13 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 13 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 165.948000000000007503331289626657962799072265625, "test_run_times": [ 4.37000000000000010658141036401502788066864013671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 164.679000000000002046363078989088535308837890625, "test_run_times": [ 4.38999999999999968025576890795491635799407958984375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 229.116000000000013869794202037155628204345703125, "test_run_times": [ 3.640000000000000124344978758017532527446746826171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "0fa3ad6972acbbc94e8cade3c5b1ae33c0fc79a7": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 18.23949999999999960209606797434389591217041015625, "test_run_times": [ 46.47999999999999687361196265555918216705322265625 ] }, "RESET3": { "value": 13.166199999999999903366187936626374721527099609375, "test_run_times": [ 46.24000000000000198951966012828052043914794921875 ] } } }, "1a040d88fe38299e97475896381fcc8c2c75f6bc": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 54.80799999999999982946974341757595539093017578125, "test_run_times": [ 46.47999999999999687361196265555918216705322265625 ] }, "RESET3": { "value": 75.916799999999994952304405160248279571533203125, "test_run_times": [ 46.24000000000000198951966012828052043914794921875 ] } } }, "9db9f3c99e0b95a281675c992dd29d0430e9ebaa": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 32 -b 256 -f 57", "description": "Threads: 32 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1031700000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 1013800000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 1397500000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "3c171500228339cca2e0b7460b50c7727593cfbe": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 8 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 8 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 59.6400000000000005684341886080801486968994140625, "test_run_times": [ 10.82000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 59.05799999999999982946974341757595539093017578125, "test_run_times": [ 10.92999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 81.0619999999999976125764078460633754730224609375, "test_run_times": [ 8.4399999999999995026200849679298698902130126953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "e25319957fb149357268b68874248b340c00a960": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_update_non_index 32", "description": "Test: oltp_update_non_index - Threads: 32", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 26459, "raw_values": [ 26459.0400000000008731149137020111083984375 ], "test_run_times": [ 609.549999999999954525264911353588104248046875 ] }, "RESET3": { "value": 36066, "raw_values": [ 36066.3700000000026193447411060333251953125 ], "test_run_times": [ 598.1799999999999499777914024889469146728515625 ] } } }, "7bd81c6e1afc248cd0227631400de567023b9e0d": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1.087499999999999911182158029987476766109466552734375, "test_run_times": [ 36.8599999999999994315658113919198513031005859375 ] }, "RESET2": { "value": 1.0806999999999999939603867460391484200954437255859375, "test_run_times": [ 36.8900000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 0.8023000000000000131450406115618534386157989501953125, "test_run_times": [ 36.88000000000000255795384873636066913604736328125 ] } } }, "b4dbc793940b7f30198f2e87377c997b6c3db06e": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 916.581699999999955252860672771930694580078125, "test_run_times": [ 36.8599999999999994315658113919198513031005859375 ] }, "RESET2": { "value": 922.356899999999995998223312199115753173828125, "test_run_times": [ 36.8900000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 1241.844800000000077488948591053485870361328125, "test_run_times": [ 36.88000000000000255795384873636066913604736328125 ] } } }, "a4bc890b00c7c2b117891f929c9a949d75e0682d": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--schedmix -1", "description": "Test: Mixed Scheduler", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 39604.330000000001746229827404022216796875, "test_run_times": [ 30.269999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 53630.3099999999976716935634613037109375, "test_run_times": [ 30.269999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "0eb5874bd95a057332b9bb415d0c2af77d73e719": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 12 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 12 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 162.28800000000001091393642127513885498046875, "test_run_times": [ 4.36000000000000031974423109204508364200592041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 216.625, "test_run_times": [ 3.8300000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "a38742a72e87b6f61085ca39d60c7a6596bd7976": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_read_write 16", "description": "Test: oltp_read_write - Threads: 16", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 36124, "raw_values": [ 36124.02999999999883584678173065185546875 ], "test_run_times": [ 608.26999999999998181010596454143524169921875 ] }, "RESET3": { "value": 47703, "raw_values": [ 47703.389999999999417923390865325927734375 ], "test_run_times": [ 589.6200000000000045474735088646411895751953125 ] } } }, "7dfd7f7d2f0f740fb22ed51af320da0e1eb8b7bf": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: regnety_400m", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 17.129999999999999005240169935859739780426025390625, "min_result": [ "16.89" ], "max_result": [ "19.07" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 22.32000000000000028421709430404007434844970703125, "min_result": [ "22.1" ], "max_result": [ "22.95" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "01f3a7f3d2f71ecb13cbd8373c598ea38ec26091": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 12 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 12 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 466.98200000000002773958840407431125640869140625, "test_run_times": [ 1.7199999999999999733546474089962430298328399658203125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 469.490999999999985448084771633148193359375, "test_run_times": [ 1.70999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 599.1399999999999863575794734060764312744140625, "test_run_times": [ 1.7399999999999999911182158029987476766109466552734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "f09e3ccfbe9c51686d6d264ada714642f77d44d6": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_update_non_index 16", "description": "Test: oltp_update_non_index - Threads: 16", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 18663, "raw_values": [ 18662.84000000000014551915228366851806640625 ], "test_run_times": [ 608.48000000000001818989403545856475830078125 ] }, "RESET3": { "value": 23758, "raw_values": [ 23758.40999999999985448084771633148193359375 ], "test_run_times": [ 594.6299999999999954525264911353588104248046875 ] } } }, "52ba96d7c5cb99495af70404ba45950a1c4e13dc": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 4 -n 160 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 4 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 4.50199999999999977973175191436894237995147705078125, "test_run_times": [ 36.5499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 4.52799999999999958077978590154089033603668212890625, "test_run_times": [ 36.35000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 5.71900000000000030553337637684307992458343505859375, "test_run_times": [ 29.339999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "c2de2d07de640d6a6ec7ede5c12f2e1fffbe33db": { "identifier": "pts\/ospray-2.12.0", "title": "OSPRay", "app_version": "2.12", "arguments": "--benchmark_filter=particle_volume\/pathtracer\/real_time", "description": "Benchmark: particle_volume\/pathtracer\/real_time", "scale": "Items Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 151.866000000000013869794202037155628204345703125, "test_run_times": [ 144.240000000000009094947017729282379150390625 ] }, "RESET2": { "value": 151.794000000000011141310096718370914459228515625, "test_run_times": [ 144.289999999999992041921359486877918243408203125 ] }, "RESET3": { "value": 192.55500000000000682121026329696178436279296875, "test_run_times": [ 190.8799999999999954525264911353588104248046875 ] } } }, "a6798cc12f260d29684f4d89a4fe5a2ad67923de": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: vision_transformer", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 55.72999999999999687361196265555918216705322265625, "min_result": [ "54.17" ], "max_result": [ "116.29" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 44.06000000000000227373675443232059478759765625, "min_result": [ "43.6" ], "max_result": [ "47.6" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "787b6174f6f1b30601dccb44bd85564f9325a9bc": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 8 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 8 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 119.2219999999999942019712761975824832916259765625, "test_run_times": [ 5.4199999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 150.62799999999998590283212251961231231689453125, "test_run_times": [ 4.82000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "96d907bb74b5f46478ece0ae1a97ea53f538e4ca": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--msg -1 --no-rand-seed", "description": "Test: System V Message Passing", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7982733.219999999739229679107666015625, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 10016615.6999999992549419403076171875, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "52ea667e1e55836750f912c6fd36dd8311b59d0d": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 8 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 8 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 128.582999999999998408384271897375583648681640625, "test_run_times": [ 5.1699999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 128.472000000000008412825991399586200714111328125, "test_run_times": [ 5.17999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 160.664999999999992041921359486877918243408203125, "test_run_times": [ 4.54000000000000003552713678800500929355621337890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "43bfc886518a3c66afdd39efb827f466099b7d88": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 100 -files 1000000", "description": "Operation: File Status - Threads: 100 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1828154, "raw_values": [ 1828153.5648994999937713146209716796875 ], "test_run_times": [ 36.659999999999996589394868351519107818603515625 ] }, "RESET3": { "value": 2252252, "raw_values": [ 2252252.2522522998042404651641845703125 ], "test_run_times": [ 35.18999999999999772626324556767940521240234375 ] } } }, "05b9ffdfbd6c0cd6c72cb9923a3da26779f548a0": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 4 -n 160 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 4 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 4.15200000000000013500311979441903531551361083984375, "test_run_times": [ 39.3900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 5.0890000000000004121147867408581078052520751953125, "test_run_times": [ 32.840000000000003410605131648480892181396484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "218cb929a51bf8271c521376c798e9a9b0af0e85": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 50 -files 100000", "description": "Operation: Open - Threads: 50 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 537634, "raw_values": [ 537634.408602150040678679943084716796875 ], "test_run_times": [ 14.3499999999999996447286321199499070644378662109375 ] }, "RESET3": { "value": 653595, "raw_values": [ 653594.77124182996340095996856689453125 ], "test_run_times": [ 13.7799999999999993605115378159098327159881591796875 ] } } }, "ad0358f6ec4e90cf3115f2ef3b164a98b0d63019": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 20 -files 1000000", "description": "Operation: Open - Threads: 20 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1191895, "raw_values": [ 1191895.11323000001721084117889404296875 ], "test_run_times": [ 34.5799999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 981354, "raw_values": [ 981354.2688910700380802154541015625 ], "test_run_times": [ 32.36999999999999744204615126363933086395263671875 ] } } }, "435a44860858662d31f8ef8056e48f4177730334": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 13 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 13 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 600.201999999999998181010596454143524169921875, "test_run_times": [ 1.2800000000000000266453525910037569701671600341796875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 595.1380000000000336513039655983448028564453125, "test_run_times": [ 1.29000000000000003552713678800500929355621337890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 721.700000000000045474735088646411895751953125, "test_run_times": [ 1.20999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "bd39c667abcd3aa6ac885ed82774873d442465ef": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 60 --ratio=1:100", "description": "Clients Per Thread: 60 - Set To Get Ratio: 1:100", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 11419293.83000000007450580596923828125, "test_run_times": [ 67.2699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 13659195.83000000007450580596923828125, "test_run_times": [ 67.2600000000000051159076974727213382720947265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "test_run_times": [ 7.11000000000000031974423109204508364200592041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" }, "error": "The test run did not produce a result. E: Connection error: Connection reset by peer" } } } }, "db6d07b5882a86cc58350833c3449ec9e40cd1d7": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_3840x2160.y4m --preset fast", "description": "Video Input: Bosphorus 4K - Video Preset: Fast", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 6.12600000000000033395508580724708735942840576171875, "test_run_times": [ 98.3700000000000045474735088646411895751953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET2": { "value": 6.1470000000000002415845301584340631961822509765625, "test_run_times": [ 98.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET3": { "value": 7.29300000000000014921397450962103903293609619140625, "test_run_times": [ 82.93000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "6bcaf1150aafb0a4d9fc6ad9d6fa504f5066de82": { "identifier": "pts\/nekrs-1.1.0", "title": "nekRS", "app_version": "23.0", "arguments": "turbPipePeriodic turbPipe.par", "description": "Input: TurboPipe Periodic", "scale": "flops\/rank", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7950340000, "test_run_times": [ 182.69999999999998863131622783839702606201171875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi" } } }, "RESET2": { "value": 7961240000, "test_run_times": [ 182.43000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi" } } }, "RESET3": { "value": 6776830000, "test_run_times": [ 109.659999999999996589394868351519107818603515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi" } } } } }, "19415e1560ae319fa42eb0e6785e8d562a6154c9": { "identifier": "pts\/svt-av1-2.9.0", "title": "SVT-AV1", "app_version": "1.6", "arguments": "--preset 4 -n 160 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 4 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 14.2110000000000002984279490192420780658721923828125, "test_run_times": [ 11.8800000000000007815970093361102044582366943359375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET2": { "value": 14.0649999999999995026200849679298698902130126953125, "test_run_times": [ 12 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 16.3960000000000007958078640513122081756591796875, "test_run_times": [ 10.71000000000000085265128291212022304534912109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "0542b60a3b2abf049d6d0d3a1c1116caa394bd37": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: blazeface", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 3.350000000000000088817841970012523233890533447265625, "min_result": [ "3.27" ], "max_result": [ "3.52" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 3.859999999999999875655021241982467472553253173828125, "min_result": [ "3.79" ], "max_result": [ "4.34" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "6791c5c8950ce69f170fbe0f96e43914575e2dd5": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_3840x2160.y4m --preset faster", "description": "Video Input: Bosphorus 4K - Video Preset: Faster", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 12.1300000000000007815970093361102044582366943359375, "test_run_times": [ 49.8900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET2": { "value": 12.2309999999999998721023075631819665431976318359375, "test_run_times": [ 49.49000000000000198951966012828052043914794921875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET3": { "value": 13.9410000000000007247535904753021895885467529296875, "test_run_times": [ 43.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "5366daf62d3b532ed18dcc2a01966f0441e167a6": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: alexnet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 6.0099999999999997868371792719699442386627197265625, "min_result": [ "5.86" ], "max_result": [ "7.74" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 5.230000000000000426325641456060111522674560546875, "min_result": [ "5.01" ], "max_result": [ "5.51" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "2e57bc78ea9a73df2b5a413bbcabefb81816d393": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m --preset fast", "description": "Video Input: Bosphorus 1080p - Video Preset: Fast", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 18.01200000000000045474735088646411895751953125, "test_run_times": [ 33.67999999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET2": { "value": 18.08899999999999863575794734060764312744140625, "test_run_times": [ 33.53999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET3": { "value": 20.675000000000000710542735760100185871124267578125, "test_run_times": [ 29.620000000000000994759830064140260219573974609375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "998260f4058ed95c60c92fe0bceecc19da92cc3b": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--memfd -1 --no-rand-seed", "description": "Test: MEMFD", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 431.58999999999997498889570124447345733642578125, "test_run_times": [ 30.8299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 495.029999999999972715158946812152862548828125, "test_run_times": [ 30.64999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "5f5344f3afd1c1914824df35f64845c6b9a4835c": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 4 -n 160 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 4 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 10.727000000000000312638803734444081783294677734375, "test_run_times": [ 15.3599999999999994315658113919198513031005859375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 12.300000000000000710542735760100185871124267578125, "test_run_times": [ 13.980000000000000426325641456060111522674560546875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "6a0aedfad278ba7ea2866ec113d935646287c4cd": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 1 -b 256 -f 57", "description": "Threads: 1 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 52897000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 48803000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 55677000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "499d632e85273104505204a5ab0631f7717a38a8": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--clone -1 --no-rand-seed", "description": "Test: Cloning", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 3317.09999999999990905052982270717620849609375, "test_run_times": [ 30.629999999999999005240169935859739780426025390625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 3751.82000000000016370904631912708282470703125, "test_run_times": [ 30.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "36a8974199a279f08595760efbf77a066736aa13": { "identifier": "pts\/nekrs-1.1.0", "title": "nekRS", "app_version": "23.0", "arguments": "kershaw kershaw.par", "description": "Input: Kershaw", "scale": "flops\/rank", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 10295200000, "test_run_times": [ 129.18000000000000682121026329696178436279296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi" } } }, "RESET2": { "value": 10068200000, "test_run_times": [ 131.539999999999992041921359486877918243408203125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi" } } }, "RESET3": { "value": 9111820000, "test_run_times": [ 74.8900000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi" } } } } }, "cecdff538032dfa900ef54a8fe2de4713eaa0668": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: efficientnet-b0", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 9.3499999999999996447286321199499070644378662109375, "min_result": [ "9.25" ], "max_result": [ "10.78" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 10.5600000000000004973799150320701301097869873046875, "min_result": [ "9.78" ], "max_result": [ "160.53" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "328a391f8c7aaa145ad173b3076d3d78de6fff13": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 8 -b 256 -f 57", "description": "Threads: 8 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 337660000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 343950000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 380280000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "b79ec236db3907c843f2b61470492434d86c830c": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 32 -b 256 -f 32", "description": "Threads: 32 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1047500000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 1046500000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 1169700000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "6af3ea7cd749c91980fbd3b9541aca5f70284cf6": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--futex -1 --no-rand-seed", "description": "Test: Futex", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 4273978.25999999977648258209228515625, "test_run_times": [ 30.1400000000000005684341886080801486968994140625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 4747454.50999999977648258209228515625, "test_run_times": [ 30.260000000000001563194018672220408916473388671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "6508705f5b2a28d5715fcd2e2d76a235aebb13aa": { "identifier": "pts\/vvenc-1.9.1", "title": "VVenC", "app_version": "1.9", "arguments": "-i Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m --preset faster", "description": "Video Input: Bosphorus 1080p - Video Preset: Faster", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 34.69800000000000039790393202565610408782958984375, "test_run_times": [ 17.660000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET2": { "value": 34.6940000000000026147972675971686840057373046875, "test_run_times": [ 17.6700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } }, "RESET3": { "value": 38.35799999999999698729880037717521190643310546875, "test_run_times": [ 16.239999999999998436805981327779591083526611328125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -flto -fno-fat-lto-objects -flto=auto" } } } } }, "5f0847e44b7e8bc7cec2e2aa227936bf08bad00c": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 500 -files 100000", "description": "Operation: Delete - Threads: 500 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 93721, "raw_values": [ 93720.712277412996627390384674072265625 ], "test_run_times": [ 15.5800000000000000710542735760100185871124267578125 ] }, "RESET3": { "value": 103306, "raw_values": [ 103305.785123969995765946805477142333984375 ], "test_run_times": [ 14.8300000000000000710542735760100185871124267578125 ] } } }, "945f9fe6956b42c533e6d098ecddbdbf78b1aab8": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 60 --ratio=1:10", "description": "Clients Per Thread: 60 - Set To Get Ratio: 1:10", "scale": "Ops\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 12065388.3399999998509883880615234375, "test_run_times": [ 67.2600000000000051159076974727213382720947265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET2": { "value": 10983543.6600000001490116119384765625, "test_run_times": [ 67.2699999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" } } }, "RESET3": { "test_run_times": [ 7.11000000000000031974423109204508364200592041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" }, "error": "The test run did not produce a result. E: Connection error: Connection reset by peer" } } } }, "0724da0b0dda01834a98fb1e7ef4f1eab5b69c72": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: vgg16", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 22.589999999999999857891452847979962825775146484375, "min_result": [ "20.48" ], "max_result": [ "23.4" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 20.620000000000000994759830064140260219573974609375, "min_result": [ "20.22" ], "max_result": [ "23.98" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "87989ab12ee35a64f09696501007f2bce45c4004": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 12 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 12 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 528.2920000000000300133251585066318511962890625, "test_run_times": [ 1.3899999999999999023003738329862244427204132080078125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 577.7340000000000372892827726900577545166015625, "test_run_times": [ 1.4499999999999999555910790149937383830547332763671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "780ab4429be08c2c7920cd48d793ab37fc106266": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_update_non_index 1", "description": "Test: oltp_update_non_index - Threads: 1", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1687, "raw_values": [ 1686.84999999999990905052982270717620849609375 ], "test_run_times": [ 609.509999999999990905052982270717620849609375 ] }, "RESET3": { "value": 1843, "raw_values": [ 1843.240000000000009094947017729282379150390625 ], "test_run_times": [ 594.5399999999999636202119290828704833984375 ] } } }, "3f27950f825cc5f52ad4af388db491f0aa558820": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 1 -b 256 -f 512", "description": "Threads: 1 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 12685000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 12264000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 13359000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "f495b84ea407aeef05a0b0afbbb01cd04df5913e": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 8 -b 256 -f 512", "description": "Threads: 8 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 97011000, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 99404000, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 105480000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "3bb2c9bc420514b1433ab26476dc85829ffec86e": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: shufflenet-v2", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 8.6699999999999999289457264239899814128875732421875, "min_result": [ "8.53" ], "max_result": [ "10.83" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 9.3800000000000007815970093361102044582366943359375, "min_result": [ "9.25" ], "max_result": [ "12.88" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "c7d9206f36dbe29c7e6e3921d73fc803b92bc7e4": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 20 -files 1000000", "description": "Operation: Create - Threads: 20 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 72317, "raw_values": [ 72317.037894128006882965564727783203125 ], "test_run_times": [ 26.3900000000000005684341886080801486968994140625 ] }, "RESET3": { "value": 78223, "raw_values": [ 78222.778473091006162576377391815185546875 ], "test_run_times": [ 24.82000000000000028421709430404007434844970703125 ] } } }, "eba5a7c6518a0cdeea41cef86bd13f6cd26e3463": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 500 -files 1000000", "description": "Operation: Open - Threads: 500 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1164144, "raw_values": [ 1164144.35389990010298788547515869140625 ], "test_run_times": [ 38.1099999999999994315658113919198513031005859375 ] }, "RESET3": { "value": 1257862, "raw_values": [ 1257861.63522009993903338909149169921875 ], "test_run_times": [ 37.13000000000000255795384873636066913604736328125 ] } } }, "f0d28c47cc2aa4662de59c0804130e3ae1860969": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--atomic -1 --no-rand-seed", "description": "Test: Atomic", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 246.6200000000000045474735088646411895751953125, "test_run_times": [ 30.28999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 265.54000000000002046363078989088535308837890625, "test_run_times": [ 30.449999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "10a08108b1423fd9f02a48f379e86e2200c0e38c": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 4 -b 256 -f 512", "description": "Threads: 4 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 48886000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 49614000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 52587000, "test_run_times": [ 30.03999999999999914734871708787977695465087890625 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "fe2282a040d551dc8c89262c4cd02f84f16781a7": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 500 -files 1000000", "description": "Operation: Rename - Threads: 500 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 76722, "raw_values": [ 76722.41829062500619329512119293212890625 ], "test_run_times": [ 51.590000000000003410605131648480892181396484375 ] }, "RESET3": { "value": 82529, "raw_values": [ 82528.678715853995527140796184539794921875 ], "test_run_times": [ 48.340000000000003410605131648480892181396484375 ] } } }, "2af151a6a6aa16cc640560e56b30c64423bfb429": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 100 -files 100000", "description": "Operation: Delete - Threads: 100 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 99701, "raw_values": [ 99700.89730807600426487624645233154296875 ], "test_run_times": [ 15.25 ] }, "RESET3": { "value": 107181, "raw_values": [ 107181.13612003999878652393817901611328125 ], "test_run_times": [ 14.5 ] } } }, "ea820002b3c0fa4dce3ea08621eed76719fcffed": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: googlenet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 17.980000000000000426325641456060111522674560546875, "min_result": [ "17.82" ], "max_result": [ "18.6" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 19.28999999999999914734871708787977695465087890625, "min_result": [ "18.99" ], "max_result": [ "22.75" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "07e777e4685ac22999efb7fac8544a07f83af440": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU-v3-v3 - Model: mobilenet-v3", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7.54999999999999982236431605997495353221893310546875, "min_result": [ "7.41" ], "max_result": [ "11.7" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 8.0800000000000000710542735760100185871124267578125, "min_result": [ "7.94" ], "max_result": [ "8.54" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "1d37a378b4ee40b0e7a97691fb96f6338d30e1e2": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 20 -files 100000", "description": "Operation: Open - Threads: 20 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 636943, "raw_values": [ 636942.675159240025095641613006591796875 ], "test_run_times": [ 14.1899999999999995026200849679298698902130126953125 ] }, "RESET3": { "value": 595238, "raw_values": [ 595238.09523810003884136676788330078125 ], "test_run_times": [ 13.6300000000000007815970093361102044582366943359375 ] } } }, "e2e94974dd0018c26cc96cb07a28718b701bcce4": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 16 -b 256 -f 32", "description": "Threads: 16 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 545570000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 544800000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 582930000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "fddcd004771853982b38d50afc60aa96c7b540e7": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 20 -files 1000000", "description": "Operation: Rename - Threads: 20 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 89095, "raw_values": [ 89094.796863862997270189225673675537109375 ], "test_run_times": [ 45.57000000000000028421709430404007434844970703125 ] }, "RESET3": { "value": 95293, "raw_values": [ 95292.54812273700372315943241119384765625 ], "test_run_times": [ 42.7999999999999971578290569595992565155029296875 ] } } }, "ca5bb1f23a73ae8920df9c31781eafe289372b38": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 4 -b 256 -f 32", "description": "Threads: 4 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 138520000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 136520000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 145900000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "0445ffc1f4f6699f48fa224e9fd6e51c7ddd14e3": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 20 -files 1000000", "description": "Operation: Delete - Threads: 20 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 116333, "raw_values": [ 116333.1782224299968220293521881103515625 ], "test_run_times": [ 43.00999999999999801048033987171947956085205078125 ] }, "RESET3": { "value": 124054, "raw_values": [ 124054.0875821899971924722194671630859375 ], "test_run_times": [ 40.7000000000000028421709430404007434844970703125 ] } } }, "6f92a9c0a8d7190416fd5bededda3b582437397e": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 20 -files 100000", "description": "Operation: Create - Threads: 20 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 59630, "raw_values": [ 59630.2921884320021490566432476043701171875 ], "test_run_times": [ 13.42999999999999971578290569595992565155029296875 ] }, "RESET3": { "value": 63492, "raw_values": [ 63492.06349206299637444317340850830078125 ], "test_run_times": [ 12.9199999999999999289457264239899814128875732421875 ] } } }, "d341c5b44dff928ae89611b4731d9b91fec4b423": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 16 -b 256 -f 512", "description": "Threads: 16 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 196300000, "test_run_times": [ 30.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 196070000, "test_run_times": [ 30.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 208610000, "test_run_times": [ 30.07000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "29dab46c3d595fa7d592ea71ecb34b2029b11d55": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 500 -files 100000", "description": "Operation: Create - Threads: 500 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 52383, "raw_values": [ 52383.44683080099639482796192169189453125 ], "test_run_times": [ 13.53999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 55525, "raw_values": [ 55524.7084952799996244721114635467529296875 ], "test_run_times": [ 12.96000000000000085265128291212022304534912109375 ] } } }, "d832b8d83c6907cf28a584ab833122e03244f0fb": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op open -threads 500 -files 100000", "description": "Operation: Open - Threads: 500 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 205761, "raw_values": [ 205761.31687243000487796962261199951171875 ], "test_run_times": [ 14.980000000000000426325641456060111522674560546875 ] }, "RESET3": { "value": 217865, "raw_values": [ 217864.92374728000140748918056488037109375 ], "test_run_times": [ 14.300000000000000710542735760100185871124267578125 ] } } }, "c457d15acb1e1f8fe927867df60e55755c904aa3": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 100 -files 1000000", "description": "Operation: Create - Threads: 100 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 69638, "raw_values": [ 69637.883008357006474398076534271240234375 ], "test_run_times": [ 27.129999999999999005240169935859739780426025390625 ] }, "RESET3": { "value": 73692, "raw_values": [ 73691.967575533999479375779628753662109375 ], "test_run_times": [ 25.71000000000000085265128291212022304534912109375 ] } } }, "d1394ea7bcfd461e0d4ae5628787df0fbb9ee1e6": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 50 -files 100000", "description": "Operation: Rename - Threads: 50 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 83333, "raw_values": [ 83333.33333333299378864467144012451171875 ], "test_run_times": [ 15.42999999999999971578290569595992565155029296875 ] }, "RESET3": { "value": 88183, "raw_values": [ 88183.421516754999174736440181732177734375 ], "test_run_times": [ 14.7400000000000002131628207280300557613372802734375 ] } } }, "d7f78bea1064f39e1a77e09d008a74955c246a60": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 13 -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080", "description": "Encoder Mode: Preset 13 - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 590.490000000000009094947017729282379150390625, "test_run_times": [ 1.2399999999999999911182158029987476766109466552734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 558.191000000000030922819860279560089111328125, "test_run_times": [ 1.45999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "20b920170db0dfe529c850c176cc9de013ea21b9": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 8 -b 256 -f 32", "description": "Threads: 8 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 277560000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 277780000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 292720000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "93daa76da7c87fd15c3674268984e24dc8b7f1bf": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 1 -b 256 -f 32", "description": "Threads: 1 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 35186000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 35179000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 37083000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "464217c3ef7cff0edb0c31396d934718ee6e1836": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 2 -b 256 -f 32", "description": "Threads: 2 - Buffer Length: 256 - Filter Length: 32", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 68854000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 68905000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 72570000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "f1bede5eb4fe0553cdcf703557d2de484d0443e6": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 500 -files 1000000", "description": "Operation: Delete - Threads: 500 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 109673, "raw_values": [ 109673.173941650005872361361980438232421875 ], "test_run_times": [ 45.969999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 104362, "raw_values": [ 104362.346065539997653104364871978759765625 ], "test_run_times": [ 46.13000000000000255795384873636066913604736328125 ] } } }, "34d8b6c8389b29062d57510f7dbc42c15d65d711": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: mnasnet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7.46999999999999975131004248396493494510650634765625, "min_result": [ "6.42" ], "max_result": [ "190.35" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 7.11000000000000031974423109204508364200592041015625, "min_result": [ "7.04" ], "max_result": [ "7.35" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "f173804530470216825616d593236da71f5af49b": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--mutex -1 --no-rand-seed", "description": "Test: Mutex", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 789472.5, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 828974.290000000037252902984619140625, "test_run_times": [ 30.050000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "02e52b8b0dc157eabf253df20be8349731ddf9a0": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--cache -1 --no-rand-seed", "description": "Test: CPU Cache", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 1163806.08000000007450580596923828125, "test_run_times": [ 30.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 1221906.4799999999813735485076904296875, "test_run_times": [ 30.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "971b45b74e58ebae10130ef653baaefd8b1d5591": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 4 -b 256 -f 57", "description": "Threads: 4 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 190540000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 188640000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 197890000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "8656c230522cbc01a88e3065ab3d9b1bc1a67b1d": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU-v2-v2 - Model: mobilenet-v2", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 7.36000000000000031974423109204508364200592041015625, "min_result": [ "6.92" ], "max_result": [ "8.19" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 7.71999999999999975131004248396493494510650634765625, "min_result": [ "7.29" ], "max_result": [ "8.21" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "b636b8f1ac303dd220688c0878070e641fe84acf": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 500 -files 100000", "description": "Operation: Rename - Threads: 500 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 78555, "raw_values": [ 78554.595443832993623800575733184814453125 ], "test_run_times": [ 15.7599999999999997868371792719699442386627197265625 ] }, "RESET3": { "value": 82305, "raw_values": [ 82304.52674897099495865404605865478515625 ], "test_run_times": [ 15.050000000000000710542735760100185871124267578125 ] } } }, "6ca58910a4b457c01f4ab8c6009ba86380075cd1": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: resnet18", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 9.1300000000000007815970093361102044582366943359375, "min_result": [ "9" ], "max_result": [ "11.27" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 8.7200000000000006394884621840901672840118408203125, "min_result": [ "8.48" ], "max_result": [ "9.08" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "00b2cb596d5f08697baa40798e3d1402fef9708b": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 50 -files 1000000", "description": "Operation: Create - Threads: 50 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 71403, "raw_values": [ 71403.070332023999071680009365081787109375 ], "test_run_times": [ 26.739999999999998436805981327779591083526611328125 ] }, "RESET3": { "value": 74722, "raw_values": [ 74721.661809758996241725981235504150390625 ], "test_run_times": [ 25.550000000000000710542735760100185871124267578125 ] } } }, "db1ffa8f5803f1486003553489193f458b78ff51": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 50 -files 100000", "description": "Operation: Delete - Threads: 50 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 108696, "raw_values": [ 108695.6521739099989645183086395263671875 ], "test_run_times": [ 15.03999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 103950, "raw_values": [ 103950.103950100005022250115871429443359375 ], "test_run_times": [ 14.53999999999999914734871708787977695465087890625 ] } } }, "713c7a1c2393887a1c94baa186568a86c4eb5b15": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: FastestDet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 11.300000000000000710542735760100185871124267578125, "min_result": [ "11.03" ], "max_result": [ "14.81" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 11.8100000000000004973799150320701301097869873046875, "min_result": [ "11.65" ], "max_result": [ "12.07" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "8dcc205ea533b5300647ca1c8ca43f70ae7466f9": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 16 -b 256 -f 57", "description": "Threads: 16 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 695920000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 686540000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 716650000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "d30734f9e7275c871b9c30d1fd50cbcbb7c78000": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: squeezenet_ssd", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 15.519999999999999573674358543939888477325439453125, "min_result": [ "15.22" ], "max_result": [ "20.06" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 16.199999999999999289457264239899814128875732421875, "min_result": [ "15.81" ], "max_result": [ "54.08" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "e11820ae0bc99a49e33ece786f4e8d3fff5a72b3": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5.0159000000000002472688720445148646831512451171875, "test_run_times": [ 37.17999999999999971578290569595992565155029296875 ] }, "RESET2": { "value": 5.02329999999999987636556397774256765842437744140625, "test_run_times": [ 36.969999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 4.8201999999999998181010596454143524169921875, "test_run_times": [ 36.9500000000000028421709430404007434844970703125 ] } } }, "5eb6b4fedcab404e77f8e4901c62a646261f9c08": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--pthread -1 --no-rand-seed", "description": "Test: Pthread", "scale": "Bogo Ops\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 119839.6799999999930150806903839111328125, "test_run_times": [ 30.10000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } }, "RESET3": { "value": 124853.1799999999930150806903839111328125, "test_run_times": [ 30.1700000000000017053025658242404460906982421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" } } } } }, "af65a062b224eef6c83fdb16e451e66192a6c565": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 2 -b 256 -f 512", "description": "Threads: 2 - Buffer Length: 256 - Filter Length: 512", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 25206000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 25050000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 26065000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "4832e130093161f2ba2a9636760cf6308a0cd2e8": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 20 -files 100000", "description": "Operation: Delete - Threads: 20 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 107875, "raw_values": [ 107874.865156419997219927608966827392578125 ], "test_run_times": [ 14.980000000000000426325641456060111522674560546875 ] }, "RESET3": { "value": 112233, "raw_values": [ 112233.445566780006629414856433868408203125 ], "test_run_times": [ 14.2599999999999997868371792719699442386627197265625 ] } } }, "e0cf89eff88ef31b5fdc43cd8549be2cbd74c703": { "identifier": "pts\/liquid-dsp-1.6.0", "title": "Liquid-DSP", "app_version": "1.6", "arguments": "-n 2 -b 256 -f 57", "description": "Threads: 2 - Buffer Length: 256 - Filter Length: 57", "scale": "samples\/s", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 105200000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET2": { "value": 104020000, "test_run_times": [ 30.019999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } }, "RESET3": { "value": 108010000, "test_run_times": [ 30.030000000000001136868377216160297393798828125 ], "details": { "compiler-options": { "compiler-type": "CC", "compiler": "gcc", "compiler-options": "-O3 -pthread -lm -lc -lliquid" } } } } }, "de579f577d229f0340544ebabc145df4a03b1185": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/bert-base\/pytorch\/huggingface\/squad\/12layer_pruned90-none --scenario async", "description": "Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 112.6037000000000034560798667371273040771484375, "test_run_times": [ 41.14999999999999857891452847979962825775146484375 ] }, "RESET2": { "value": 112.251800000000002910383045673370361328125, "test_run_times": [ 41.50999999999999801048033987171947956085205078125 ] }, "RESET3": { "value": 116.5553000000000025693225325085222721099853515625, "test_run_times": [ 42.50999999999999801048033987171947956085205078125 ] } } }, "a69f4caf95e4e90e88a8fd9ca7d077e7a6836649": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 20 -files 100000", "description": "Operation: Rename - Threads: 20 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 87032, "raw_values": [ 87032.201914707999094389379024505615234375 ], "test_run_times": [ 15.269999999999999573674358543939888477325439453125 ] }, "RESET3": { "value": 90253, "raw_values": [ 90252.7075812270049937069416046142578125 ], "test_run_times": [ 14.550000000000000710542735760100185871124267578125 ] } } }, "0a18969c09921c78a36341de611545b0861d9cd2": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 50 -files 1000000", "description": "Operation: Delete - Threads: 50 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 110963, "raw_values": [ 110963.160230800000135786831378936767578125 ], "test_run_times": [ 44.590000000000003410605131648480892181396484375 ] }, "RESET3": { "value": 115022, "raw_values": [ 115021.85415229000500403344631195068359375 ], "test_run_times": [ 42.67999999999999971578290569595992565155029296875 ] } } }, "69f7a9e17c576c747b057ded335a977ba6460c5f": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 325.02199999999999135980033315718173980712890625, "test_run_times": [ 48.5799999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 336.763599999999996725819073617458343505859375, "test_run_times": [ 49.32000000000000028421709430404007434844970703125 ] } } }, "23c3d814901a6953bcebb624ad549c575243bed1": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 50 -files 100000", "description": "Operation: Create - Threads: 50 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 60314, "raw_values": [ 60313.630880579003132879734039306640625 ], "test_run_times": [ 13.2599999999999997868371792719699442386627197265625 ] }, "RESET3": { "value": 62189, "raw_values": [ 62189.0547263679982279427349567413330078125 ], "test_run_times": [ 12.78999999999999914734871708787977695465087890625 ] } } }, "5ff8ad00befa8021f2a426750fd7961d10d1674a": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: mobilenet", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 16.730000000000000426325641456060111522674560546875, "min_result": [ "16.57" ], "max_result": [ "18.96" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 16.28999999999999914734871708787977695465087890625, "min_result": [ "16.05" ], "max_result": [ "16.77" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "a0a7571ebb6bac4c336889fd50cd58ed1381a332": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 100 -files 100000", "description": "Operation: Create - Threads: 100 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 59242, "raw_values": [ 59241.70616113700089044868946075439453125 ], "test_run_times": [ 13.300000000000000710542735760100185871124267578125 ] }, "RESET3": { "value": 60790, "raw_values": [ 60790.2735562309972010552883148193359375 ], "test_run_times": [ 12.75 ] } } }, "a21c11f98484d3fd8baa9af77755efbd05498195": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 50 -files 1000000", "description": "Operation: Rename - Threads: 50 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 87912, "raw_values": [ 87912.08791208799812011420726776123046875 ], "test_run_times": [ 47.0799999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 89985, "raw_values": [ 89984.7026005579973571002483367919921875 ], "test_run_times": [ 45.07000000000000028421709430404007434844970703125 ] } } }, "2e2bc38d45ee28800889530f82c55525ab1635e7": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 100 -files 100000", "description": "Operation: Rename - Threads: 100 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 85616, "raw_values": [ 85616.43835616399883292615413665771484375 ], "test_run_times": [ 15.410000000000000142108547152020037174224853515625 ] }, "RESET3": { "value": 83752, "raw_values": [ 83752.093802344999858178198337554931640625 ], "test_run_times": [ 14.839999999999999857891452847979962825775146484375 ] } } }, "e65d0aa2ac68b8fcd9ab577886319ba2215b0c59": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: resnet50", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 16.8299999999999982946974341757595539093017578125, "min_result": [ "16.57" ], "max_result": [ "24.47" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 17.190000000000001278976924368180334568023681640625, "min_result": [ "16.86" ], "max_result": [ "35.55" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "fcfde517d809537718f6b7731dc8d0f7ed0716d7": { "identifier": "pts\/ncnn-1.5.0", "title": "NCNN", "app_version": "20230517", "arguments": "-1", "description": "Target: CPU - Model: yolov4-tiny", "scale": "ms", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 25.4200000000000017053025658242404460906982421875, "min_result": [ "24.66" ], "max_result": [ "60.7" ], "test_run_times": [ 98.0199999999999960209606797434389591217041015625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } }, "RESET3": { "value": 25.96000000000000085265128291212022304534912109375, "min_result": [ "25.03" ], "max_result": [ "29.61" ], "test_run_times": [ 100.0499999999999971578290569595992565155029296875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -rdynamic -lgomp -lpthread" } } } } }, "bbe51ef7801e4d5429e7d54adef98799c663dc54": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_point_select 1", "description": "Test: oltp_point_select - Threads: 1", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 5956, "raw_values": [ 5955.8900000000003274180926382541656494140625 ], "test_run_times": [ 608.3700000000000045474735088646411895751953125 ] }, "RESET3": { "value": 6080, "raw_values": [ 6079.9399999999995998223312199115753173828125 ], "test_run_times": [ 594.55999999999994543031789362430572509765625 ] } } }, "65cbd8e8741836bf698b95a83df172f6750b20f2": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op delete -threads 100 -files 1000000", "description": "Operation: Delete - Threads: 100 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 112587, "raw_values": [ 112587.25512272000196389853954315185546875 ], "test_run_times": [ 44.32000000000000028421709430404007434844970703125 ] }, "RESET3": { "value": 114732, "raw_values": [ 114731.528223960005561821162700653076171875 ], "test_run_times": [ 43.159999999999996589394868351519107818603515625 ] } } }, "c4bbfce9687798cec0a5b1c8ea4462c5f79d480f": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op create -threads 500 -files 1000000", "description": "Operation: Create - Threads: 500 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 66037, "raw_values": [ 66037.1128574259928427636623382568359375 ], "test_run_times": [ 27.8299999999999982946974341757595539093017578125 ] }, "RESET3": { "value": 67087, "raw_values": [ 67087.0790285789989866316318511962890625 ], "test_run_times": [ 27.030000000000001136868377216160297393798828125 ] } } }, "807f4d4566ea54a9882855360705b1ab3b8de923": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op rename -threads 100 -files 1000000", "description": "Operation: Rename - Threads: 100 - Files: 1000000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 85800, "raw_values": [ 85800.08580008600256405770778656005859375 ], "test_run_times": [ 47.28999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 84474, "raw_values": [ 84473.72867038400727324187755584716796875 ], "test_run_times": [ 47 ] } } }, "c140dfec0018fc181a99a409aabde3dfc60b3338": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/bert-base\/pytorch\/huggingface\/sst2\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 143.84239999999999781721271574497222900390625, "test_run_times": [ 47.56000000000000227373675443232059478759765625 ] }, "RESET3": { "value": 145.997399999999998954081092961132526397705078125, "test_run_times": [ 47.13000000000000255795384873636066913604736328125 ] } } }, "e98d7f3e55dd7556d5a7e285d585b1f332155a2c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/bert-base\/pytorch\/huggingface\/sst2\/12layer_pruned90-none --scenario async", "description": "Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 31.0243999999999999772626324556767940521240234375, "test_run_times": [ 40.63000000000000255795384873636066913604736328125 ] }, "RESET2": { "value": 31.053200000000000358113538823090493679046630859375, "test_run_times": [ 41.090000000000003410605131648480892181396484375 ] }, "RESET3": { "value": 31.44409999999999882902557146735489368438720703125, "test_run_times": [ 41.42999999999999971578290569595992565155029296875 ] } } }, "bebb62f45ff7622efad92194d1ad4a2932098244": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 33.2488000000000027966962079517543315887451171875, "test_run_times": [ 52.719999999999998863131622783839702606201171875 ] }, "RESET3": { "value": 32.83359999999999701003616792149841785430908203125, "test_run_times": [ 51.99000000000000198951966012828052043914794921875 ] } } }, "00a3faa7c0f772066b32e38912d7efd0da6c6479": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 15.8072999999999996845190253225155174732208251953125, "test_run_times": [ 48.93999999999999772626324556767940521240234375 ] }, "RESET2": { "value": 15.80330000000000012505552149377763271331787109375, "test_run_times": [ 49.4500000000000028421709430404007434844970703125 ] }, "RESET3": { "value": 15.99510000000000076170181273482739925384521484375, "test_run_times": [ 49.32000000000000028421709430404007434844970703125 ] } } }, "3fe07981233683701958382bf8ad2a4f73d4b77e": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 73.204700000000002546585164964199066162109375, "test_run_times": [ 38.93999999999999772626324556767940521240234375 ] }, "RESET3": { "value": 73.9771999999999962938090902753174304962158203125, "test_run_times": [ 38.840000000000003410605131648480892181396484375 ] } } }, "132dca3d993c38d5a37de8fc72f4591ac7eb1ddd": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 607.0286999999999579813447780907154083251953125, "test_run_times": [ 47.840000000000003410605131648480892181396484375 ] }, "RESET2": { "value": 607.469399999999950523488223552703857421875, "test_run_times": [ 47.71000000000000085265128291212022304534912109375 ] }, "RESET3": { "value": 613.0327999999999519786797463893890380859375, "test_run_times": [ 47.61999999999999744204615126363933086395263671875 ] } } }, "85372d2cddb591feb38946fd4fac427c4412616c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 608.1608999999999696228769607841968536376953125, "test_run_times": [ 47.11999999999999744204615126363933086395263671875 ] }, "RESET3": { "value": 614.0225000000000363797880709171295166015625, "test_run_times": [ 47.50999999999999801048033987171947956085205078125 ] } } }, "11f23757bc512e73ec1733c280e61785d8ebeb3b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 48.9951999999999969759301166050136089324951171875, "test_run_times": [ 36.909999999999996589394868351519107818603515625 ] }, "RESET2": { "value": 49.057400000000001227817847393453121185302734375, "test_run_times": [ 37.24000000000000198951966012828052043914794921875 ] }, "RESET3": { "value": 48.739699999999999135980033315718173980712890625, "test_run_times": [ 37.090000000000003410605131648480892181396484375 ] } } }, "a206800656ca18c80dcdf9fcf46e5a86b142079b": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 48.99940000000000139834810397587716579437255859375, "test_run_times": [ 37.39999999999999857891452847979962825775146484375 ] }, "RESET3": { "value": 48.76870000000000260342858382500708103179931640625, "test_run_times": [ 37.28999999999999914734871708787977695465087890625 ] } } }, "4eaee16613e7ebe05edc8651c848b583666fb211": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 111.1047999999999973397279973141849040985107421875, "test_run_times": [ 37.67999999999999971578290569595992565155029296875 ] }, "RESET2": { "value": 110.7357999999999975671016727574169635772705078125, "test_run_times": [ 37.60000000000000142108547152020037174224853515625 ] }, "RESET3": { "value": 111.076200000000000045474735088646411895751953125, "test_run_times": [ 37.67999999999999971578290569595992565155029296875 ] } } }, "460c01e2574e71030ea2d5f4f8acbdc1acaffb5c": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 109.886899999999997135091689415276050567626953125, "test_run_times": [ 37.68999999999999772626324556767940521240234375 ] }, "RESET3": { "value": 110.1321999999999974306774674914777278900146484375, "test_run_times": [ 37.61999999999999744204615126363933086395263671875 ] } } }, "0e601820a058a056ca591d76030131475bde0280": { "identifier": "pts\/deepsparse-1.5.2", "title": "Neural Magic DeepSparse", "app_version": "1.5", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 493.6078999999999723513610661029815673828125, "test_run_times": [ 98.1200000000000045474735088646411895751953125 ] }, "RESET3": { "value": 494.298000000000001818989403545856475830078125, "test_run_times": [ 97.659999999999996589394868351519107818603515625 ] } } }, "30653450091a5324616ffc4e05655eabfbf132c4": { "identifier": "pts\/svt-av1-2.10.0", "title": "SVT-AV1", "app_version": "1.7", "arguments": "--preset 13 -i Bosphorus_3840x2160.y4m -w 3840 -h 2160", "description": "Encoder Mode: Preset 13 - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 161.60300000000000864019966684281826019287109375, "test_run_times": [ 4.37000000000000010658141036401502788066864013671875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } }, "RESET3": { "value": 161.431000000000011596057447604835033416748046875, "test_run_times": [ 4.769999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq" } } } } }, "e8a3b2f5be2a45a32f4105fb38b2f700e7b3cab8": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_point_select 64", "description": "Test: oltp_point_select - Threads: 64", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 118850, "raw_values": [ 118849.509999999994761310517787933349609375 ], "test_run_times": [ 608.4600000000000363797880709171295166015625 ] }, "RESET3": { "test_run_times": [ 13.1199999999999992184029906638897955417633056640625 ], "details": { "error": "The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!" } } } }, "65559351b7161bfb8bf312e3b6a36a985d95c97c": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_point_select 32", "description": "Test: oltp_point_select - Threads: 32", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 97200, "raw_values": [ 97199.729999999995925463736057281494140625 ], "test_run_times": [ 608.990000000000009094947017729282379150390625 ] }, "RESET3": { "test_run_times": [ 13.1099999999999994315658113919198513031005859375 ], "details": { "error": "The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!" } } } }, "4404dd836c53a3446858270f8deecbb5c6e6cb47": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_point_select 16", "description": "Test: oltp_point_select - Threads: 16", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 13.0999999999999996447286321199499070644378662109375 ], "details": { "error": "The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!" } }, "RESET3": { "value": 87667, "raw_values": [ 87666.770000000004074536263942718505859375 ], "test_run_times": [ 595.8300000000000409272615797817707061767578125 ] } } }, "321aa2181b5e8a8a075163c47dee30d3616dfcda": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_read_write 128", "description": "Test: oltp_read_write - Threads: 128", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 59739, "raw_values": [ 59738.580000000001746229827404022216796875 ], "test_run_times": [ 608.4600000000000363797880709171295166015625 ] }, "RESET3": { "test_run_times": [ 13.1400000000000005684341886080801486968994140625 ], "details": { "error": "The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!" } } } }, "9096b53c25653c6900d71ae2e60d7cf7992edcd9": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_read_write 64", "description": "Test: oltp_read_write - Threads: 64", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 13.1199999999999992184029906638897955417633056640625 ], "details": { "error": "The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!" } }, "RESET3": { "value": 94643, "raw_values": [ 94642.66000000000349245965480804443359375 ], "test_run_times": [ 593.6100000000000136424205265939235687255859375 ] } } }, "78d5d1fd2c7f8eade839eb79620da909dceafe07": { "identifier": "pts\/tidb-1.0.3", "title": "TiDB Community Server", "app_version": "7.3", "arguments": "oltp_read_write 1", "description": "Test: oltp_read_write - Threads: 1", "scale": "Queries Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 3204, "raw_values": [ 3203.51999999999998181010596454143524169921875 ], "test_run_times": [ 608.720000000000027284841053187847137451171875 ] }, "RESET3": { "test_run_times": [ 13.1199999999999992184029906638897955417633056640625 ], "details": { "error": "The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!" } } } }, "682dbdac8d9cbf27d04329e64a60c94d2239d269": { "identifier": "pts\/hadoop-1.0.0", "title": "Apache Hadoop", "app_version": "3.3.6", "arguments": "-op fileStatus -threads 20 -files 100000", "description": "Operation: File Status - Threads: 20 - Files: 100000", "scale": "Ops per sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "value": 869565, "raw_values": [ 869565.217391300015151500701904296875 ], "test_run_times": [ 14.28999999999999914734871708787977695465087890625 ] }, "RESET3": { "value": 869565, "raw_values": [ 869565.217391300015151500701904296875 ], "test_run_times": [ 13.4199999999999999289457264239899814128875732421875 ] } } }, "fae59ff6696fea549dab621a5831bf9427f7d022": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=0 --limit=20 Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 60.7000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 42.75 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "2d75c770a5eb5acbdb122d33f661d71b2676ca07": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=0 --limit=20 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 19.519999999999999573674358543939888477325439453125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 13.5800000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "237daa3d06d107e31b3544a81b106d21956d8094": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=4 Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 85.31999999999999317878973670303821563720703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 69.43999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "990b79ac804afca73968b7baa3c93f76668a091d": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=4 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 38.3299999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 35.0799999999999982946974341757595539093017578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "8d62493955ae4c561e259bd78abcc694a66261e9": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=6 Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 42.75999999999999801048033987171947956085205078125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 37.18999999999999772626324556767940521240234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "511070c98f3de850d8acb6f721fdd82147842ace": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=6 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 15.6199999999999992184029906638897955417633056640625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 17.410000000000000142108547152020037174224853515625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "92b13462f9427e2ddca3aab945846c435ba56a86": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=6 --rt Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 8.449999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 9.199999999999999289457264239899814128875732421875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "d2886fa8426cf515a98444b3df164068a1e07adf": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=6 --rt Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 4.3300000000000000710542735760100185871124267578125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 4.2400000000000002131628207280300557613372802734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "7b0e93d55e83f2664ec665cdf0c5c452c8d55b02": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=8 --rt Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 9.1899999999999995026200849679298698902130126953125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 9.5999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "49655d3be8e05ad4e83826a6c578a5f85e8ac760": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=8 --rt Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 4.20999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 4.0099999999999997868371792719699442386627197265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "51ffe15aa8c20a95b9f014f7c6987f558e45cbbc": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=9 --rt Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 8.5099999999999997868371792719699442386627197265625 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 9.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "cf2d52bac08d82251f3c8dcc386e413a5605744c": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=9 --rt Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 4.089999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 3.859999999999999875655021241982467472553253173828125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "4df380d37f9286a7932cf66e837d648ffac3e641": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=10 --rt Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 8.5 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 9.32000000000000028421709430404007434844970703125 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "175c38583119c1c4a6d37417ca8d22a70fc01709": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=10 --rt Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 4.0999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 4.2400000000000002131628207280300557613372802734375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "b5357da4fb8d94eec03165842d5b8b2e9d9a7e50": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=11 --rt Bosphorus_3840x2160.y4m", "description": "Encoder Mode: Speed 11 Realtime - Input: Bosphorus 4K", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 9.839999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 10.25 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "ce004df6382a0005912fcfb18262b1b1f1419af5": { "identifier": "pts\/aom-av1-3.7.0", "title": "AOM AV1", "app_version": "3.7", "arguments": "--cpu-used=11 --rt Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m", "description": "Encoder Mode: Speed 11 Realtime - Input: Bosphorus 1080p", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 4.69000000000000039079850466805510222911834716796875 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 4.589999999999999857891452847979962825775146484375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O3 -std=c++11 -U_FORTIFY_SOURCE -lm" }, "error": "The test run did not produce a result." } } } }, "0c45031a71a671efe82d4234eb66706155d40b76": { "identifier": "pts\/stress-ng-1.11.0", "title": "Stress-NG", "app_version": "0.16.04", "arguments": "--io-uring -1 --no-rand-seed", "description": "Test: IO_uring", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 0.25 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" }, "error": "The test run did not produce a result." } }, "RESET3": { "test_run_times": [ 0.289999999999999980015985556747182272374629974365234375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -std=gnu99 -lc" }, "error": "The test run did not produce a result." } } } }, "19d24684aa1074960671cd0ab70a0d7d0459b7bf": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 60 --ratio=1:100", "description": "Clients Per Thread: 60 - Set To Get Ratio: 1:100", "display_format": "BAR_GRAPH", "results": { "RESET3": { "test_run_times": [ 7.0999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" }, "error": "The test run did not produce a result. E: Connection error: Connection reset by peer" } } } }, "642e74e1533ae2a1de6799c35ff34908b6d43dab": { "identifier": "pts\/dragonflydb-1.1.0", "title": "Dragonflydb", "app_version": "1.6.2", "arguments": "-c 60 --ratio=1:10", "description": "Clients Per Thread: 60 - Set To Get Ratio: 1:10", "display_format": "BAR_GRAPH", "results": { "RESET3": { "test_run_times": [ 7.0999999999999996447286321199499070644378662109375 ], "details": { "compiler-options": { "compiler-type": "CXX", "compiler": "g++", "compiler-options": "-O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre" }, "error": "The test run did not produce a result. E: Connection error: Broken pipe" } } } }, "f06bdc65d8d218e96da2676cdcc292140486c21c": { "identifier": "pts\/build-linux-kernel-1.15.0", "title": "Timed Linux Kernel Compilation", "app_version": "6.1", "arguments": "allmodconfig", "description": "Build: allmodconfig", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "RESET": { "test_run_times": [ 564.1000000000000227373675443232059478759765625 ], "details": { "error": "The test quit with a non-zero exit status." } }, "RESET2": { "test_run_times": [ 565.1599999999999681676854379475116729736328125 ], "details": { "error": "The test quit with a non-zero exit status." } }, "RESET3": { "test_run_times": [ 298.529999999999972715158946812152862548828125 ], "details": { "error": "The test quit with a non-zero exit status." } } } } } }