sdfa

AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312122-PTS-SDFA911983
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
December 11 2023
  22 Hours, 44 Minutes
b
December 12 2023
  7 Hours, 14 Minutes
c
December 12 2023
  21 Hours, 52 Minutes
d
December 12 2023
  21 Hours, 47 Minutes
Invert Hiding All Results Option
  18 Hours, 24 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


{ "title": "sdfa", "last_modified": "2023-12-12 13:51:59", "description": "AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 23.10 via the Phoronix Test Suite.", "systems": { "a": { "identifier": "a", "hardware": { "Processor": "AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "128GB", "Disk": "Samsung SSD 970 EVO Plus 500GB", "Graphics": "AMD Radeon RX 5700 8GB (1750\/875MHz)", "Audio": "AMD Navi 10 HDMI Audio", "Monitor": "DELL P2415Q", "Network": "Intel I211 + Intel Wi-Fi 6 AX200" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.5.0-13-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54)", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "pts", "timestamp": "2023-12-11 22:18:04", "client_version": "10.8.4", "data": { "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0x830107a", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "b": { "identifier": "b", "hardware": { "Processor": "AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "128GB", "Disk": "Samsung SSD 970 EVO Plus 500GB", "Graphics": "AMD Radeon RX 5700 8GB (1750\/875MHz)", "Audio": "AMD Navi 10 HDMI Audio", "Monitor": "DELL P2415Q", "Network": "Intel I211 + Intel Wi-Fi 6 AX200" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.5.0-13-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54)", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "pts", "timestamp": "2023-12-12 01:08:04", "client_version": "10.8.4", "data": { "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0x830107a", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "c": { "identifier": "c", "hardware": { "Processor": "AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "128GB", "Disk": "Samsung SSD 970 EVO Plus 500GB", "Graphics": "AMD Radeon RX 5700 8GB (1750\/875MHz)", "Audio": "AMD Navi 10 HDMI Audio", "Monitor": "DELL P2415Q", "Network": "Intel I211 + Intel Wi-Fi 6 AX200" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.5.0-13-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54)", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "pts", "timestamp": "2023-12-12 02:31:57", "client_version": "10.8.4", "data": { "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0x830107a", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } }, "d": { "identifier": "d", "hardware": { "Processor": "AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores \/ 128 Threads)", "Motherboard": "Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)", "Chipset": "AMD Starship\/Matisse", "Memory": "128GB", "Disk": "Samsung SSD 970 EVO Plus 500GB", "Graphics": "AMD Radeon RX 5700 8GB (1750\/875MHz)", "Audio": "AMD Navi 10 HDMI Audio", "Monitor": "DELL P2415Q", "Network": "Intel I211 + Intel Wi-Fi 6 AX200" }, "software": { "OS": "Ubuntu 23.10", "Kernel": "6.5.0-13-generic (x86_64)", "Desktop": "GNOME Shell 45.0", "Display Server": "X Server + Wayland", "OpenGL": "4.6 Mesa 23.2.1-1ubuntu3 (LLVM 15.0.7 DRM 3.54)", "Compiler": "GCC 13.2.0", "File-System": "ext4", "Screen Resolution": "3840x2160" }, "user": "pts", "timestamp": "2023-12-12 10:46:39", "client_version": "10.8.4", "data": { "cpu-scaling-governor": "acpi-cpufreq schedutil (Boost: Enabled)", "cpu-microcode": "0x830107a", "kernel-extra-details": "Transparent Huge Pages: madvise", "java": "OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)", "python": "Python 3.11.6", "security": "gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "3839e66866895d4c11542e19e018090618c01ed3": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Geometric Mean Of All Queries", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 2.20328734000000014958686733734793961048126220703125, "raw_values": [ 2.14654889999999998195789885357953608036041259765625, 2.19811917999999995032567312591709196567535400390625, 2.2667320499999998872908690827898681163787841796875, 2.201749219999999951369318296201527118682861328125 ], "min_result": [ "0.99" ], "max_result": [ "7.56" ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.245314150000000008589040589868091046810150146484375, "min_result": [ "0.99" ], "max_result": [ "7.7" ], "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.237059110000000128337660498800687491893768310546875, "raw_values": [ 2.24777642000000010824578566825948655605316162109375, 2.235239480000000167336793310823850333690643310546875, 2.22816142000000017020511222654022276401519775390625 ], "min_result": [ "1.05" ], "max_result": [ "7.66" ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.223564459999999964878725222661159932613372802734375, "raw_values": [ 2.214619309999999785532054374925792217254638671875, 2.18972839999999990823198459111154079437255859375, 2.266345670000000200872136701946146786212921142578125 ], "min_result": [ "0.97" ], "max_result": [ "7.7" ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "145d389a201051bdcf6cb842d2efa1d19962cbe3": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q01", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 4.69511842999999995384996509528718888759613037109375, "raw_values": [ 4.65964603000000021637561076204292476177215576171875, 4.81567621000000034570120988064445555210113525390625, 4.51516008000000024225073502748273313045501708984375, 4.789991380000000020800143829546868801116943359375 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 4.73092078999999987587443683878518640995025634765625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 4.84034108999999990174956110422499477863311767578125, "raw_values": [ 4.91843890999999988622448654496110975742340087890625, 4.86660433000000036685150917037390172481536865234375, 4.73598003000000034035110729746520519256591796875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 4.8462298700000001616672307136468589305877685546875, "raw_values": [ 4.82462835000000023200072973850183188915252685546875, 4.99870062000000014990064300945959985256195068359375, 4.715360640000000103100319392979145050048828125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "ee14afb28b163d6ab050d408069970a7f7525bb2": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q02", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.19916511000000003406285031815059483051300048828125, "raw_values": [ 2.132631060000000022824906409368850290775299072265625, 2.32933783999999999281271811923943459987640380859375, 2.098729130000000164812945513403974473476409912109375, 2.23596239000000007735025064903311431407928466796875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.207261320000000193175537788192741572856903076171875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.278467660000000005737774699809961020946502685546875, "raw_values": [ 2.13002658000000000271256794803775846958160400390625, 2.2910244500000001011130734696052968502044677734375, 2.414351939999999974162392391008324921131134033203125 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.2751286799999999033161657280288636684417724609375, "raw_values": [ 2.373452900000000198588168132118880748748779296875, 2.1285822400000000698128133080899715423583984375, 2.323350909999999824862015884718857705593109130859375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "202fe1f00582439ca516dfdcd3b4b2e6e3ad41ca": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q03", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 3.158902589999999843684008737909607589244842529296875, "raw_values": [ 3.226972340000000105675326267373748123645782470703125, 3.109703779999999806449295647325925529003143310546875, 3.09113622000000010103804015670903027057647705078125, 3.207797999999999927212002148735336959362030029296875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 3.239124299999999845312004254083149135112762451171875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 3.345568969999999975328819346032105386257171630859375, "raw_values": [ 3.23614097000000011661313692457042634487152099609375, 3.36560535000000005112497092341072857379913330078125, 3.434960600000000141562850330956280231475830078125 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 3.154473219999999855645000934600830078125, "raw_values": [ 3.13310145999999978272398948320187628269195556640625, 3.2340443099999998111115928622893989086151123046875, 3.096273899999999912324710749089717864990234375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "58d63d4818158a9293382ffec5a97490c754fe67": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q04", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.9602639100000001093349055736325681209564208984375, "raw_values": [ 2.992393729999999862911863601766526699066162109375, 2.91328358999999981193695930414833128452301025390625, 3.015446419999999960737113724462687969207763671875, 2.91993188999999997434997567324899137020111083984375 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 3.0925722100000001546504790894687175750732421875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.944285949999999818516016603098250925540924072265625, "raw_values": [ 2.847852950000000049612935981713235378265380859375, 2.947653530000000188238118425942957401275634765625, 3.037351370000000105875415101763792335987091064453125 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.8585604000000000013415046851150691509246826171875, "raw_values": [ 2.845566509999999826874272912391461431980133056640625, 3.03779674000000010636313163558952510356903076171875, 2.692317960000000010012399798142723739147186279296875 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "8ebf347a8ee1522ca43f4048ebba480c3e2e5507": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q05", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 3.461568059999999835696371519588865339756011962890625, "raw_values": [ 3.336837529999999940599764158832840621471405029296875, 3.474294899999999852724386073532514274120330810546875, 3.404446839999999863124457988305948674678802490234375, 3.63069296000000019120079741696827113628387451171875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 3.377686499999999814036755196866579353809356689453125, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 3.524186530000000150408823174075223505496978759765625, "raw_values": [ 3.466215370000000017824959286372177302837371826171875, 3.41304826999999999515011950279586017131805419921875, 3.693295959999999933387471173773519694805145263671875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 3.309953689999999948412323647062294185161590576171875, "raw_values": [ 3.2979538399999999143119566724635660648345947265625, 3.201268199999999897187308306456543505191802978515625, 3.4306390300000000337377059622667729854583740234375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "6d5cb73edae5b83bc1b51474714c8fd35e52e7d7": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q06", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 0.7587075199999999686184537495137192308902740478515625, "raw_values": [ 0.70322644999999994741557429733802564442157745361328125, 0.83650469999999998993445160522242076694965362548828125, 0.70958441000000005427494897958240471780300140380859375, 0.78551453000000004411873533172183670103549957275390625 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 0.73223764000000002294399337188224308192729949951171875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 0.710825559999999967430994729511439800262451171875, "raw_values": [ 0.69950783000000005262819513518479652702808380126953125, 0.727864859999999946893467495101504027843475341796875, 0.705103990000000013793624020763672888278961181640625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 0.74262397999999996134334878661320544779300689697265625, "raw_values": [ 0.7254536700000000504218178321025334298610687255859375, 0.72354477999999999848768084120820276439189910888671875, 0.778873499999999996390442902338691055774688720703125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "3c61476d3fe480804704309338585dd5a0d1119a": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q07", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 3.1629649999999998044586391188204288482666015625, "raw_values": [ 3.149655819999999994962536220555193722248077392578125, 2.9591231300000000459249349660240113735198974609375, 3.276162859999999898974465395440347492694854736328125, 3.266918179999999782836539452546276152133941650390625 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 3.303481339999999821799292476498521864414215087890625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 3.184302170000000042904275687760673463344573974609375, "raw_values": [ 3.4348654700000000872250893735326826572418212890625, 2.979107139999999986912371241487562656402587890625, 3.138933900000000054575366448261775076389312744140625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 3.253300429999999909824737187591381371021270751953125, "raw_values": [ 3.190788980000000218950617636437527835369110107421875, 3.3153753300000001758007783791981637477874755859375, 3.253736969999999839586735106422565877437591552734375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "407b816162771fc52c67783fbc7ed6e3b585f80a": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q08", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.29091268999999986277771313325501978397369384765625, "raw_values": [ 2.253022909999999878749576964764855802059173583984375, 2.235395430000000072112698035198263823986053466796875, 2.311788799999999977075049173436127603054046630859375, 2.36344361000000002803744791890494525432586669921875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.327807659999999945199533613049425184726715087890625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.357799210000000034170852813986130058765411376953125, "raw_values": [ 2.456990719999999850386984689976088702678680419921875, 2.22926188000000014000079318066127598285675048828125, 2.38714504000000005135007086209952831268310546875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.22529736999999983027009875513613224029541015625, "raw_values": [ 2.115793940000000095125187726807780563831329345703125, 2.196002959999999948337290334166027605533599853515625, 2.364095209999999891437028054497204720973968505859375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "67667611810ce2892ec290511f056f18cc3439dc": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q09", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 4.40090740000000035792027119896374642848968505859375, "raw_values": [ 4.12520075000000030485125535051338374614715576171875, 4.76241827000000039760152503731660544872283935546875, 4.40223074000000025307599571533501148223876953125, 4.3137798299999996487485987017862498760223388671875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 4.51510048000000008272536433651112020015716552734375, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 4.32967218000000020339257389423437416553497314453125, "raw_values": [ 4.28670024999999998982502802391536533832550048828125, 4.54720401999999968012389217619784176349639892578125, 4.155112270000000052050381782464683055877685546875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 4.55872503999999967305711834342218935489654541015625, "raw_values": [ 4.569274899999999917099557933397591114044189453125, 4.24756670000000013942553778178989887237548828125, 4.85933351999999985082467901520431041717529296875 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "6dca9177efb7ac022803115f9744a739bf7d2dbf": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q10", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.837899390000000021672121874871663749217987060546875, "raw_values": [ 2.70316005000000014746319720870815217494964599609375, 2.843916650000000156950363816577009856700897216796875, 2.925219059999999871024556341581046581268310546875, 2.879301789999999972025079841841943562030792236328125 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 3.079596280000000074750232670339755713939666748046875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 3.029143570000000007524931788793765008449554443359375, "raw_values": [ 2.97584844000000003916284185834228992462158203125, 3.098371269999999899624754107207991182804107666015625, 3.01321101000000002301248969160951673984527587890625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 3.14210589999999978516598275746218860149383544921875, "raw_values": [ 3.067239049999999966900077197351492941379547119140625, 3.14660645000000016580088413320481777191162109375, 3.212472200000000110975406641955487430095672607421875 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "7a2634a6a9169f7c019048ed78a82af59fb59f67": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q11", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.3084985600000000882658923728740774095058441162109375, "raw_values": [ 1.1779822099999999185371279963874258100986480712890625, 1.4578862200000000104438413472962565720081329345703125, 1.4331012999999999113498461156268604099750518798828125, 1.1650245200000000078688344729016534984111785888671875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 1.3644779899999999184245780270430259406566619873046875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 1.2897426700000000909795971892890520393848419189453125, "raw_values": [ 1.090895179999999964337575875106267631053924560546875, 1.584018710000000051962842917419038712978363037109375, 1.194314120000000034593767850310541689395904541015625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 1.29190468999999996668748281081207096576690673828125, "raw_values": [ 1.1676121999999999889752189119462855160236358642578125, 1.1977222000000000701191993357497267425060272216796875, 1.5103796700000000630126351097715087234973907470703125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "2819e99ff39e485d43298a9bb585d40351727fa6": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q12", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.149872690000000030607907319790683686733245849609375, "raw_values": [ 1.9928544800000000947193257161416113376617431640625, 1.972126250000000080575546235195361077785491943359375, 2.599070549999999979462472765590064227581024169921875, 2.0354394899999999068995748530142009258270263671875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.029419900000000165363189807976596057415008544921875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.040395380000000091769152277265675365924835205078125, "raw_values": [ 2.082870010000000160488298206473700702190399169921875, 1.951017259999999975406126395682804286479949951171875, 2.087298870000000139413032229640521109104156494140625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.069544159999999966004224916105158627033233642578125, "raw_values": [ 2.060463429999999984687519827275536954402923583984375, 2.03306102999999982472445481107570230960845947265625, 2.115108010000000149375409819185733795166015625 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "edb0d0909f27a4c885f013b069f5635ccff235c5": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q13", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.4005866399999999938330574877909384667873382568359375, "raw_values": [ 1.4002345800000000064500227381358854472637176513671875, 1.296926379999999934256038613966666162014007568359375, 1.4584395900000000079188566814991645514965057373046875, 1.4467459899999999262121264109737239778041839599609375 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 1.45866322999999997733766576857306063175201416015625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 1.3999168099999999004268147473339922726154327392578125, "raw_values": [ 1.33347820999999999713736542616970837116241455078125, 1.3688328299999998893810015943017788231372833251953125, 1.4974393800000000975813918557832948863506317138671875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 1.3922555100000000294357960228808224201202392578125, "raw_values": [ 1.39726149999999993411847754032351076602935791015625, 1.3426048799999998895060571157955564558506011962890625, 1.436900140000000103412958196713589131832122802734375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "d27aab7b368fb9669c294cd85380a19444340749": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q14", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.83231535999999994857034835149534046649932861328125, "raw_values": [ 1.760839339999999975105993144097737967967987060546875, 1.8521012100000000533128741153632290661334991455078125, 1.7941173299999999546372464465093798935413360595703125, 1.9222035399999999327746991184540092945098876953125 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 1.781570550000000086043883129605092108249664306640625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 1.8383659900000000053665871746488846838474273681640625, "raw_values": [ 1.8584637600000000201561078938539139926433563232421875, 1.825876829999999895193241172819398343563079833984375, 1.830757380000000100750412457273341715335845947265625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 1.8321913899999999753021029391675256192684173583984375, "raw_values": [ 1.8648719799999999846562559469020925462245941162109375, 1.7839138500000000231437979891779832541942596435546875, 1.8477883299999999788809645906439982354640960693359375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "c2da3e2fc1946e58a884de6c031b028a19e7148d": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q15", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.9949158700000000354890516973682679235935211181640625, "raw_values": [ 1.906595709999999943562443149858154356479644775390625, 2.037877079999999896386952968896366655826568603515625, 2.094832900000000108775566332042217254638671875, 1.9403577999999999104119297044235281646251678466796875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.17460774999999983947418513707816600799560546875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.14363773999999995822918208432383835315704345703125, "raw_values": [ 2.554788589999999803836772116483189165592193603515625, 1.954695459999999940237103146500885486602783203125, 1.9214291599999999693437757741776295006275177001953125 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.277157310000000212113491215859539806842803955078125, "raw_values": [ 2.163079740000000139588109959731809794902801513671875, 2.45482086999999982168674250715412199497222900390625, 2.21357130999999984766191118978895246982574462890625 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "237747b84d84430f39651813934d96b4b24b5d90": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q16", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.427312909999999934740344542660750448703765869140625, "raw_values": [ 1.4353505399999999525562088820151984691619873046875, 1.3940247299999999341935108532197773456573486328125, 1.4336532399999999398687577922828495502471923828125, 1.4462231400000000736127958589349873363971710205078125 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 1.4393985300000000648878994979895651340484619140625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 1.4944876000000000271228373094345442950725555419921875, "raw_values": [ 1.544006589999999956575038595474325120449066162109375, 1.3761902999999999774871639601769857108592987060546875, 1.56326592000000008653159966343082487583160400390625 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 1.539288200000000106371089714230038225650787353515625, "raw_values": [ 1.4719606599999999207994960670475848019123077392578125, 1.6322082300000000376627440346055664122104644775390625, 1.5136957200000000778317144067841582000255584716796875 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "17ddcad9c750b1678e457b9bc186f966042a8265": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q17", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.66192222000000011661313692457042634487152099609375, "raw_values": [ 2.624920130000000018100081433658488094806671142578125, 2.6311178200000000515501596964895725250244140625, 2.7091295699999999868623490328900516033172607421875, 2.68252134000000008740016710362397134304046630859375 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.72264193999999992712446328368969261646270751953125, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.585270720000000022054109649616293609142303466796875, "raw_values": [ 2.548011300000000201038119485019706189632415771484375, 2.605727669999999829286707608844153583049774169921875, 2.602073190000000035837501854985021054744720458984375 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.577730499999999924654048299998976290225982666015625, "raw_values": [ 2.6329321900000000056252247304655611515045166015625, 2.515957119999999935799905870226211845874786376953125, 2.58430218999999983253701429930515587329864501953125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "97d5d7b982e8495d2440dab19cd0fff3f3e1f73b": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q18", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 4.00372249000000035579205359681509435176849365234375, "raw_values": [ 3.89608693000000005923766366322524845600128173828125, 3.88567543000000004127514330320991575717926025390625, 3.92109155999999980934944687760435044765472412109375, 4.31203603999999973694912114297039806842803955078125 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 4.04589510000000007750031727482564747333526611328125, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 3.993240670000000047679122872068546712398529052734375, "raw_values": [ 3.793923850000000097537622423260472714900970458984375, 4.07491112000000033077640182455070316791534423828125, 4.11088704999999965394863465917296707630157470703125 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 3.869211359999999988446006682352162897586822509765625, "raw_values": [ 4.0781769800000002845763447112403810024261474609375, 3.629645109999999785799218443571589887142181396484375, 3.89981197999999995573716660146601498126983642578125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "b00a2d6a7ee7d6acec8c5cb332b26d05bfe84e5e": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q19", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.0284703799999999063174982438795268535614013671875, "raw_values": [ 0.99407016999999997519665839718072675168514251708984375, 1.1059559599999999601749323119292967021465301513671875, 0.9962863299999999977529796524322591722011566162109375, 1.017569069999999964437620292301289737224578857421875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 1.173945900000000097662677944754250347614288330078125, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 1.20837911000000008954202712629921734333038330078125, "raw_values": [ 1.3174821100000000395624510929337702691555023193359375, 1.0553640099999999080182533361949026584625244140625, 1.2522911999999999377308768089278601109981536865234375 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 0.9943581999999999698758301747147925198078155517578125, "raw_values": [ 1.0318446199999999901564251558738760650157928466796875, 0.97491980000000000305959702018299140036106109619140625, 0.976310189999999966659061101381666958332061767578125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "08f65794bab112978be073c508883a00c942420a": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q20", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 2.755551759999999905659251453471370041370391845703125, "raw_values": [ 2.961143729999999862911863601766526699066162109375, 2.538043259999999801124204168445430696010589599609375, 2.8629345900000000568752511753700673580169677734375, 2.660085440000000023275106286746449768543243408203125 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 2.587625979999999881187022765516303479671478271484375, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 2.752848230000000118167235996224917471408843994140625, "raw_values": [ 2.76260114000000012168811736046336591243743896484375, 2.98613572000000004891262506134808063507080078125, 2.509807830000000183900965566863305866718292236328125 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 2.74797662000000020299239622545428574085235595703125, "raw_values": [ 2.99599361000000019572553355828858911991119384765625, 2.503904579999999935324694888549856841564178466796875, 2.7440316700000000338377503794617950916290283203125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "667b9fec117e9447e77f309e25e3ab01a671c6ee": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q21", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 7.39505470000000020291963664931245148181915283203125, "raw_values": [ 7.17807817000000003559989636414684355258941650390625, 7.45341348999999997460008671623654663562774658203125, 7.56079864999999973207422954146750271320343017578125, 7.38792849000000018122591427527368068695068359375 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 7.70369244000000019667595552164129912853240966796875, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 7.4619758899999997225904735387302935123443603515625, "raw_values": [ 7.24589586000000007715016181464307010173797607421875, 7.48367166999999966492396197281777858734130859375, 7.65636015000000025310100681963376700878143310546875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 7.4077355100000001897342372103594243526458740234375, "raw_values": [ 7.41086721000000014925035429769195616245269775390625, 7.70355367999999973704916556016542017459869384765625, 7.10878562999999985549948178231716156005859375 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "1038fd7d4a27858f5ed637bbdf8d43b0f7059120": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 1", "description": "Scale Factor: 1 - Q22", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3839e66866895d4c11542e19e018090618c01ed3", "results": { "a": { "value": 1.0850228399999999329139654946629889309406280517578125, "raw_values": [ 1.1006480499999999889126911511993966996669769287109375, 1.0636140099999999986124521456076763570308685302734375, 1.073484179999999899024487604037858545780181884765625, 1.1023451099999999058809407870285212993621826171875 ], "test_run_times": [ 64.75, 66.150000000000005684341886080801486968994140625, 66.909999999999996589394868351519107818603515625, 66.68000000000000682121026329696178436279296875 ] }, "b": { "value": 0.9888632299999999819561935510137118399143218994140625, "test_run_times": [ 67.2099999999999937472239253111183643341064453125 ] }, "c": { "value": 1.058803240000000034370941648376174271106719970703125, "raw_values": [ 1.064449189999999934030938675277866423130035400390625, 1.0630342999999999875626599532552063465118408203125, 1.0489262299999999594746213915641419589519500732421875 ], "test_run_times": [ 66.659999999999996589394868351519107818603515625, 67.150000000000005684341886080801486968994140625, 67.06999999999999317878973670303821563720703125 ] }, "d": { "value": 1.061138469999999944803903417778201401233673095703125, "raw_values": [ 1.03831469999999992381845004274509847164154052734375, 1.0833506600000000208439132620696909725666046142578125, 1.0617500499999998897493469485198147594928741455078125 ], "test_run_times": [ 66.56000000000000227373675443232059478759765625, 66.2999999999999971578290569595992565155029296875, 66.8599999999999994315658113919198513031005859375 ] } } }, "3e84b2d01ae7ee0550c9911c298ebea0678ae176": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Geometric Mean Of All Queries", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 8.17090667000000081543475971557199954986572265625, "raw_values": [ 8.18123806999999914069121587090194225311279296875, 8.165898999999999574583853245712816715240478515625, 8.165582929999999350911821238696575164794921875 ], "min_result": [ "3.42" ], "max_result": [ "29.75" ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 7.8939945500000003875129550579003989696502685546875, "min_result": [ "3.4" ], "max_result": [ "28.8" ], "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 8.1114257500000004341700332588516175746917724609375, "raw_values": [ 8.0292850799999992972288964665494859218597412109375, 8.21283674000000019077560864388942718505859375, 8.0921554199999992107450452749617397785186767578125 ], "min_result": [ "3.43" ], "max_result": [ "29.17" ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 8.2456727300000007829794412828050553798675537109375, "raw_values": [ 8.2637516099999999141800799407064914703369140625, 8.2664716400000006757409209967590868473052978515625, 8.2067949500000008100641935016028583049774169921875 ], "min_result": [ "3.57" ], "max_result": [ "29.28" ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "3cbe669108b2eaf1291aaba7c9b28a3370b1ae5f": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q01", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 8.6783374200000000797672328189946711063385009765625, "raw_values": [ 8.820805549999999328747435356490314006805419921875, 8.6274137500000005474021236295811831951141357421875, 8.586792949999999535748429480008780956268310546875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 8.7015180599999997212989910622127354145050048828125, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 8.666814479999999321080395020544528961181640625, "raw_values": [ 8.5843934999999991219965522759594023227691650390625, 8.882546420000000608752088737674057483673095703125, 8.533503530000000836253093439154326915740966796875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 8.73231696999999940089765004813671112060546875, "raw_values": [ 8.727771759999999545698301517404615879058837890625, 8.835741999999999762849256512708961963653564453125, 8.633437159999999721549102105200290679931640625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "2f4de7e794a4a2bf3fb33839d779a0e39380448f": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q02", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 4.8509952199999997191071088309399783611297607421875, "raw_values": [ 4.81147289000000011327529136906377971172332763671875, 4.9045662899999999950750861898995935916900634765625, 4.83694648999999987637465892476029694080352783203125 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 4.88495015999999981914925228920765221118927001953125, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 4.92897081000000003569994078134186565876007080078125, "raw_values": [ 4.81976604000000019567551134969107806682586669921875, 5.03413820000000011845031622215174138545989990234375, 4.93300818999999979297399477218277752399444580078125 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 4.79437430000000031071749617694877088069915771484375, "raw_values": [ 4.7514619800000001959006112883798778057098388671875, 4.848961349999999725923771620728075504302978515625, 4.78269958000000006137497621239162981510162353515625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "0ed2cfdda734ce3fe0d7dda2440b5b40613b1f91": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q03", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 10.2440671900000008776032700552605092525482177734375, "raw_values": [ 10.8007411999999991536469678976573050022125244140625, 9.8735694899999995044481693184934556484222412109375, 10.057890889999999473047864739783108234405517578125 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 10.3212261200000003924515112885273993015289306640625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 10.264451030000000031350282370112836360931396484375, "raw_values": [ 9.861989969999999772198862046934664249420166015625, 10.7678260800000007435528459609486162662506103515625, 10.1635370300000005272522685118019580841064453125 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 10.1522455199999992458970154984854161739349365234375, "raw_values": [ 10.15395737000000053740222938358783721923828125, 10.1535253500000006710024536005221307277679443359375, 10.1492538499999991330469129025004804134368896484375 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "d1a831e086894e552d0ca328e16453a050d98eb1": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q04", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 8.63682969999999983201632858254015445709228515625, "raw_values": [ 9.044255259999999907449819147586822509765625, 8.678223609999999865749487071298062801361083984375, 8.1880102200000006718028089380823075771331787109375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 8.70809077999999914254658506251871585845947265625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 8.5045766799999995555481291376054286956787109375, "raw_values": [ 8.6083774599999998144994606263935565948486328125, 8.335689540000000619102138443849980831146240234375, 8.5696630500000008368033377337269484996795654296875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 8.3395834000000004238017936586402356624603271484375, "raw_values": [ 8.364909170000000671052475809119641780853271484375, 8.1999893200000002480010152794420719146728515625, 8.4538516999999995249481798964552581310272216796875 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "4f543278efec72f5d4b5f533d14432e0173e78b4": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q05", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 12.4760735799999995521147866384126245975494384765625, "raw_values": [ 12.0172872500000007534026735811494290828704833984375, 12.774855609999999472847775905393064022064208984375, 12.6360778800000002064507498289458453655242919921875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 12.9188852300000007744529284536838531494140625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 12.6633793499999995901816873811185359954833984375, "raw_values": [ 12.2934417699999993800474840099923312664031982421875, 13.3268995300000003823015504167415201663970947265625, 12.3697967500000007845528671168722212314605712890625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 12.6566190699999996382985045784153044223785400390625, "raw_values": [ 12.511609079999999494248186238110065460205078125, 13.0170860299999997522490957635454833507537841796875, 12.44116211000000049580194172449409961700439453125 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "e3fc2714676ca71af71bc0458215d2d957684c99": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q06", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 4.401313619999999815490809851326048374176025390625, "raw_values": [ 4.37515067999999995862481227959506213665008544921875, 4.4877219200000002530259735067375004291534423828125, 4.34106827000000006222535375854931771755218505859375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 4.62162923999999986079956215689890086650848388671875, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 4.30036067999999982447434376808814704418182373046875, "raw_values": [ 4.29348802999999978879941409104503691196441650390625, 4.32151890000000005187530405237339437007904052734375, 4.28607511999999957197360345162451267242431640625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 4.36710961999999991434151525027118623256683349609375, "raw_values": [ 4.3140068100000004136518327868543565273284912109375, 4.4207038900000004133516995352692902088165283203125, 4.3666181599999998041994331288151443004608154296875 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "ffd01a08f795e70d6a02e422669bce9b91628a6f": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q07", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 10.6311874399999997109489413560368120670318603515625, "raw_values": [ 10.8604021100000007749031283310614526271820068359375, 10.517088890000000134250512928701937198638916015625, 10.5160713200000000000500222085975110530853271484375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 10.531743999999999772398950881324708461761474609375, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 10.6200927099999997693657860509119927883148193359375, "raw_values": [ 10.5175485599999998242992660379968583583831787109375, 10.6629857999999995143980413558892905712127685546875, 10.6797437699999999694000507588498294353485107421875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 10.7454160000000005226183930062688887119293212890625, "raw_values": [ 11.08524036000000023705069907009601593017578125, 10.5732584000000002788510755635797977447509765625, 10.577749250000000103000274975784122943878173828125 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "331502f7730345bcb204fd7b25cfe689c23755a0": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q08", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 10.99399408000000022411768441088497638702392578125, "raw_values": [ 10.75748538999999937004758976399898529052734375, 11.019482610000000732952685211785137653350830078125, 11.205014229999999741949068265967071056365966796875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 10.670455929999999256096998578868806362152099609375, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 10.85271359000000046535205910913646221160888671875, "raw_values": [ 11.1450147600000004644016371457837522029876708984375, 10.7240257299999992568473317078314721584320068359375, 10.689100270000000847403498482890427112579345703125 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 10.81727695000000011305019143037497997283935546875, "raw_values": [ 10.857457159999999163346728892065584659576416015625, 10.927787779999999173696778598241508007049560546875, 10.666585919999999276797097991220653057098388671875 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "e858f84bf6f7bf851a7218fb5afd16d0aac265d9": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q09", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 14.8994369500000001238504410139285027980804443359375, "raw_values": [ 14.6738128700000007853532224544323980808258056640625, 14.594253540000000413101588492281734943389892578125, 15.430244450000000000500222085975110530853271484375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 14.1802969000000000932004695641808211803436279296875, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 14.818981170000000702202669344842433929443359375, "raw_values": [ 14.7681865699999992358470990438945591449737548828125, 14.9581432299999992352468325407244265079498291015625, 14.73061371000000008280039764940738677978515625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 14.920975049999999129113348317332565784454345703125, "raw_values": [ 15.079462050000000061800164985470473766326904296875, 14.32062149000000061960236052982509136199951171875, 15.362841610000000258651198237203061580657958984375 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "8846518ca7f29cd91d9737b16acf5f822e62c39d": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q10", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 10.265551880000000295467543764971196651458740234375, "raw_values": [ 10.1831302600000004332514436100609600543975830078125, 10.1088018399999999274996298481710255146026611328125, 10.5047235499999995766984284273348748683929443359375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 10.18445492000000029975126381032168865203857421875, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 10.419712069999999215497155091725289821624755859375, "raw_values": [ 10.4841098800000001034504748531617224216461181640625, 10.3860225699999997317490851855836808681488037109375, 10.389003750000000536601874046027660369873046875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 10.3587229999999994589643392828293144702911376953125, "raw_values": [ 10.337773320000000154550434672273695468902587890625, 10.3571748699999997000986695638857781887054443359375, 10.381220819999999349647623603232204914093017578125 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "96c82d982fce91111e065d1bcf9df83047ef2ff2": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q11", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 4.549316250000000394493326894007623195648193359375, "raw_values": [ 4.5332579600000002528759068809449672698974609375, 4.6241321600000002689512257347814738750457763671875, 4.4905586199999998342491380753926932811737060546875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 4.26761341000000005152514859219081699848175048828125, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 4.389634290000000049758455133996903896331787109375, "raw_values": [ 4.43225192999999961784851620905101299285888671875, 4.37423705999999956617330099106766283512115478515625, 4.3624138800000000770751285017468035221099853515625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 4.48057459999999974087359078112058341503143310546875, "raw_values": [ 4.462133879999999663823473383672535419464111328125, 4.4920315699999999736746758571825921535491943359375, 4.48755836000000041252633309341035783290863037109375 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "c5f1c4de65e94ee007a45e3ab391ba3ee3e830e2": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q12", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 8.03465001000000000885847839526832103729248046875, "raw_values": [ 8.0745468099999992972470863605849444866180419921875, 7.94733762999999981957444106228649616241455078125, 8.0820655800000000823501977720297873020172119140625 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 8.1085929900000000003501554601825773715972900390625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 8.171160379999999889832906774245202541351318359375, "raw_values": [ 8.1389303200000000515501596964895725250244140625, 8.1980848300000008777033144724555313587188720703125, 8.176465990000000516602085554040968418121337890625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 8.09419774999999930287231109105050563812255859375, "raw_values": [ 8.16351891000000051690221880562603473663330078125, 7.99358797000000009802533895708620548248291015625, 8.125486370000000846403054310940206050872802734375 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "a658d98ad91a5427e556aa0029dc7f8f3622c0ad": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q13", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 4.45708307000000036879328035865910351276397705078125, "raw_values": [ 4.1143441200000001600756149855442345142364501953125, 4.182931899999999814099282957613468170166015625, 5.07397318000000030480123314191587269306182861328125 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 4.0369801499999997673739926540292799472808837890625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 4.0977700600000002140177457476966083049774169921875, "raw_values": [ 3.99966287999999980939946908620186150074005126953125, 4.09989119000000012960072126588784158229827880859375, 4.1937560999999998756493369000963866710662841796875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 4.61340586000000030253431759774684906005859375, "raw_values": [ 4.84571600000000035635139283840544521808624267578125, 4.88809060999999989149955581524409353733062744140625, 4.10641097999999971079887473024427890777587890625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "3b4bc5e2641c171f4934484ef8871dcd325dfa74": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q14", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 5.79615275000000007565859050373546779155731201171875, "raw_values": [ 5.7519736300000001705257091089151799678802490234375, 5.845884319999999689798642066307365894317626953125, 5.79060030000000036665142033598385751247406005859375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 5.82840871999999965424876791075803339481353759765625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 5.86177412999999969400732879876159131526947021484375, "raw_values": [ 5.8075375600000000986256054602563381195068359375, 5.9109964399999999073997969389893114566802978515625, 5.866788389999999964175003697164356708526611328125 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 5.7352247199999997206987245590426027774810791015625, "raw_values": [ 5.645750050000000186400939128361642360687255859375, 5.7734675400000003975264917244203388690948486328125, 5.78645658000000029375087251537479460239410400390625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "00d6ed7fe1b7b499447943f588e88f14cff9f3bf": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q15", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 5.83709431000000034117647373932413756847381591796875, "raw_values": [ 5.903920649999999881174517213366925716400146484375, 5.7943854300000001700254870229400694370269775390625, 5.81297684000000014492570699076168239116668701171875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 5.6808953300000002428760126349516212940216064453125, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 5.810214359999999800265868543647229671478271484375, "raw_values": [ 5.86738538999999992284983818535692989826202392578125, 5.747022630000000020800143829546868801116943359375, 5.81623507000000028455133360694162547588348388671875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 5.85565598999999981089104039710946381092071533203125, "raw_values": [ 5.7797708500000002374008545302785933017730712890625, 5.9405660600000000926002030610106885433197021484375, 5.84663105000000005162519300938583910465240478515625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "65ea1b7a8a0f57598dbc9219f9db7903debad6ca": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q16", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 4.3205062600000001538091964903287589550018310546875, "raw_values": [ 4.389781479999999902474883128888905048370361328125, 4.32215976999999984542455422342754900455474853515625, 4.24957751999999988612444212776608765125274658203125 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 4.1559176400000001905254976009018719196319580078125, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 4.1757297500000003509512680466286838054656982421875, "raw_values": [ 4.34557055999999963802338243112899363040924072265625, 4.106706140000000004874891601502895355224609375, 4.07491254999999963359869070700369775295257568359375 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 4.3460125999999998924749888828955590724945068359375, "raw_values": [ 4.34211493000000015030082067823968827724456787109375, 4.35069179999999988694980856962502002716064453125, 4.345231059999999700949047110043466091156005859375 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "13e3484063423e7a90ec43acd9b12fb889a34330": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q17", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 12.4504473999999998312659954535774886608123779296875, "raw_values": [ 12.46648311999999947374817566014826297760009765625, 12.266399379999999297297108569182455539703369140625, 12.6184597000000007227527021314017474651336669921875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 12.4410772299999994316976881236769258975982666015625, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 12.41860390000000080590325524099171161651611328125, "raw_values": [ 12.355519290000000154350345837883651256561279296875, 12.4029588700000008572033038944937288761138916015625, 12.4973335300000005787524059996940195560455322265625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 12.400583590000000100417310022749006748199462890625, "raw_values": [ 12.286863329999999194797055679373443126678466796875, 12.2498884199999995558982845977880060672760009765625, 12.6649990100000007231528798001818358898162841796875 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "5cde70bffa421086b2351dd4045b82ef5a8239c3": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q18", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 14.862232529999999997016857378184795379638671875, "raw_values": [ 14.7413740200000003000013748533092439174652099609375, 15.093971249999999173496689763851463794708251953125, 14.7513523099999996901487975264899432659149169921875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 14.8768053099999999489000401808880269527435302734375, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 16.114520389999999139263309189118444919586181640625, "raw_values": [ 15.8125152599999996283486325410194694995880126953125, 14.9238319399999994629979482851922512054443359375, 17.607213970000000102800186141394078731536865234375 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 14.9112904900000007302196536329574882984161376953125, "raw_values": [ 15.08660697999999911189661361277103424072265625, 14.9170885099999992462471709586679935455322265625, 14.7301759699999994523977875360287725925445556640625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "ee45a4d6feb8bfeb0751ae7d3f8b91859865b1a3": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q19", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 7.21627537999999990603328114957548677921295166015625, "raw_values": [ 7.78597975000000008805045581539161503314971923828125, 7.86767053999999976809931467869319021701812744140625, 5.9951758399999999227247826638631522655487060546875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 6.042502400000000051250026444904506206512451171875, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 6.543281549999999668898453819565474987030029296875, "raw_values": [ 5.88228129999999982402414389071054756641387939453125, 7.8102006900000002787010089377872645854949951171875, 5.93736266999999973137391862110234797000885009765625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 8.02795346999999992476659826934337615966796875, "raw_values": [ 7.989926340000000237751009990461170673370361328125, 8.0861578000000005062020136392675340175628662109375, 8.0077762599999999792999005876481533050537109375 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "17bf40d7f515e5de4f355dcc13a3c95169023a39": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q20", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 8.8416096399999997146323948982171714305877685546875, "raw_values": [ 8.815232280000000031350282370112836360931396484375, 8.963172910000000825903043732978403568267822265625, 8.746423719999999235596988000907003879547119140625 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 8.8766384099999999790497895446605980396270751953125, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 8.9121713600000003197010300937108695507049560546875, "raw_values": [ 8.88633727999999933899744064547121524810791015625, 8.9176912300000008571032594772987067699432373046875, 8.9324855799999998140492607490159571170806884765625 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 8.8245258300000006812524588895030319690704345703125, "raw_values": [ 8.8521175400000000621503204456530511379241943359375, 8.660315510000000216450644074939191341400146484375, 8.9611444500000008162032827385701239109039306640625 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "671c413cfa986d985ae3d95c95bc989b74cce721": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q21", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 29.314933780000000496102074976079165935516357421875, "raw_values": [ 28.87385941000000144640580401755869388580322265625, 29.3183479300000016110061551444232463836669921875, 29.75259399000000115620423457585275173187255859375 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 28.798635480000001507505658082664012908935546875, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 29.03367678000000040583472582511603832244873046875, "raw_values": [ 28.7903575899999992770972312428057193756103515625, 29.1716651899999988017953000962734222412109375, 29.139007570000000413301677326671779155731201171875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 28.908061350000000544469003216363489627838134765625, "raw_values": [ 28.58867645000000123900463222526013851165771484375, 29.2763462099999998144994606263935565948486328125, 28.859161379999999752499206806533038616180419921875 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "a6582049fae98d7b9cc6b7c2a4af7d3309598638": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 10", "description": "Scale Factor: 10 - Q22", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "3e84b2d01ae7ee0550c9911c298ebea0678ae176", "results": { "a": { "value": 3.5358621299999999365581970778293907642364501953125, "raw_values": [ 3.7461669400000001672879079706035554409027099609375, 3.417890310000000209100790016236715018749237060546875, 3.4435291299999999381498128059320151805877685546875 ], "test_run_times": [ 213.719999999999998863131622783839702606201171875, 214.68000000000000682121026329696178436279296875, 214.719999999999998863131622783839702606201171875 ] }, "b": { "value": 3.40110779000000018612581698107533156871795654296875, "test_run_times": [ 211.840000000000003410605131648480892181396484375 ] }, "c": { "value": 3.69966157999999989414163792389445006847381591796875, "raw_values": [ 3.42876387000000004690036803367547690868377685546875, 4.059263709999999747424226370640099048614501953125, 3.61095714999999994887502907658927142620086669921875 ], "test_run_times": [ 212.490000000000009094947017729282379150390625, 215.43999999999999772626324556767940521240234375, 213.990000000000009094947017729282379150390625 ] }, "d": { "value": 3.596826070000000097337533588870428502559661865234375, "raw_values": [ 3.607361790000000123512791105895303189754486083984375, 3.61669253999999984472424330306239426136016845703125, 3.566423889999999818911646798369474709033966064453125 ], "test_run_times": [ 214.18000000000000682121026329696178436279296875, 214.280000000000001136868377216160297393798828125, 213.770000000000010231815394945442676544189453125 ] } } }, "6018fc76daa8d9a5345f9cb4ee239b4409f6890b": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Geometric Mean Of All Queries", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 27.975628230000001650523699936456978321075439453125, "raw_values": [ 27.907254359999999593355823890306055545806884765625, 28.159343820000000135905793285928666591644287109375, 27.86028651000000166959580383263528347015380859375 ], "min_result": [ "8.84" ], "max_result": [ "131.32" ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 27.7868289299999986496914061717689037322998046875, "min_result": [ "8.69" ], "max_result": [ "131.46" ], "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 28.11219412999999889279933995567262172698974609375, "raw_values": [ 27.958936210000000954778442974202334880828857421875, 28.3941245500000007950802682898938655853271484375, 27.98352163999999930865669739432632923126220703125 ], "min_result": [ "8.58" ], "max_result": [ "132.82" ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 28.12394225999999974874299368821084499359130859375, "raw_values": [ 27.832239650000001773832991602830588817596435546875, 28.3480477600000000393265509046614170074462890625, 28.191539379999998260473148548044264316558837890625 ], "min_result": [ "8.73" ], "max_result": [ "132.42" ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "ed6267f65acfe715546840f6114d81de008e7796": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q01", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 26.02234904000000170753992279060184955596923828125, "raw_values": [ 25.889898299999998698694980703294277191162109375, 26.004219060000000496302163810469210147857666015625, 26.172929759999998822195266257040202617645263671875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 25.990354539999998451094143092632293701171875, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 26.001666390000000461668605566956102848052978515625, "raw_values": [ 26.038423540000000144800651469267904758453369140625, 25.824359890000000206100594368763267993927001953125, 26.142215730000000206700860871933400630950927734375 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 26.119038270000000778736648499034345149993896484375, "raw_values": [ 26.183933259999999876299625611864030361175537109375, 26.39916038999999869929524720646440982818603515625, 25.774021149999999380497683887369930744171142578125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "5cc96524f6201536aefbe14be178113a67d1ae22": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q02", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 10.4835224199999998972998582758009433746337890625, "raw_values": [ 10.7201747899999997315489963511936366558074951171875, 10.5966386799999998657995092798955738544464111328125, 10.13375377999999926714735920540988445281982421875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 10.4503164300000008779534255154430866241455078125, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 10.560948690000000027566784410737454891204833984375, "raw_values": [ 10.396928790000000475401975563727319240570068359375, 10.5975685100000003302511686342768371105194091796875, 10.6883487699999992770472090342082083225250244140625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 10.4435723599999992217135513783432543277740478515625, "raw_values": [ 10.2123546600000008055530997808091342449188232421875, 10.6197452499999993591472957632504403591156005859375, 10.498617169999999276797097991220653057098388671875 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "97f89f707827d8c5f2e48dc80f3ad1a92b5fde1f": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q03", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 36.61449941000000052326868171803653240203857421875, "raw_values": [ 36.817317959999996901387930847704410552978515625, 35.69110107000000198240741156041622161865234375, 37.3350791900000018586069927550852298736572265625 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 36.02916718000000173560692928731441497802734375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 37.058446250000002919477992691099643707275390625, "raw_values": [ 37.3221092200000015282057574950158596038818359375, 36.964931489999997893391991965472698211669921875, 36.8882980300000014040051610209047794342041015625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 35.99200438999999818179276189766824245452880859375, "raw_values": [ 35.4410476700000032224124879576265811920166015625, 35.72402190999999760379068902693688869476318359375, 36.810943600000001652006176300346851348876953125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "f4a9bd7924dc19c7c3c00fe82ee04691b700cbb7": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q04", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 30.584877649999999249530446832068264484405517578125, "raw_values": [ 30.213975909999998492594386334531009197235107421875, 31.08570861999999834779373486526310443878173828125, 30.45494843000000173560692928731441497802734375 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 30.268709179999998326593413366936147212982177734375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 30.22341601000000110843757283873856067657470703125, "raw_values": [ 30.428569790000000949703462538309395313262939453125, 30.020172120000001569906089571304619312286376953125, 30.2215061200000008057031664066016674041748046875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 30.55707930999999888399543124251067638397216796875, "raw_values": [ 29.792476650000001114904080168344080448150634765625, 31.13991736999999915269654593430459499359130859375, 30.73884392000000076450305641628801822662353515625 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "28f99f7de74e7e48be7575b65f6825adb3e7af78": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q05", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 41.16542688999999910492988419719040393829345703125, "raw_values": [ 41.46962357000000309881215798668563365936279296875, 42.3975868200000007846028893254697322845458984375, 39.62907028000000053680196288041770458221435546875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 43.25001144000000152800566866062581539154052734375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 39.70042801000000309841198031790554523468017578125, "raw_values": [ 38.3369407699999982241934048943221569061279296875, 38.49396895999999657078660675324499607086181640625, 42.2703743000000002894012141041457653045654296875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 38.99460092999999716312231612391769886016845703125, "raw_values": [ 38.565299989999999752399162389338016510009765625, 39.33585739000000103260390460491180419921875, 39.08264541999999863719494896940886974334716796875 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "f4680c9877c06a0dcacafc28bba0b2bf29cd979e": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q06", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 20.381172819999999745732566225342452526092529296875, "raw_values": [ 20.4364376099999986990951583720743656158447265625, 20.36982345999999921559719950892031192779541015625, 20.337257390000001322505340795032680034637451171875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 20.297233580000000330301190842874348163604736328125, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 20.34083810999999997193299350328743457794189453125, "raw_values": [ 20.28932762000000167290636454708874225616455078125, 20.273687360000000268200892605818808078765869140625, 20.459499359999998802095433347858488559722900390625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 20.3820470200000016802732716314494609832763671875, "raw_values": [ 20.344100950000001404305294272489845752716064453125, 20.511169429999998925495674484409391880035400390625, 20.290870670000000330901457346044480800628662109375 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "b989bf711c7d24869a33af1be95b4b8c544cd603": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q07", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 35.63054783999999841626049601472914218902587890625, "raw_values": [ 34.74398040999999892619598540477454662322998046875, 35.83242034999999958699845592491328716278076171875, 36.31524276999999756299075670540332794189453125 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 35.3421478300000018180071492679417133331298828125, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 35.4553070099999985131944413296878337860107421875, "raw_values": [ 35.2411689799999976457911543548107147216796875, 35.69927978999999851339453016407787799835205078125, 35.42547225999999938039763947017490863800048828125 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 35.4003842700000035392804420553147792816162109375, "raw_values": [ 35.10668181999999859499439480714499950408935546875, 35.4902153000000026850102585740387439727783203125, 35.60425568000000140500560519285500049591064453125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "f6bc4b72e442591caeb2d563fb51fb6576781a12": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q08", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 38.35942204999999916026354185305535793304443359375, "raw_values": [ 37.267013550000001487205736339092254638671875, 38.88340758999999735578967374749481678009033203125, 38.92784499999999781039150548167526721954345703125 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 37.97156906000000020640072762034833431243896484375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 37.80742771999999973786543705500662326812744140625, "raw_values": [ 37.702293400000002066008164547383785247802734375, 37.75128554999999863639459363184869289398193359375, 37.96870421999999933859726297669112682342529296875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 38.380752569999998513594618998467922210693359375, "raw_values": [ 37.9919815100000022312087821774184703826904296875, 38.8070640600000018594073480926454067230224609375, 38.3432121299999977281913743354380130767822265625 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "5dda1e014a2eb3c1818f1b3fec4e86f1460ebb87": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q09", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 46.89715448999999836132701602764427661895751953125, "raw_values": [ 46.5595169099999992567973094992339611053466796875, 47.26127242999999822359313839115202426910400390625, 46.870674129999997603590600192546844482421875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 46.31754303000000305701178149320185184478759765625, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 47.10843913000000071633621701039373874664306640625, "raw_values": [ 46.2089080800000004956018528901040554046630859375, 47.04953765999999859559466131031513214111328125, 48.0668716400000022304084268398582935333251953125 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 46.9971860200000008944698492996394634246826171875, "raw_values": [ 46.534778590000001941007212735712528228759765625, 47.0868454000000014048055163584649562835693359375, 47.36993408000000016500052879564464092254638671875 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "610a457447b726bb59579439714f1c6b843280a4": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q10", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 35.92603937999999885732904658652842044830322265625, "raw_values": [ 36.07969283999999987599949236027896404266357421875, 36.98225403000000000020008883439004421234130859375, 34.71617126000000297381120617501437664031982421875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 36.27207947000000132220520754344761371612548828125, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 36.821423850000002175875124521553516387939453125, "raw_values": [ 37.49900054999999809979271958582103252410888671875, 36.49614715999999958739863359369337558746337890625, 36.46912384000000173500666278414428234100341796875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 35.9282480899999967505209497176110744476318359375, "raw_values": [ 35.99481964000000289161107502877712249755859375, 35.51629256999999739718987257219851016998291015625, 36.27363205000000334621290676295757293701171875 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "a17f0f73461abcdae80039091a719d09f36eec33": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q11", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 9.0623906499999993258143149432726204395294189453125, "raw_values": [ 9.3983497600000003302511686342768371105194091796875, 8.95141124999999959754859446547925472259521484375, 8.837410930000000774953150539658963680267333984375 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 8.6932077400000000722002369002439081668853759765625, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 8.752606390000000402551449951715767383575439453125, "raw_values": [ 8.7694931000000000409499989473260939121246337890625, 8.91027451000000070280293584801256656646728515625, 8.5780515699999995149482856504619121551513671875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 9.0176893899999992498806022922508418560028076171875, "raw_values": [ 9.1210422500000003509512680466286838054656982421875, 8.72914504999999962819856591522693634033203125, 9.20288086000000049580194172449409961700439453125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "fb8a5ebd55c4dd4ddd588507bea15d4a13e91f02": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q12", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 30.430392590000000296868165605701506137847900390625, "raw_values": [ 29.81896210000000024820110411383211612701416015625, 30.74160767000000049620211939327418804168701171875, 30.730607989999999318797563319094479084014892578125 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 30.4071655300000003308014129288494586944580078125, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 30.88582865000000055033524404279887676239013671875, "raw_values": [ 30.7786235800000014251054381020367145538330078125, 30.12251662999999979319909471087157726287841796875, 31.75634575000000126010490930639207363128662109375 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 30.04180271999999973786543705500662326812744140625, "raw_values": [ 29.718326569999998554294506902806460857391357421875, 30.432867049999998698694980703294277191162109375, 29.97421454999999923529685474932193756103515625 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "ff87d56c26ba10d87998b67a0a54d3d0bd08d975": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q13", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 12.3371191000000006710024536005221307277679443359375, "raw_values": [ 12.31804561999999947374817566014826297760009765625, 12.4150342899999994727977536967955529689788818359375, 12.27827740000000034115146263502538204193115234375 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 12.131105420000000805202944320626556873321533203125, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 13.1364854199999996353653841651976108551025390625, "raw_values": [ 12.423709869999999710898919147439301013946533203125, 14.8730850199999995453481460572220385074615478515625, 12.112661360000000598802216700278222560882568359375 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 13.6845792100000007707194527029059827327728271484375, "raw_values": [ 12.171953200000000805403033155016601085662841796875, 14.6255550400000000621503204456530511379241943359375, 14.2562294000000004956518750987015664577484130859375 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "889f952220ad4d50ab47177ad26744ba6d508536": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q14", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 25.487052920000000000300133251585066318511962890625, "raw_values": [ 25.261379240000000123700374388135969638824462890625, 25.5834808299999991731965565122663974761962890625, 25.6162986799999998765997588634490966796875 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 25.396928790000000475401975563727319240570068359375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 25.45622125999999951773133943788707256317138671875, "raw_values": [ 25.396375660000000351601556758396327495574951171875, 25.473684309999999442197804455645382404327392578125, 25.498603819999999586798367090523242950439453125 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 25.42378615999999880159521126188337802886962890625, "raw_values": [ 25.199665069999998223693182808347046375274658203125, 25.24460601999999909139660303480923175811767578125, 25.827087399999999917099557933397591114044189453125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "372e1c1d0b47882fef2ef6dca8343a59aef46f2e": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q15", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 23.04547437000000087437001639045774936676025390625, "raw_values": [ 22.970729829999999793699316796846687793731689453125, 23.10472487999999913199644652195274829864501953125, 23.06096840000000014470060705207288265228271484375 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 22.88924598999999915349690127186477184295654296875, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 22.946389520000000317168087349273264408111572265625, "raw_values": [ 22.88928413000000006150003173388540744781494140625, 23.081659319999999979700078256428241729736328125, 22.868225100000000082900442066602408885955810546875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 23.002367660000000881836967892013490200042724609375, "raw_values": [ 23.01874160999999929799741948954761028289794921875, 23.04445266999999830659362487494945526123046875, 22.94390869000000066080247052013874053955078125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "94eb383aa89707b61925915cb665b051c5bd612c": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q16", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 10.5865411799999993291976352338679134845733642578125, "raw_values": [ 10.7578115499999995563484844751656055450439453125, 10.5026025799999995768985172617249190807342529296875, 10.4992093999999998032990333740599453449249267578125 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 10.5323028599999997112490746076218783855438232421875, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 10.8244365099999999557667251792736351490020751953125, "raw_values": [ 10.9716072100000001654507286730222404003143310546875, 10.927236560000000764603100833483040332794189453125, 10.5744657499999998861994754406623542308807373046875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 10.9140424700000000513000486535020172595977783203125, "raw_values": [ 10.44956398000000064030245994217693805694580078125, 11.8592386199999992868470144458115100860595703125, 10.4333248100000002267506715725176036357879638671875 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "7a4333ee661a8aada48926338a81d70e165c8d8b": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q17", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 55.609177909999999656065483577549457550048828125, "raw_values": [ 55.45159148999999842999386601150035858154296875, 55.6438484199999976453909766860306262969970703125, 55.73209381000000206540789804421365261077880859375 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 55.2799911500000007436028681695461273193359375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 55.33429081999999965546521707437932491302490234375, "raw_values": [ 55.0250816300000025194094632752239704132080078125, 55.68019867000000289181116386316716670989990234375, 55.29759216000000066060238168574869632720947265625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 55.42181269000000298774466500617563724517822265625, "raw_values": [ 56.23978423999999876059519010595977306365966796875, 54.38683701000000070280293584801256656646728515625, 55.63881683000000322181222145445644855499267578125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "f2a6da5e9c2afb6556680192730dbfb28a3953c4": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q18", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 62.508574170000002823144313879311084747314453125, "raw_values": [ 61.68613434000000239620931097306311130523681640625, 62.93209839000000016540070646442472934722900390625, 62.90748977999999880239556659944355487823486328125 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 61.95502090000000094960341812111437320709228515625, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 62.29955419000000205187461688183248043060302734375, "raw_values": [ 62.38104247999999785179170430637896060943603515625, 62.468452450000000908403308130800724029541015625, 62.04916762999999946259777061641216278076171875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 62.73364002999999655685314792208373546600341796875, "raw_values": [ 63.68491745000000037180143408477306365966796875, 62.6842689500000034286131267435848712921142578125, 61.831733700000000908403308130800724029541015625 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "a2a164329e8faaff6da37429f1feae347cfb98d5": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q19", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 24.718722660000000956870280788280069828033447265625, "raw_values": [ 24.702976230000000867903509060852229595184326171875, 24.535152440000000950703906710259616374969482421875, 24.91803931999999832669345778413116931915283203125 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 25.07553100999999884379576542414724826812744140625, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 24.894475299999999862166077946312725543975830078125, "raw_values": [ 25.04519081000000113590431283228099346160888671875, 24.671155930000001177404556074179708957672119140625, 24.967079160000000825903043732978403568267822265625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 25.028920490000000853569872560910880565643310546875, "raw_values": [ 24.722059250000000929503585211932659149169921875, 24.856117250000000495901986141689121723175048828125, 25.508584979999998409994077519513666629791259765625 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "32987bbbc63165b2cf21e7de25845e2da6e160ac": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q20", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 30.707695009999998347893779282458126544952392578125, "raw_values": [ 30.606081010000000475201886729337275028228759765625, 30.669439319999998616594893974252045154571533203125, 30.84756469999999950459823594428598880767822265625 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 30.538133619999999979199856170453131198883056640625, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 30.789619439999999173096512095071375370025634765625, "raw_values": [ 30.512981409999998305693225120194256305694580078125, 30.593915939999998698795025120489299297332763671875, 31.261960980000001342204996035434305667877197265625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 30.5178140000000013287717592902481555938720703125, "raw_values": [ 30.5074768100000000004001776687800884246826171875, 30.532878879999998389394022524356842041015625, 30.5130863199999993184974300675094127655029296875 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "7263eb00ce12533ebf0f1faebb07dfac8684ee1f": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q21", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 130.865641280000005508554750122129917144775390625, "raw_values": [ 131.315139770000001817606971599161624908447265625, 130.918731689999987111150403507053852081298828125, 130.3630523699999912423663772642612457275390625 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 131.455261229999990746364346705377101898193359375, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 131.421752929999996695187292061746120452880859375, "raw_values": [ 130.1752929699999867807491682469844818115234375, 132.817275999999992563971318304538726806640625, 131.272689820000010740841389633715152740478515625 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 131.0061238600000024234759621322154998779296875, "raw_values": [ 131.42127991000000974963768385350704193115234375, 132.423965449999997190388967283070087432861328125, 129.173126220000000330401235260069370269775390625 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "581e0bd5a4156d92cc72c0eb07514bfc1fe0075d": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 50", "description": "Scale Factor: 50 - Q22", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "parent": "6018fc76daa8d9a5345f9cb4ee239b4409f6890b", "results": { "a": { "value": 10.6748638200000005582523954217322170734405517578125, "raw_values": [ 10.5863361400000002277010935358703136444091796875, 11.1626090999999991737468008068390190601348876953125, 10.2756462099999996695487425313331186771392822265625 ], "test_run_times": [ 755.700000000000045474735088646411895751953125, 762.98000000000001818989403545856475830078125, 756.8700000000000045474735088646411895751953125 ] }, "b": { "value": 10.5269079199999993079472915269434452056884765625, "test_run_times": [ 756.990000000000009094947017729282379150390625 ] }, "c": { "value": 10.63667170000000083973645814694464206695556640625, "raw_values": [ 10.45192813999999970064891385845839977264404296875, 10.8442602200000006718028089380823075771331787109375, 10.6138267499999994214476828346960246562957763671875 ], "test_run_times": [ 754.25, 759.6100000000000136424205265939235687255859375, 762.3300000000000409272615797817707061767578125 ] }, "d": { "value": 10.2650543800000004779349183081649243831634521484375, "raw_values": [ 10.3103227600000000308000380755402147769927978515625, 10.2936782799999999582496457151137292385101318359375, 10.19116211000000049580194172449409961700439453125 ], "test_run_times": [ 753.3600000000000136424205265939235687255859375, 759.8300000000000409272615797817707061767578125, 757.1499999999999772626324556767940521240234375 ] } } }, "2ea64d53fe15cab893e4ae8d166fcb608b6cdc39": { "identifier": "pts\/spark-tpch-1.0.0", "title": "Apache Spark TPC-H", "app_version": "3.5", "arguments": "-s 100", "description": "Scale Factor: 100", "scale": "Seconds", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "test_run_times": [ 1.4199999999999999289457264239899814128875732421875, 1.4099999999999999200639422269887290894985198974609375, 1.4099999999999999200639422269887290894985198974609375 ], "details": { "error": "The test quit with a non-zero exit status. E: .\/spark-tpch: line 6: echo: write error: No space left on device" } }, "b": { "test_run_times": [ 1.4199999999999999289457264239899814128875732421875 ], "details": { "error": "The test quit with a non-zero exit status. E: .\/spark-tpch: line 6: echo: write error: No space left on device" } }, "c": { "test_run_times": [ 1.4299999999999999378275106209912337362766265869140625, 1.4199999999999999289457264239899814128875732421875, 1.4299999999999999378275106209912337362766265869140625 ], "details": { "error": "The test quit with a non-zero exit status. E: .\/spark-tpch: line 6: echo: write error: No space left on device" } }, "d": { "test_run_times": [ 1.4099999999999999200639422269887290894985198974609375, 1.4199999999999999289457264239899814128875732421875, 1.4199999999999999289457264239899814128875732421875 ], "details": { "error": "The test quit with a non-zero exit status. E: .\/spark-tpch: line 6: echo: write error: No space left on device" } } } }, "7177df0983290cc547ee8201e604768da3e0a24a": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 37.9294000000000011141310096718370914459228515625, "raw_values": [ 38.775700000000000500222085975110530853271484375, 38.03410000000000223963070311583578586578369140625, 36.97829999999999728288457845337688922882080078125 ], "test_run_times": [ 49.60000000000000142108547152020037174224853515625, 45.530000000000001136868377216160297393798828125, 45.49000000000000198951966012828052043914794921875 ] }, "b": { "value": 39.38329999999999841975295566953718662261962890625, "test_run_times": [ 45.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 37.78450000000000130739863379858434200286865234375, "raw_values": [ 39.4412999999999982492226990871131420135498046875, 38.00240000000000151203494169749319553375244140625, 37.5311999999999983401721692644059658050537109375, 37.01859999999999928377292235381901264190673828125, 36.8960000000000007958078640513122081756591796875, 37.817599999999998772182152606546878814697265625 ], "test_run_times": [ 45.07000000000000028421709430404007434844970703125, 45.32000000000000028421709430404007434844970703125, 45.4200000000000017053025658242404460906982421875, 45.5799999999999982946974341757595539093017578125, 45.2999999999999971578290569595992565155029296875, 45.340000000000003410605131648480892181396484375 ] }, "d": { "value": 38.7188000000000016598278307355940341949462890625, "raw_values": [ 39.38369999999999748752088635228574275970458984375, 38.62429999999999807869244250468909740447998046875, 38.1484999999999985220711096189916133880615234375 ], "test_run_times": [ 45.340000000000003410605131648480892181396484375, 45.46000000000000085265128291212022304534912109375, 45.28999999999999914734871708787977695465087890625 ] } } }, "cfea26185bda60cf1bd972198a894017567ea66d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario async", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 836.9171999999999798092176206409931182861328125, "raw_values": [ 815.53729999999995925463736057281494140625, 835.175899999999955980456434190273284912109375, 860.0383000000000492946128360927104949951171875 ], "test_run_times": [ 49.60000000000000142108547152020037174224853515625, 45.530000000000001136868377216160297393798828125, 45.49000000000000198951966012828052043914794921875 ] }, "b": { "value": 806.3927999999999656211002729833126068115234375, "test_run_times": [ 45.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 841.3434999999999490682967007160186767578125, "raw_values": [ 805.839500000000043655745685100555419921875, 835.182199999999966166797094047069549560546875, 848.358799999999973806552588939666748046875, 858.60410000000001673470251262187957763671875, 859.7369999999999663486960344016551971435546875, 840.3391000000000303771230392158031463623046875 ], "test_run_times": [ 45.07000000000000028421709430404007434844970703125, 45.32000000000000028421709430404007434844970703125, 45.4200000000000017053025658242404460906982421875, 45.5799999999999982946974341757595539093017578125, 45.2999999999999971578290569595992565155029296875, 45.340000000000003410605131648480892181396484375 ] }, "d": { "value": 820.1208000000000311047188006341457366943359375, "raw_values": [ 804.7886999999999488863977603614330291748046875, 823.892900000000054205884225666522979736328125, 831.6807999999999765350366942584514617919921875 ], "test_run_times": [ 45.340000000000003410605131648480892181396484375, 45.46000000000000085265128291212022304534912109375, 45.28999999999999914734871708787977695465087890625 ] } } }, "75b6442e296ce0e967a26cd61945f6ce4b61b99d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 13.8986999999999998323119143606163561344146728515625, "raw_values": [ 13.9674999999999993605115378159098327159881591796875, 13.9444999999999996731503415503539144992828369140625, 13.7842000000000002302158463862724602222442626953125 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.88000000000000255795384873636066913604736328125, 45.72999999999999687361196265555918216705322265625 ] }, "b": { "value": 14.4029000000000007020162229309789836406707763671875, "test_run_times": [ 45.53999999999999914734871708787977695465087890625 ] }, "c": { "value": 13.881299999999999528199623455293476581573486328125, "raw_values": [ 13.969300000000000494537744089029729366302490234375, 13.80669999999999930651028989814221858978271484375, 13.8680000000000003268496584496460855007171630859375 ], "test_run_times": [ 45.61999999999999744204615126363933086395263671875, 45.7000000000000028421709430404007434844970703125, 45.7999999999999971578290569595992565155029296875 ] }, "d": { "value": 13.9019999999999992468247000942938029766082763671875, "raw_values": [ 13.841499999999999914734871708787977695465087890625, 13.9608000000000007645439836778677999973297119140625, 13.903800000000000380850906367413699626922607421875 ], "test_run_times": [ 45.659999999999996589394868351519107818603515625, 45.63000000000000255795384873636066913604736328125, 45.780000000000001136868377216160297393798828125 ] } } }, "65ae56ceea2f265276e1b95b6a6e3b53119b5ff3": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/document_classification\/obert-base\/pytorch\/huggingface\/imdb\/base-none --scenario sync", "description": "Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 71.9375, "raw_values": [ 71.58129999999999881765688769519329071044921875, 71.698700000000002319211489520967006683349609375, 72.53239999999999554347596131265163421630859375 ], "test_run_times": [ 45.85000000000000142108547152020037174224853515625, 45.88000000000000255795384873636066913604736328125, 45.72999999999999687361196265555918216705322265625 ] }, "b": { "value": 69.4174000000000006593836587853729724884033203125, "test_run_times": [ 45.53999999999999914734871708787977695465087890625 ] }, "c": { "value": 72.027299999999996771293808706104755401611328125, "raw_values": [ 71.5721999999999951569407130591571331024169921875, 72.4149000000000029331204132176935672760009765625, 72.09489999999999554347596131265163421630859375 ], "test_run_times": [ 45.61999999999999744204615126363933086395263671875, 45.7000000000000028421709430404007434844970703125, 45.7999999999999971578290569595992565155029296875 ] }, "d": { "value": 71.9192000000000035697667044587433338165283203125, "raw_values": [ 72.2323999999999983856469043530523777008056640625, 71.6159999999999996589394868351519107818603515625, 71.909300000000001773514668457210063934326171875 ], "test_run_times": [ 45.659999999999996589394868351519107818603515625, 45.63000000000000255795384873636066913604736328125, 45.780000000000001136868377216160297393798828125 ] } } }, "f524385817c97baf9338a7ff6f39a7c655b03295": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 980.4497000000000070940586738288402557373046875, "raw_values": [ 982.8020999999999958163243718445301055908203125, 984.8781999999999925421434454619884490966796875, 973.6689000000000078216544352471828460693359375 ], "test_run_times": [ 48.18999999999999772626324556767940521240234375, 47.42999999999999971578290569595992565155029296875, 47.219999999999998863131622783839702606201171875 ] }, "b": { "value": 993.6037000000000034560798667371273040771484375, "test_run_times": [ 47.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 988.4904999999999972715158946812152862548828125, "raw_values": [ 990.6598999999999932697392068803310394287109375, 986.712800000000015643308870494365692138671875, 988.09870000000000800355337560176849365234375 ], "test_run_times": [ 47.07000000000000028421709430404007434844970703125, 47.0799999999999982946974341757595539093017578125, 47.22999999999999687361196265555918216705322265625 ] }, "d": { "value": 989.05889999999999417923390865325927734375, "raw_values": [ 991.32439999999996871338225901126861572265625, 987.3964999999999463398125953972339630126953125, 988.455799999999953797669149935245513916015625 ], "test_run_times": [ 47.159999999999996589394868351519107818603515625, 47.13000000000000255795384873636066913604736328125, 47.00999999999999801048033987171947956085205078125 ] } } }, "6d1bc6324fc6f3c201d57050ed8113b8f3aaa20f": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 32.6019000000000005456968210637569427490234375, "raw_values": [ 32.52120000000000032969182939268648624420166015625, 32.4568000000000012050804798491299152374267578125, 32.82770000000000010231815394945442676544189453125 ], "test_run_times": [ 48.18999999999999772626324556767940521240234375, 47.42999999999999971578290569595992565155029296875, 47.219999999999998863131622783839702606201171875 ] }, "b": { "value": 32.15670000000000072759576141834259033203125, "test_run_times": [ 47.1700000000000017053025658242404460906982421875 ] }, "c": { "value": 32.33919999999999816964191268198192119598388671875, "raw_values": [ 32.26769999999999782858139951713383197784423828125, 32.3969000000000022509993868879973888397216796875, 32.35289999999999821511664777062833309173583984375 ], "test_run_times": [ 47.07000000000000028421709430404007434844970703125, 47.0799999999999982946974341757595539093017578125, 47.22999999999999687361196265555918216705322265625 ] }, "d": { "value": 32.310800000000000409272615797817707061767578125, "raw_values": [ 32.22760000000000246700437855906784534454345703125, 32.36399999999999721467247582040727138519287109375, 32.34089999999999776036929688416421413421630859375 ], "test_run_times": [ 47.159999999999996589394868351519107818603515625, 47.13000000000000255795384873636066913604736328125, 47.00999999999999801048033987171947956085205078125 ] } } }, "1414e9d238abf3c69640ae7afe5a8630f728e27e": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 129.704100000000011050360626541078090667724609375, "raw_values": [ 128.333200000000005047695594839751720428466796875, 130.38020000000000209183781407773494720458984375, 130.39879999999999427018337883055210113525390625 ], "test_run_times": [ 48.42999999999999971578290569595992565155029296875, 48.530000000000001136868377216160297393798828125, 48.590000000000003410605131648480892181396484375 ] }, "b": { "value": 131.167000000000001591615728102624416351318359375, "test_run_times": [ 48.21000000000000085265128291212022304534912109375 ] }, "c": { "value": 132.104700000000008230927051045000553131103515625, "raw_values": [ 135.81950000000000500222085975110530853271484375, 128.8437999999999874489731155335903167724609375, 130.657000000000010686562745831906795501708984375, 133.09850000000000136424205265939235687255859375 ], "test_run_times": [ 48.3299999999999982946974341757595539093017578125, 48.0799999999999982946974341757595539093017578125, 48.3900000000000005684341886080801486968994140625, 48.36999999999999744204615126363933086395263671875 ] }, "d": { "value": 134.397500000000007958078640513122081756591796875, "raw_values": [ 134.957099999999996953192749060690402984619140625, 128.7821000000000140062184073030948638916015625, 135.364699999999999135980033315718173980712890625, 137.6345000000000027284841053187847137451171875, 135.24930000000000518411980010569095611572265625 ], "test_run_times": [ 48.3599999999999994315658113919198513031005859375, 48.280000000000001136868377216160297393798828125, 48.36999999999999744204615126363933086395263671875, 48.39999999999999857891452847979962825775146484375, 48.3900000000000005684341886080801486968994140625 ] } } }, "4bdc2e856120b16bb5c7704dd9f24c0d445a7eaf": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/sentiment_analysis\/oberta-base\/pytorch\/huggingface\/sst2\/pruned90_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 7.7065999999999998948396751075051724910736083984375, "raw_values": [ 7.78849999999999997868371792719699442386627197265625, 7.66629999999999967030817060731351375579833984375, 7.66500000000000003552713678800500929355621337890625 ], "test_run_times": [ 48.42999999999999971578290569595992565155029296875, 48.530000000000001136868377216160297393798828125, 48.590000000000003410605131648480892181396484375 ] }, "b": { "value": 7.61920000000000019468870959826745092868804931640625, "test_run_times": [ 48.21000000000000085265128291212022304534912109375 ] }, "c": { "value": 7.56890000000000018332002582610584795475006103515625, "raw_values": [ 7.3589000000000002188471626141108572483062744140625, 7.757600000000000051159076974727213382720947265625, 7.64970000000000016626700016786344349384307861328125, 7.509299999999999641886461176909506320953369140625 ], "test_run_times": [ 48.3299999999999982946974341757595539093017578125, 48.0799999999999982946974341757595539093017578125, 48.3900000000000005684341886080801486968994140625, 48.36999999999999744204615126363933086395263671875 ] }, "d": { "value": 7.44019999999999992468247000942938029766082763671875, "raw_values": [ 7.40559999999999973852027324028313159942626953125, 7.76100000000000012079226507921703159809112548828125, 7.3834999999999997299937604111619293689727783203125, 7.26189999999999979962694851565174758434295654296875, 7.38889999999999957935870043002068996429443359375 ], "test_run_times": [ 48.3599999999999994315658113919198513031005859375, 48.280000000000001136868377216160297393798828125, 48.36999999999999744204615126363933086395263671875, 48.39999999999999857891452847979962825775146484375, 48.3900000000000005684341886080801486968994140625 ] } } }, "a9114050bf9d19d8068bec56f0849556b5ad7e41": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 441.4406999999999925421434454619884490966796875, "raw_values": [ 444.66930000000002110027708113193511962890625, 442.1462999999999965439201332628726959228515625, 437.50659999999999172359821386635303497314453125 ], "test_run_times": [ 38.659999999999996589394868351519107818603515625, 37.77000000000000312638803734444081783294677734375, 37.74000000000000198951966012828052043914794921875 ] }, "b": { "value": 450.8061999999999898136593401432037353515625, "test_run_times": [ 37.72999999999999687361196265555918216705322265625 ] }, "c": { "value": 445.16230000000001609805622138082981109619140625, "raw_values": [ 447.44819999999998572093318216502666473388671875, 445.63119999999997844497556798160076141357421875, 442.40760000000000218278728425502777099609375 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.64999999999999857891452847979962825775146484375, 37.590000000000003410605131648480892181396484375 ] }, "d": { "value": 441.39409999999998035491444170475006103515625, "raw_values": [ 443.66120000000000800355337560176849365234375, 440.5575000000000045474735088646411895751953125, 439.963700000000017098500393331050872802734375 ], "test_run_times": [ 37.63000000000000255795384873636066913604736328125, 37.67999999999999971578290569595992565155029296875, 37.63000000000000255795384873636066913604736328125 ] } } }, "39697168b3b50cc5be0663ce16b826085d7964b6": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 72.4193000000000068894223659299314022064208984375, "raw_values": [ 71.85349999999999681676854379475116729736328125, 72.332999999999998408384271897375583648681640625, 73.0713999999999970214048516936600208282470703125 ], "test_run_times": [ 38.659999999999996589394868351519107818603515625, 37.77000000000000312638803734444081783294677734375, 37.74000000000000198951966012828052043914794921875 ] }, "b": { "value": 70.9424000000000063437255448661744594573974609375, "test_run_times": [ 37.72999999999999687361196265555918216705322265625 ] }, "c": { "value": 71.80910000000000081854523159563541412353515625, "raw_values": [ 71.439300000000002910383045673370361328125, 71.721100000000006957634468562901020050048828125, 72.2668000000000034788172342814505100250244140625 ], "test_run_times": [ 37.72999999999999687361196265555918216705322265625, 37.64999999999999857891452847979962825775146484375, 37.590000000000003410605131648480892181396484375 ] }, "d": { "value": 72.45720000000000027284841053187847137451171875, "raw_values": [ 72.0859999999999985220711096189916133880615234375, 72.594300000000004047251422889530658721923828125, 72.6911999999999949295670376159250736236572265625 ], "test_run_times": [ 37.63000000000000255795384873636066913604736328125, 37.67999999999999971578290569595992565155029296875, 37.63000000000000255795384873636066913604736328125 ] } } }, "1654e04c4da2ac25065bfa01530180c82acb03cd": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 103.564300000000002910383045673370361328125, "raw_values": [ 103.7854999999999989768184605054557323455810546875, 102.5644999999999953388396534137427806854248046875, 104.3429000000000002046363078989088535308837890625 ], "test_run_times": [ 37.86999999999999744204615126363933086395263671875, 37.840000000000003410605131648480892181396484375, 37.82000000000000028421709430404007434844970703125 ] }, "b": { "value": 106.9295000000000044337866711430251598358154296875, "test_run_times": [ 37.68999999999999772626324556767940521240234375 ] }, "c": { "value": 106.03329999999999699866748414933681488037109375, "raw_values": [ 106.185699999999997089616954326629638671875, 105.7417999999999977944753482006490230560302734375, 106.1724999999999994315658113919198513031005859375 ], "test_run_times": [ 37.68999999999999772626324556767940521240234375, 37.780000000000001136868377216160297393798828125, 37.719999999999998863131622783839702606201171875 ] }, "d": { "value": 103.9791000000000025238477974198758602142333984375, "raw_values": [ 104.9779999999999944293449516408145427703857421875, 104.59350000000000591171556152403354644775390625, 102.36570000000000391082721762359142303466796875 ], "test_run_times": [ 37.67999999999999971578290569595992565155029296875, 37.74000000000000198951966012828052043914794921875, 37.74000000000000198951966012828052043914794921875 ] } } }, "5dea4cb36afc2938810567625491f7b43ad557cd": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 9.64620000000000032969182939268648624420166015625, "raw_values": [ 9.625299999999999300825948012061417102813720703125, 9.7400999999999999801048033987171947956085205078125, 9.5731999999999999317878973670303821563720703125 ], "test_run_times": [ 37.86999999999999744204615126363933086395263671875, 37.840000000000003410605131648480892181396484375, 37.82000000000000028421709430404007434844970703125 ] }, "b": { "value": 9.3423999999999995935695551452226936817169189453125, "test_run_times": [ 37.68999999999999772626324556767940521240234375 ] }, "c": { "value": 9.4214999999999999857891452847979962825775146484375, "raw_values": [ 9.4077999999999999403144101961515843868255615234375, 9.447900000000000630961949354968965053558349609375, 9.4087999999999993860910763032734394073486328125 ], "test_run_times": [ 37.68999999999999772626324556767940521240234375, 37.780000000000001136868377216160297393798828125, 37.719999999999998863131622783839702606201171875 ] }, "d": { "value": 9.608399999999999607780409860424697399139404296875, "raw_values": [ 9.515499999999999403144101961515843868255615234375, 9.5510999999999999232613845379091799259185791015625, 9.7586999999999992638777257525362074375152587890625 ], "test_run_times": [ 37.67999999999999971578290569595992565155029296875, 37.74000000000000198951966012828052043914794921875, 37.74000000000000198951966012828052043914794921875 ] } } }, "1a8f84ecf131a8f2bb9cf496b58f44a8a27991a2": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 2555.4232000000001789885573089122772216796875, "raw_values": [ 2583.4047000000000480213202536106109619140625, 2548.163300000000162981450557708740234375, 2534.7015000000001236912794411182403564453125 ], "test_run_times": [ 38.11999999999999744204615126363933086395263671875, 37.88000000000000255795384873636066913604736328125, 37.88000000000000255795384873636066913604736328125 ] }, "b": { "value": 2635.5729000000001178705133497714996337890625, "test_run_times": [ 37.85000000000000142108547152020037174224853515625 ] }, "c": { "value": 2548.37710000000015497789718210697174072265625, "raw_values": [ 2549.75250000000005456968210637569427490234375, 2568.4495999999999185092747211456298828125, 2526.92920000000003710738383233547210693359375 ], "test_run_times": [ 37.780000000000001136868377216160297393798828125, 37.85000000000000142108547152020037174224853515625, 37.8599999999999994315658113919198513031005859375 ] }, "d": { "value": 2543.1138000000000829459168016910552978515625, "raw_values": [ 2565.511300000000119325704872608184814453125, 2550.7328999999999723513610661029815673828125, 2513.09720000000015716068446636199951171875 ], "test_run_times": [ 37.99000000000000198951966012828052043914794921875, 37.8299999999999982946974341757595539093017578125, 37.78999999999999914734871708787977695465087890625 ] } } }, "fe8adf6ae3796d52419bec3b9df723076023e933": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario async", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 12.4868000000000005655920176650397479534149169921875, "raw_values": [ 12.3529999999999997584154698415659368038177490234375, 12.5189000000000003609557097661308944225311279296875, 12.588499999999999801048033987171947956085205078125 ], "test_run_times": [ 38.11999999999999744204615126363933086395263671875, 37.88000000000000255795384873636066913604736328125, 37.88000000000000255795384873636066913604736328125 ] }, "b": { "value": 12.109500000000000596855898038484156131744384765625, "test_run_times": [ 37.85000000000000142108547152020037174224853515625 ] }, "c": { "value": 12.51989999999999980673237587325274944305419921875, "raw_values": [ 12.512499999999999289457264239899814128875732421875, 12.422200000000000130739863379858434200286865234375, 12.624900000000000233058017329312860965728759765625 ], "test_run_times": [ 37.780000000000001136868377216160297393798828125, 37.85000000000000142108547152020037174224853515625, 37.8599999999999994315658113919198513031005859375 ] }, "d": { "value": 12.5482999999999993434585121576674282550811767578125, "raw_values": [ 12.439099999999999823785401531495153903961181640625, 12.5099999999999997868371792719699442386627197265625, 12.6957000000000004291678123991005122661590576171875 ], "test_run_times": [ 37.99000000000000198951966012828052043914794921875, 37.8299999999999982946974341757595539093017578125, 37.78999999999999914734871708787977695465087890625 ] } } }, "3b440bbd8e4ccd918716ffc64aa79f6a9429dae7": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 627.7539000000000442014425061643123626708984375, "raw_values": [ 623.773400000000037834979593753814697265625, 629.237300000000004729372449219226837158203125, 630.2509000000000014551915228366851806640625 ], "test_run_times": [ 37.38000000000000255795384873636066913604736328125, 37.3900000000000005684341886080801486968994140625, 37.4500000000000028421709430404007434844970703125 ] }, "b": { "value": 599.1862999999999601641320623457431793212890625, "test_run_times": [ 37.3599999999999994315658113919198513031005859375 ] }, "c": { "value": 591.2569999999999481588019989430904388427734375, "raw_values": [ 575.8465999999999667124939151108264923095703125, 593.4588999999999714418663643300533294677734375, 604.46559999999999490682967007160186767578125 ], "test_run_times": [ 37.28999999999999914734871708787977695465087890625, 37.4500000000000028421709430404007434844970703125, 37.409999999999996589394868351519107818603515625 ] }, "d": { "value": 620.2412000000000489308149553835391998291015625, "raw_values": [ 617.47550000000001091393642127513885498046875, 621.1454999999999699866748414933681488037109375, 622.1027000000000271029421128332614898681640625 ], "test_run_times": [ 37.219999999999998863131622783839702606201171875, 37.340000000000003410605131648480892181396484375, 37.340000000000003410605131648480892181396484375 ] } } }, "43a4d7c1eff55bcea48516c4a6afc01afa37a084": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/pruned95_uniform_quant-none --scenario sync", "description": "Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 1.5896999999999998909316900608246214687824249267578125, "raw_values": [ 1.5998000000000001108446667785756289958953857421875, 1.585900000000000087396756498492322862148284912109375, 1.583299999999999929656269159750081598758697509765625 ], "test_run_times": [ 37.38000000000000255795384873636066913604736328125, 37.3900000000000005684341886080801486968994140625, 37.4500000000000028421709430404007434844970703125 ] }, "b": { "value": 1.665599999999999969446662362315692007541656494140625, "test_run_times": [ 37.3599999999999994315658113919198513031005859375 ] }, "c": { "value": 1.6887000000000000898836560736526735126972198486328125, "raw_values": [ 1.7333000000000000628830321147688664495944976806640625, 1.6816999999999999726441046732361428439617156982421875, 1.6510000000000000230926389122032560408115386962890625 ], "test_run_times": [ 37.28999999999999914734871708787977695465087890625, 37.4500000000000028421709430404007434844970703125, 37.409999999999996589394868351519107818603515625 ] }, "d": { "value": 1.6089999999999999857891452847979962825775146484375, "raw_values": [ 1.6163000000000000699884594723698683083057403564453125, 1.606899999999999995026200849679298698902130126953125, 1.6039000000000001033839680530945770442485809326171875 ], "test_run_times": [ 37.219999999999998863131622783839702606201171875, 37.340000000000003410605131648480892181396484375, 37.340000000000003410605131648480892181396484375 ] } } }, "30a0ae27e6fce0ebd1a53ca1cf7c2475badd4741": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 201.91300000000001091393642127513885498046875, "raw_values": [ 203.540799999999990177457220852375030517578125, 202.801099999999991041477187536656856536865234375, 199.3971999999999979991116560995578765869140625 ], "test_run_times": [ 38.6099999999999994315658113919198513031005859375, 38.25999999999999801048033987171947956085205078125, 38.17999999999999971578290569595992565155029296875 ] }, "b": { "value": 206.962700000000012323653209023177623748779296875, "test_run_times": [ 38.13000000000000255795384873636066913604736328125 ] }, "c": { "value": 199.216199999999986403054208494722843170166015625, "raw_values": [ 196.017799999999994042809703387320041656494140625, 200.6471999999999979991116560995578765869140625, 200.98349999999999226929503493010997772216796875 ], "test_run_times": [ 38.42999999999999971578290569595992565155029296875, 38.1400000000000005684341886080801486968994140625, 38.14999999999999857891452847979962825775146484375 ] }, "d": { "value": 201.944400000000001682565198279917240142822265625, "raw_values": [ 202.47579999999999245119397528469562530517578125, 203.837500000000005684341886080801486968994140625, 199.519800000000003592504072003066539764404296875 ], "test_run_times": [ 38.52000000000000312638803734444081783294677734375, 38.1099999999999994315658113919198513031005859375, 38.22999999999999687361196265555918216705322265625 ] } } }, "bf5141edd92c8c1e44875bf4322842f2d565a81a": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 158.1544000000000096406438387930393218994140625, "raw_values": [ 156.9732999999999947249307297170162200927734375, 157.4678000000000110958353616297245025634765625, 160.0221999999999979991116560995578765869140625 ], "test_run_times": [ 38.6099999999999994315658113919198513031005859375, 38.25999999999999801048033987171947956085205078125, 38.17999999999999971578290569595992565155029296875 ] }, "b": { "value": 154.303500000000013869794202037155628204345703125, "test_run_times": [ 38.13000000000000255795384873636066913604736328125 ] }, "c": { "value": 160.277999999999991587174008600413799285888671875, "raw_values": [ 163.00110000000000809450284577906131744384765625, 158.958499999999986584953148849308490753173828125, 158.87430000000000518411980010569095611572265625 ], "test_run_times": [ 38.42999999999999971578290569595992565155029296875, 38.1400000000000005684341886080801486968994140625, 38.14999999999999857891452847979962825775146484375 ] }, "d": { "value": 158.106500000000011141310096718370914459228515625, "raw_values": [ 157.51380000000000336513039655983448028564453125, 156.7187000000000125510268844664096832275390625, 160.087099999999992405719240196049213409423828125 ], "test_run_times": [ 38.52000000000000312638803734444081783294677734375, 38.1099999999999994315658113919198513031005859375, 38.22999999999999687361196265555918216705322265625 ] } } }, "59d928faf884edbadd7e25d023874b40a291e0c0": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 86.376900000000006230038707144558429718017578125, "raw_values": [ 87.5310999999999950205165077932178974151611328125, 85.6795000000000044337866711430251598358154296875, 85.920199999999994133759173564612865447998046875 ], "test_run_times": [ 38.61999999999999744204615126363933086395263671875, 38.6400000000000005684341886080801486968994140625, 38.60000000000000142108547152020037174224853515625 ] }, "b": { "value": 88.1650000000000062527760746888816356658935546875, "test_run_times": [ 38.43999999999999772626324556767940521240234375 ] }, "c": { "value": 87.930599999999998317434801720082759857177734375, "raw_values": [ 88.3641999999999967485564411617815494537353515625, 87.299499999999994770405464805662631988525390625, 88.1281000000000034333424991928040981292724609375 ], "test_run_times": [ 38.49000000000000198951966012828052043914794921875, 38.47999999999999687361196265555918216705322265625, 38.5 ] }, "d": { "value": 87.4654000000000024783730623312294483184814453125, "raw_values": [ 87.6902999999999934743755147792398929595947265625, 87.6240999999999985448084771633148193359375, 87.0816999999999978854248183779418468475341796875 ], "test_run_times": [ 38.50999999999999801048033987171947956085205078125, 38.64999999999999857891452847979962825775146484375, 38.5 ] } } }, "462f293f366723d6995e274ef4bcdb1bff660c2d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/base-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 11.561099999999999710098563809879124164581298828125, "raw_values": [ 11.40820000000000078443918027915060520172119140625, 11.654199999999999448618837050162255764007568359375, 11.620799999999999130295691429637372493743896484375 ], "test_run_times": [ 38.61999999999999744204615126363933086395263671875, 38.6400000000000005684341886080801486968994140625, 38.60000000000000142108547152020037174224853515625 ] }, "b": { "value": 11.327899999999999636202119290828704833984375, "test_run_times": [ 38.43999999999999772626324556767940521240234375 ] }, "c": { "value": 11.3575999999999996958877090946771204471588134765625, "raw_values": [ 11.302099999999999369038050645031034946441650390625, 11.438900000000000289901436190120875835418701171875, 11.3317999999999994287236404488794505596160888671875 ], "test_run_times": [ 38.49000000000000198951966012828052043914794921875, 38.47999999999999687361196265555918216705322265625, 38.5 ] }, "d": { "value": 11.4171999999999993491428540437482297420501708984375, "raw_values": [ 11.387499999999999289457264239899814128875732421875, 11.396499999999999630517777404747903347015380859375, 11.4674999999999993605115378159098327159881591796875 ], "test_run_times": [ 38.50999999999999801048033987171947956085205078125, 38.64999999999999857891452847979962825775146484375, 38.5 ] } } }, "110f1cc60ec0ea7c1af675f5581fd8635260d922": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 49.2180000000000035242919693700969219207763671875, "raw_values": [ 49.26950000000000073896444519050419330596923828125, 49.204599999999999226929503493010997772216796875, 49.179900000000003501554601825773715972900390625 ], "test_run_times": [ 90.590000000000003410605131648480892181396484375, 77.9200000000000017053025658242404460906982421875, 76.9899999999999948840923025272786617279052734375 ] }, "b": { "value": 49.33279999999999887450030655600130558013916015625, "test_run_times": [ 77.8700000000000045474735088646411895751953125 ] }, "c": { "value": 49.080500000000000682121026329696178436279296875, "raw_values": [ 48.5619999999999976125764078460633754730224609375, 49.27329999999999898818714427761733531951904296875, 49.40610000000000212594386539421975612640380859375 ], "test_run_times": [ 76.7300000000000039790393202565610408782958984375, 77.9500000000000028421709430404007434844970703125, 76.340000000000003410605131648480892181396484375 ] }, "d": { "value": 49.16870000000000118234311230480670928955078125, "raw_values": [ 48.978600000000000136424205265939235687255859375, 49.243999999999999772626324556767940521240234375, 49.28359999999999985220711096189916133880615234375 ], "test_run_times": [ 76.840000000000003410605131648480892181396484375, 77.7099999999999937472239253111183643341064453125, 77.4599999999999937472239253111183643341064453125 ] } } }, "9ff1e78c5264f23b5224a84b200df72830b13579": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 649.9347999999999956344254314899444580078125, "raw_values": [ 649.3563000000000329237082041800022125244140625, 650.1607999999999947249307297170162200927734375, 650.2874000000000478394213132560253143310546875 ], "test_run_times": [ 90.590000000000003410605131648480892181396484375, 77.9200000000000017053025658242404460906982421875, 76.9899999999999948840923025272786617279052734375 ] }, "b": { "value": 648.5240000000000009094947017729282379150390625, "test_run_times": [ 77.8700000000000045474735088646411895751953125 ] }, "c": { "value": 649.7549999999999954525264911353588104248046875, "raw_values": [ 652.644900000000006912159733474254608154296875, 649.0566000000000030922819860279560089111328125, 647.56359999999995125108398497104644775390625 ], "test_run_times": [ 76.7300000000000039790393202565610408782958984375, 77.9500000000000028421709430404007434844970703125, 76.340000000000003410605131648480892181396484375 ] }, "d": { "value": 650.69309999999995852704159915447235107421875, "raw_values": [ 653.2123000000000274667399935424327850341796875, 649.6951999999999998181010596454143524169921875, 649.1716999999999870851752348244190216064453125 ], "test_run_times": [ 76.840000000000003410605131648480892181396484375, 77.7099999999999937472239253111183643341064453125, 77.4599999999999937472239253111183643341064453125 ] } } }, "b4b0dae41eeea56982616df74c29d8fe7770a0a2": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 11.3087999999999997413624441833235323429107666015625, "raw_values": [ 10.4929000000000005599076757789589464664459228515625, 10.9502000000000005996980689815245568752288818359375, 11.1367999999999991445065461448393762111663818359375, 11.160000000000000142108547152020037174224853515625, 11.248599999999999710098563809879124164581298828125, 11.3531999999999992922994351829402148723602294921875, 11.373599999999999710098563809879124164581298828125, 11.4201999999999994628296917653642594814300537109375, 11.4275999999999999801048033987171947956085205078125, 11.4654000000000007020162229309789836406707763671875, 11.4763000000000001676880856393836438655853271484375, 11.5767000000000006565414878423325717449188232421875, 11.51389999999999957935870043002068996429443359375, 11.5100999999999995537791619426570832729339599609375, 11.5265000000000004121147867408581078052520751953125 ], "test_run_times": [ 80, 79.9599999999999937472239253111183643341064453125, 79.4899999999999948840923025272786617279052734375, 79.340000000000003410605131648480892181396484375, 80.2699999999999960209606797434389591217041015625, 79.469999999999998863131622783839702606201171875, 79.650000000000005684341886080801486968994140625, 78.93000000000000682121026329696178436279296875, 79.31000000000000227373675443232059478759765625, 79.099999999999994315658113919198513031005859375, 79.3900000000000005684341886080801486968994140625, 79.2699999999999960209606797434389591217041015625, 79.400000000000005684341886080801486968994140625, 79.7099999999999937472239253111183643341064453125, 79.56999999999999317878973670303821563720703125 ] }, "b": { "value": 11.6057000000000005712763595511205494403839111328125, "test_run_times": [ 79.4500000000000028421709430404007434844970703125 ] }, "c": { "value": 11.838699999999999334931999328546226024627685546875, "raw_values": [ 11.95570000000000021600499167107045650482177734375, 11.783699999999999619149093632586300373077392578125, 11.7766000000000001790567694115452468395233154296875 ], "test_run_times": [ 78.969999999999998863131622783839702606201171875, 79.8700000000000045474735088646411895751953125, 79.6200000000000045474735088646411895751953125 ] }, "d": { "value": 11.7423000000000001818989403545856475830078125, "raw_values": [ 11.9107000000000002870592652470804750919342041015625, 11.65729999999999932924765744246542453765869140625, 11.658899999999999153033058973960578441619873046875 ], "test_run_times": [ 79.31000000000000227373675443232059478759765625, 79.099999999999994315658113919198513031005859375, 80.93999999999999772626324556767940521240234375 ] } } }, "ef3131cb650fc5296dcb8c35cc5728d21bc68983": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/base-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 88.467500000000001136868377216160297393798828125, "raw_values": [ 95.2878999999999933834260446019470691680908203125, 91.3076999999999969759301166050136089324951171875, 89.778400000000004865796654485166072845458984375, 89.5921000000000020691004465334117412567138671875, 88.8867000000000047066350816749036312103271484375, 88.0665000000000048885340220294892787933349609375, 87.908600000000006957634468562901020050048828125, 87.5502000000000037971403799019753932952880859375, 87.4926999999999992496668710373342037200927734375, 87.204800000000005866240826435387134552001953125, 87.1227999999999980218490236438810825347900390625, 86.36709999999999354258761741220951080322265625, 86.8375999999999947931428323499858379364013671875, 86.8667999999999977944753482006490230560302734375, 86.7429000000000058889781939797103404998779296875 ], "test_run_times": [ 80, 79.9599999999999937472239253111183643341064453125, 79.4899999999999948840923025272786617279052734375, 79.340000000000003410605131648480892181396484375, 80.2699999999999960209606797434389591217041015625, 79.469999999999998863131622783839702606201171875, 79.650000000000005684341886080801486968994140625, 78.93000000000000682121026329696178436279296875, 79.31000000000000227373675443232059478759765625, 79.099999999999994315658113919198513031005859375, 79.3900000000000005684341886080801486968994140625, 79.2699999999999960209606797434389591217041015625, 79.400000000000005684341886080801486968994140625, 79.7099999999999937472239253111183643341064453125, 79.56999999999999317878973670303821563720703125 ] }, "b": { "value": 86.150499999999993860910763032734394073486328125, "test_run_times": [ 79.4500000000000028421709430404007434844970703125 ] }, "c": { "value": 84.458699999999993224264471791684627532958984375, "raw_values": [ 83.6277999999999934743755147792398929595947265625, 84.848399999999998044586391188204288482666015625, 84.900000000000005684341886080801486968994140625 ], "test_run_times": [ 78.969999999999998863131622783839702606201171875, 79.8700000000000045474735088646411895751953125, 79.6200000000000045474735088646411895751953125 ] }, "d": { "value": 85.1572000000000031150193535722792148590087890625, "raw_values": [ 83.9446999999999974306774674914777278900146484375, 85.769599999999996953192749060690402984619140625, 85.7573000000000007503331289626657962799072265625 ], "test_run_times": [ 79.31000000000000227373675443232059478759765625, 79.099999999999994315658113919198513031005859375, 80.93999999999999772626324556767940521240234375 ] } } }, "59e3c791f39382e6c9e84cf0bd6166c7d7b5ba9e": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 449.307900000000017826096154749393463134765625, "raw_values": [ 450.85980000000000700310920365154743194580078125, 449.663999999999987267074175179004669189453125, 447.3998000000000274667399935424327850341796875 ], "test_run_times": [ 37.61999999999999744204615126363933086395263671875, 37.6700000000000017053025658242404460906982421875, 37.75 ] }, "b": { "value": 448.76029999999997244231053628027439117431640625, "test_run_times": [ 37.68999999999999772626324556767940521240234375 ] }, "c": { "value": 452.04009999999999536157702095806598663330078125, "raw_values": [ 453.09949999999997771737980656325817108154296875, 452.00479999999998881321516819298267364501953125, 451.01609999999999445208231918513774871826171875 ], "test_run_times": [ 37.6700000000000017053025658242404460906982421875, 37.63000000000000255795384873636066913604736328125, 37.719999999999998863131622783839702606201171875 ] }, "d": { "value": 450.0597999999999956344254314899444580078125, "raw_values": [ 450.62520000000000663931132294237613677978515625, 452.398500000000012732925824820995330810546875, 447.15559999999999263309291563928127288818359375 ], "test_run_times": [ 37.590000000000003410605131648480892181396484375, 37.67999999999999971578290569595992565155029296875, 37.67999999999999971578290569595992565155029296875 ] } } }, "eca4294ef9f65f9eb7e3619864362bb782b221df": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario async", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 71.17189999999999372448655776679515838623046875, "raw_values": [ 70.9089000000000027057467377744615077972412109375, 71.1226999999999947021933621726930141448974609375, 71.4839999999999946567186270840466022491455078125 ], "test_run_times": [ 37.61999999999999744204615126363933086395263671875, 37.6700000000000017053025658242404460906982421875, 37.75 ] }, "b": { "value": 71.267200000000002546585164964199066162109375, "test_run_times": [ 37.68999999999999772626324556767940521240234375 ] }, "c": { "value": 70.739900000000005775291356258094310760498046875, "raw_values": [ 70.558099999999996043698047287762165069580078125, 70.7546999999999997044142219237983226776123046875, 70.9069999999999964757080306299030780792236328125 ], "test_run_times": [ 37.6700000000000017053025658242404460906982421875, 37.63000000000000255795384873636066913604736328125, 37.719999999999998863131622783839702606201171875 ] }, "d": { "value": 71.050600000000002864908310584723949432373046875, "raw_values": [ 70.9714000000000027057467377744615077972412109375, 70.6573000000000064346750150434672832489013671875, 71.523200000000002773958840407431125640869140625 ], "test_run_times": [ 37.590000000000003410605131648480892181396484375, 37.67999999999999971578290569595992565155029296875, 37.67999999999999971578290569595992565155029296875 ] } } }, "6cffa9ab35b6aef98adc22c9570d27e8498b2cc7": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 106.4432000000000044792614062316715717315673828125, "raw_values": [ 106.2784999999999939745976007543504238128662109375, 106.2839000000000027057467377744615077972412109375, 106.767300000000005866240826435387134552001953125 ], "test_run_times": [ 37.75, 37.8599999999999994315658113919198513031005859375, 37.75 ] }, "b": { "value": 106.53870000000000572981662116944789886474609375, "test_run_times": [ 37.75 ] }, "c": { "value": 107.1042000000000058435034588910639286041259765625, "raw_values": [ 107.58580000000000609361450187861919403076171875, 106.4596999999999979991116560995578765869140625, 107.267099999999999226929503493010997772216796875 ], "test_run_times": [ 37.64999999999999857891452847979962825775146484375, 37.71000000000000085265128291212022304534912109375, 37.71000000000000085265128291212022304534912109375 ] }, "d": { "value": 104.2930000000000063664629124104976654052734375, "raw_values": [ 106.06610000000000582076609134674072265625, 102.616299999999995407051756046712398529052734375, 104.1965000000000003410605131648480892181396484375 ], "test_run_times": [ 37.659999999999996589394868351519107818603515625, 37.81000000000000227373675443232059478759765625, 37.74000000000000198951966012828052043914794921875 ] } } }, "753aeb8a274f556289615ead1b33b34309049c95": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/classification\/resnet_v1-50\/pytorch\/sparseml\/imagenet\/base-none --scenario sync", "description": "Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 9.385300000000000864019966684281826019287109375, "raw_values": [ 9.3999000000000005883293852093629539012908935546875, 9.399100000000000676436684443615376949310302734375, 9.356899999999999550936990999616682529449462890625 ], "test_run_times": [ 37.75, 37.8599999999999994315658113919198513031005859375, 37.75 ] }, "b": { "value": 9.3770000000000006679101716144941747188568115234375, "test_run_times": [ 37.75 ] }, "c": { "value": 9.32770000000000010231815394945442676544189453125, "raw_values": [ 9.2855000000000007531752999057061970233917236328125, 9.384299999999999641886461176909506320953369140625, 9.3132999999999999118927007657475769519805908203125 ], "test_run_times": [ 37.64999999999999857891452847979962825775146484375, 37.71000000000000085265128291212022304534912109375, 37.71000000000000085265128291212022304534912109375 ] }, "d": { "value": 9.5801999999999996049382389173842966556549072265625, "raw_values": [ 9.417899999999999494093572138808667659759521484375, 9.734899999999999664623828721232712268829345703125, 9.5876999999999998891553332214243710041046142578125 ], "test_run_times": [ 37.659999999999996589394868351519107818603515625, 37.81000000000000227373675443232059478759765625, 37.74000000000000198951966012828052043914794921875 ] } } }, "99fe49a34e19276c2c1e1cabb81232bca03c6b56": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 215.829700000000002546585164964199066162109375, "raw_values": [ 216.71629999999998972270986996591091156005859375, 216.133199999999987994669936597347259521484375, 214.639499999999998181010596454143524169921875 ], "test_run_times": [ 38.3299999999999982946974341757595539093017578125, 38.090000000000003410605131648480892181396484375, 38.11999999999999744204615126363933086395263671875 ] }, "b": { "value": 212.75520000000000209183781407773494720458984375, "test_run_times": [ 38.030000000000001136868377216160297393798828125 ] }, "c": { "value": 216.391400000000004411049303598701953887939453125, "raw_values": [ 216.605400000000003046807250939309597015380859375, 216.12889999999998735802364535629749298095703125, 216.439899999999994406607584096491336822509765625 ], "test_run_times": [ 38.02000000000000312638803734444081783294677734375, 38, 38.10000000000000142108547152020037174224853515625 ] }, "d": { "value": 215.290899999999993497112882323563098907470703125, "raw_values": [ 215.268200000000007321432349272072315216064453125, 215.148400000000009413270163349807262420654296875, 215.456199999999995498001226224005222320556640625 ], "test_run_times": [ 38.030000000000001136868377216160297393798828125, 38.06000000000000227373675443232059478759765625, 37.99000000000000198951966012828052043914794921875 ] } } }, "d3a51d2475684402105c9de929d898b8c318d267": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario async", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 147.96199999999998908606357872486114501953125, "raw_values": [ 147.304499999999990222931955941021442413330078125, 147.760700000000014142642612569034099578857421875, 148.820699999999987994669936597347259521484375 ], "test_run_times": [ 38.3299999999999982946974341757595539093017578125, 38.090000000000003410605131648480892181396484375, 38.11999999999999744204615126363933086395263671875 ] }, "b": { "value": 150.225899999999995770849636755883693695068359375, "test_run_times": [ 38.030000000000001136868377216160297393798828125 ] }, "c": { "value": 147.48890000000000100044417195022106170654296875, "raw_values": [ 147.27060000000000172803993336856365203857421875, 147.68139999999999645297066308557987213134765625, 147.514600000000001500666257925331592559814453125 ], "test_run_times": [ 38.02000000000000312638803734444081783294677734375, 38, 38.10000000000000142108547152020037174224853515625 ] }, "d": { "value": 148.282700000000005502442945726215839385986328125, "raw_values": [ 148.18999999999999772626324556767940521240234375, 148.402999999999991587174008600413799285888671875, 148.25520000000000209183781407773494720458984375 ], "test_run_times": [ 38.030000000000001136868377216160297393798828125, 38.06000000000000227373675443232059478759765625, 37.99000000000000198951966012828052043914794921875 ] } } }, "184fece0867b0c453d1ea8cbb6c3eeeca294f0fd": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 91.1431999999999931105776340700685977935791015625, "raw_values": [ 91.23480000000000700310920365154743194580078125, 91.7239000000000004320099833421409130096435546875, 90.47079999999999699866748414933681488037109375 ], "test_run_times": [ 38.4500000000000028421709430404007434844970703125, 38.5, 38.469999999999998863131622783839702606201171875 ] }, "b": { "value": 89.8018000000000000682121026329696178436279296875, "test_run_times": [ 38.5 ] }, "c": { "value": 91.15649999999999408828443847596645355224609375, "raw_values": [ 91.2253999999999933834260446019470691680908203125, 90.8401000000000067302607931196689605712890625, 91.404099999999999681676854379475116729736328125 ], "test_run_times": [ 38.5499999999999971578290569595992565155029296875, 38.42999999999999971578290569595992565155029296875, 38.46000000000000085265128291212022304534912109375 ] }, "d": { "value": 89.591800000000006320988177321851253509521484375, "raw_values": [ 89.61799999999999499777914024889469146728515625, 88.964100000000001955413608811795711517333984375, 90.1933999999999969077180139720439910888671875 ], "test_run_times": [ 38.43999999999999772626324556767940521240234375, 38.3599999999999994315658113919198513031005859375, 38.4500000000000028421709430404007434844970703125 ] } } }, "386d3c9c7501657468be0ac976a04b369aced25d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/detection\/yolov5-s\/pytorch\/ultralytics\/coco\/pruned85-none --scenario sync", "description": "Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 10.963499999999999801048033987171947956085205078125, "raw_values": [ 10.9522999999999992581933838664554059505462646484375, 10.8938000000000005940137270954437553882598876953125, 11.044499999999999317878973670303821563720703125 ], "test_run_times": [ 38.4500000000000028421709430404007434844970703125, 38.5, 38.469999999999998863131622783839702606201171875 ] }, "b": { "value": 11.12650000000000005684341886080801486968994140625, "test_run_times": [ 38.5 ] }, "c": { "value": 10.9618999999999999772626324556767940521240234375, "raw_values": [ 10.9542000000000001591615728102624416351318359375, 11, 10.931499999999999772626324556767940521240234375 ], "test_run_times": [ 38.5499999999999971578290569595992565155029296875, 38.42999999999999971578290569595992565155029296875, 38.46000000000000085265128291212022304534912109375 ] }, "d": { "value": 11.15390000000000014779288903810083866119384765625, "raw_values": [ 11.1501999999999998891553332214243710041046142578125, 11.2327999999999992297716744360513985157012939453125, 11.0785999999999997811528373858891427516937255859375 ], "test_run_times": [ 38.43999999999999772626324556767940521240234375, 38.3599999999999994315658113919198513031005859375, 38.4500000000000028421709430404007434844970703125 ] } } }, "bbe2982cef2af31b6c22d5cc1487ed124ca4ed4b": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 336.19170000000002573870006017386913299560546875, "raw_values": [ 336.72550000000001091393642127513885498046875, 335.1299999999999954525264911353588104248046875, 336.7196999999999889041646383702754974365234375 ], "test_run_times": [ 42.36999999999999744204615126363933086395263671875, 39.96000000000000085265128291212022304534912109375, 39.88000000000000255795384873636066913604736328125 ] }, "b": { "value": 337.08210000000002537490217946469783782958984375, "test_run_times": [ 39.9200000000000017053025658242404460906982421875 ] }, "c": { "value": 337.7812999999999874489731155335903167724609375, "raw_values": [ 338.66770000000002482920535840094089508056640625, 337.3020000000000209183781407773494720458984375, 337.3740999999999985448084771633148193359375 ], "test_run_times": [ 39.85000000000000142108547152020037174224853515625, 39.8299999999999982946974341757595539093017578125, 39.85000000000000142108547152020037174224853515625 ] }, "d": { "value": 335.09679999999997335180523805320262908935546875, "raw_values": [ 335.6313000000000101863406598567962646484375, 336.494500000000016370904631912708282470703125, 333.16460000000000718500814400613307952880859375 ], "test_run_times": [ 39.82000000000000028421709430404007434844970703125, 39.92999999999999971578290569595992565155029296875, 39.8599999999999994315658113919198513031005859375 ] } } }, "19d426cc943b00227b564f6813b33d710c2a4615": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario async", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 95.0151000000000038880898500792682170867919921875, "raw_values": [ 94.9145999999999929741534288041293621063232421875, 95.1788999999999987267074175179004669189453125, 94.9517000000000024328983272425830364227294921875 ], "test_run_times": [ 42.36999999999999744204615126363933086395263671875, 39.96000000000000085265128291212022304534912109375, 39.88000000000000255795384873636066913604736328125 ] }, "b": { "value": 94.8817999999999983629095368087291717529296875, "test_run_times": [ 39.9200000000000017053025658242404460906982421875 ] }, "c": { "value": 94.6788999999999987267074175179004669189453125, "raw_values": [ 94.4365999999999985448084771633148193359375, 94.819400000000001682565198279917240142822265625, 94.780699999999995952748577110469341278076171875 ], "test_run_times": [ 39.85000000000000142108547152020037174224853515625, 39.8299999999999982946974341757595539093017578125, 39.85000000000000142108547152020037174224853515625 ] }, "d": { "value": 95.4458000000000055251803132705390453338623046875, "raw_values": [ 95.292599999999993087840266525745391845703125, 95.0473999999999961119101499207317829132080078125, 95.99750000000000227373675443232059478759765625 ], "test_run_times": [ 39.82000000000000028421709430404007434844970703125, 39.92999999999999971578290569595992565155029296875, 39.8599999999999994315658113919198513031005859375 ] } } }, "e9ceeb6664940d8b450401aeeb6cce42adb2afe5": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 56.790199999999998681232682429254055023193359375, "raw_values": [ 56.8524000000000029331204132176935672760009765625, 57.0073000000000007503331289626657962799072265625, 56.51100000000000278532752417959272861480712890625 ], "test_run_times": [ 39.93999999999999772626324556767940521240234375, 39.89999999999999857891452847979962825775146484375, 39.92999999999999971578290569595992565155029296875 ] }, "b": { "value": 59.0082000000000022055246517993509769439697265625, "test_run_times": [ 39.9500000000000028421709430404007434844970703125 ] }, "c": { "value": 57.1792999999999977944753482006490230560302734375, "raw_values": [ 56.80420000000000158024704433046281337738037109375, 57.32430000000000092086338554508984088897705078125, 57.40950000000000130739863379858434200286865234375 ], "test_run_times": [ 39.8299999999999982946974341757595539093017578125, 39.86999999999999744204615126363933086395263671875, 39.89999999999999857891452847979962825775146484375 ] }, "d": { "value": 56.85990000000000321733750752173364162445068359375, "raw_values": [ 57.1563000000000016598278307355940341949462890625, 56.91109999999999757847035652957856655120849609375, 56.51219999999999998863131622783839702606201171875 ], "test_run_times": [ 39.9200000000000017053025658242404460906982421875, 39.89999999999999857891452847979962825775146484375, 39.96000000000000085265128291212022304534912109375 ] } } }, "2d13c0ebad5488ddc8b194766412ebeba7b497e0": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/text_classification\/distilbert-none\/pytorch\/huggingface\/mnli\/base-none --scenario sync", "description": "Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 17.59779999999999944293449516408145427703857421875, "raw_values": [ 17.578199999999998937028067302890121936798095703125, 17.530499999999999971578290569595992565155029296875, 17.684799999999999187139110290445387363433837890625 ], "test_run_times": [ 39.93999999999999772626324556767940521240234375, 39.89999999999999857891452847979962825775146484375, 39.92999999999999971578290569595992565155029296875 ] }, "b": { "value": 16.935500000000001108446667785756289958953857421875, "test_run_times": [ 39.9500000000000028421709430404007434844970703125 ] }, "c": { "value": 17.477900000000001767830326571129262447357177734375, "raw_values": [ 17.592800000000000437694325228221714496612548828125, 17.433499999999998664179656771011650562286376953125, 17.407399999999999096189640113152563571929931640625 ], "test_run_times": [ 39.8299999999999982946974341757595539093017578125, 39.86999999999999744204615126363933086395263671875, 39.89999999999999857891452847979962825775146484375 ] }, "d": { "value": 17.576100000000000278532752417959272861480712890625, "raw_values": [ 17.48440000000000082991391536779701709747314453125, 17.560199999999998254907040973193943500518798828125, 17.683800000000001517719283583573997020721435546875 ], "test_run_times": [ 39.9200000000000017053025658242404460906982421875, 39.89999999999999857891452847979962825775146484375, 39.96000000000000085265128291212022304534912109375 ] } } }, "6089d6134855343b042b5ffe9f952c461140c3ab": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 43.1906000000000034333424991928040981292724609375, "raw_values": [ 43.777299999999996771293808706104755401611328125, 43.02420000000000044337866711430251598358154296875, 42.77040000000000219415596802718937397003173828125 ], "test_run_times": [ 42.8299999999999982946974341757595539093017578125, 42.11999999999999744204615126363933086395263671875, 41.75 ] }, "b": { "value": 43.83840000000000003410605131648480892181396484375, "test_run_times": [ 42.11999999999999744204615126363933086395263671875 ] }, "c": { "value": 43.045400000000000773070496506989002227783203125, "raw_values": [ 43.5568999999999988403942552395164966583251953125, 43.00439999999999685087459511123597621917724609375, 42.5748999999999995225152815692126750946044921875 ], "test_run_times": [ 41.93999999999999772626324556767940521240234375, 42.10000000000000142108547152020037174224853515625, 42.030000000000001136868377216160297393798828125 ] }, "d": { "value": 43.0568999999999988403942552395164966583251953125, "raw_values": [ 43.1499000000000023646862246096134185791015625, 43.075299999999998590283212251961231231689453125, 42.94550000000000267164068645797669887542724609375 ], "test_run_times": [ 42.18999999999999772626324556767940521240234375, 42.2999999999999971578290569595992565155029296875, 42.1099999999999994315658113919198513031005859375 ] } } }, "a2efe4ee2ae3185b2d06fce82479f0651157c55c": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario async", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 736.7739000000000260115484707057476043701171875, "raw_values": [ 724.846800000000030195224098861217498779296875, 738.5114999999999554347596131265163421630859375, 746.9634999999999536157702095806598663330078125 ], "test_run_times": [ 42.8299999999999982946974341757595539093017578125, 42.11999999999999744204615126363933086395263671875, 41.75 ] }, "b": { "value": 726.2504000000000132786226458847522735595703125, "test_run_times": [ 42.11999999999999744204615126363933086395263671875 ] }, "c": { "value": 737.9777000000000271029421128332614898681640625, "raw_values": [ 729.4442000000000234649633057415485382080078125, 740.27809999999999490682967007160186767578125, 744.210900000000037834979593753814697265625 ], "test_run_times": [ 41.93999999999999772626324556767940521240234375, 42.10000000000000142108547152020037174224853515625, 42.030000000000001136868377216160297393798828125 ] }, "d": { "value": 737.852399999999988722265698015689849853515625, "raw_values": [ 733.836000000000012732925824820995330810546875, 739.57619999999997162376530468463897705078125, 740.14499999999998181010596454143524169921875 ], "test_run_times": [ 42.18999999999999772626324556767940521240234375, 42.2999999999999971578290569595992565155029296875, 42.1099999999999994315658113919198513031005859375 ] } } }, "783e4fda90b92632a55752f151f8b54fe13bc5a4": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 17.07450000000000045474735088646411895751953125, "raw_values": [ 17.295899999999999607780409860424697399139404296875, 16.990600000000000591171556152403354644775390625, 16.937000000000001165290086646564304828643798828125 ], "test_run_times": [ 41.53999999999999914734871708787977695465087890625, 41.469999999999998863131622783839702606201171875, 41.590000000000003410605131648480892181396484375 ] }, "b": { "value": 17.99119999999999919282345217652618885040283203125, "test_run_times": [ 41.47999999999999687361196265555918216705322265625 ] }, "c": { "value": 16.98649999999999948840923025272786617279052734375, "raw_values": [ 17.16009999999999990905052982270717620849609375, 16.913900000000001710986907710321247577667236328125, 16.885400000000000630961949354968965053558349609375 ], "test_run_times": [ 41.57000000000000028421709430404007434844970703125, 41.50999999999999801048033987171947956085205078125, 41.53999999999999914734871708787977695465087890625 ] }, "d": { "value": 17.0878000000000014324541552923619747161865234375, "raw_values": [ 17.124700000000000699174051987938582897186279296875, 17.02550000000000096633812063373625278472900390625, 17.113099999999999312194631784223020076751708984375 ], "test_run_times": [ 41.6400000000000005684341886080801486968994140625, 41.61999999999999744204615126363933086395263671875, 41.57000000000000028421709430404007434844970703125 ] } } }, "1f417a129a26ca72098c17e5820805ce0e39abde": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:cv\/segmentation\/yolact-darknet53\/pytorch\/dbolya\/coco\/pruned90-none --scenario sync", "description": "Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 58.55109999999999814690454513765871524810791015625, "raw_values": [ 57.797100000000000363797880709171295166015625, 58.834800000000001318767317570745944976806640625, 59.02150000000000318323145620524883270263671875 ], "test_run_times": [ 41.53999999999999914734871708787977695465087890625, 41.469999999999998863131622783839702606201171875, 41.590000000000003410605131648480892181396484375 ] }, "b": { "value": 55.5621000000000009322320693172514438629150390625, "test_run_times": [ 41.47999999999999687361196265555918216705322265625 ] }, "c": { "value": 58.85260000000000246700437855906784534454345703125, "raw_values": [ 58.255099999999998772182152606546878814697265625, 59.1015000000000014779288903810083866119384765625, 59.20130000000000336513039655983448028564453125 ], "test_run_times": [ 41.57000000000000028421709430404007434844970703125, 41.50999999999999801048033987171947956085205078125, 41.53999999999999914734871708787977695465087890625 ] }, "d": { "value": 58.50110000000000098907548817805945873260498046875, "raw_values": [ 58.375, 58.71470000000000055706550483591854572296142578125, 58.41369999999999862438926356844604015350341796875 ], "test_run_times": [ 41.6400000000000005684341886080801486968994140625, 41.61999999999999744204615126363933086395263671875, 41.57000000000000028421709430404007434844970703125 ] } } }, "c0672a4955f7b2ab1a405f869c012f764e80097e": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 503.41320000000001755324774421751499176025390625, "raw_values": [ 504.01019999999999754436430521309375762939453125, 503.50360000000000582076609134674072265625, 502.7259000000000241925590671598911285400390625 ], "test_run_times": [ 47.92999999999999971578290569595992565155029296875, 46.1700000000000017053025658242404460906982421875, 46.35000000000000142108547152020037174224853515625 ] }, "b": { "value": 508.5901999999999816282070241868495941162109375, "test_run_times": [ 46.77000000000000312638803734444081783294677734375 ] }, "c": { "value": 506.13299999999998135535861365497112274169921875, "raw_values": [ 506.9669000000000096406438387930393218994140625, 506.0185000000000172803993336856365203857421875, 505.41370000000000572981662116944789886474609375 ], "test_run_times": [ 46.27000000000000312638803734444081783294677734375, 46.72999999999999687361196265555918216705322265625, 46.1099999999999994315658113919198513031005859375 ] }, "d": { "value": 504.8419999999999845385900698602199554443359375, "raw_values": [ 506.078800000000001091393642127513885498046875, 504.37709999999998444764059968292713165283203125, 504.06999999999999317878973670303821563720703125 ], "test_run_times": [ 46.25999999999999801048033987171947956085205078125, 46.56000000000000227373675443232059478759765625, 46.1700000000000017053025658242404460906982421875 ] } } }, "60f855709ace180c19d54e5d245b05d6b1c7fe03": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario async", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 63.47699999999999675992512493394315242767333984375, "raw_values": [ 63.40149999999999863575794734060764312744140625, 63.46629999999999682813722756691277027130126953125, 63.563299999999998135535861365497112274169921875 ], "test_run_times": [ 47.92999999999999971578290569595992565155029296875, 46.1700000000000017053025658242404460906982421875, 46.35000000000000142108547152020037174224853515625 ] }, "b": { "value": 62.8111999999999994770405464805662631988525390625, "test_run_times": [ 46.77000000000000312638803734444081783294677734375 ] }, "c": { "value": 63.12950000000000017053025658242404460906982421875, "raw_values": [ 63.02239999999999753299562144093215465545654296875, 63.14330000000000353566065314225852489471435546875, 63.22290000000000276259015663526952266693115234375 ], "test_run_times": [ 46.27000000000000312638803734444081783294677734375, 46.72999999999999687361196265555918216705322265625, 46.1099999999999994315658113919198513031005859375 ] }, "d": { "value": 63.29650000000000176214598468504846096038818359375, "raw_values": [ 63.1443000000000012050804798491299152374267578125, 63.35159999999999769215719425119459629058837890625, 63.39370000000000260342858382500708103179931640625 ], "test_run_times": [ 46.25999999999999801048033987171947956085205078125, 46.56000000000000227373675443232059478759765625, 46.1700000000000017053025658242404460906982421875 ] } } }, "4b84253f6f74267fbb2b339c2ae5a4541816768d": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 64.70720000000000027284841053187847137451171875, "raw_values": [ 65.7793999999999954297891235910356044769287109375, 63.5009000000000014551915228366851806640625, 64.8413000000000039335645851679146289825439453125 ], "test_run_times": [ 79.4800000000000039790393202565610408782958984375, 79.3299999999999982946974341757595539093017578125, 79.590000000000003410605131648480892181396484375 ] }, "b": { "value": 64.3984999999999985220711096189916133880615234375, "test_run_times": [ 79.2900000000000062527760746888816356658935546875 ] }, "c": { "value": 64.115399999999993951860233210027217864990234375, "raw_values": [ 63.538600000000002410160959698259830474853515625, 65.1372000000000070940586738288402557373046875, 63.670400000000000773070496506989002227783203125 ], "test_run_times": [ 79.18000000000000682121026329696178436279296875, 79.2300000000000039790393202565610408782958984375, 78.5799999999999982946974341757595539093017578125 ] }, "d": { "value": 64.0841999999999956116880639456212520599365234375, "raw_values": [ 63.13850000000000051159076974727213382720947265625, 65.1013999999999981582732289098203182220458984375, 64.012699999999995270627550780773162841796875 ], "test_run_times": [ 79.590000000000003410605131648480892181396484375, 80.1700000000000017053025658242404460906982421875, 79.8599999999999994315658113919198513031005859375 ] } } }, "a006a3a5fe1942cc73bba310b95c090a716a2126": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/question_answering\/obert-large\/pytorch\/huggingface\/squad\/pruned97_quant-none --input_shapes='[1,128]' --scenario sync", "description": "Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 15.45100000000000051159076974727213382720947265625, "raw_values": [ 15.1956000000000006622258297284133732318878173828125, 15.7416999999999998038902049302123486995697021484375, 15.415800000000000835598257253877818584442138671875 ], "test_run_times": [ 79.4800000000000039790393202565610408782958984375, 79.3299999999999982946974341757595539093017578125, 79.590000000000003410605131648480892181396484375 ] }, "b": { "value": 15.5220000000000002415845301584340631961822509765625, "test_run_times": [ 79.2900000000000062527760746888816356658935546875 ] }, "c": { "value": 15.5925999999999991274535204865969717502593994140625, "raw_values": [ 15.7322000000000006281197784119285643100738525390625, 15.34609999999999985220711096189916133880615234375, 15.699400000000000687805368215776979923248291015625 ], "test_run_times": [ 79.18000000000000682121026329696178436279296875, 79.2300000000000039790393202565610408782958984375, 78.5799999999999982946974341757595539093017578125 ] }, "d": { "value": 15.6000999999999994116706147906370460987091064453125, "raw_values": [ 15.8314000000000003609557097661308944225311279296875, 15.3544999999999998152588887023739516735076904296875, 15.61449999999999960209606797434389591217041015625 ], "test_run_times": [ 79.590000000000003410605131648480892181396484375, 80.1700000000000017053025658242404460906982421875, 79.8599999999999994315658113919198513031005859375 ] } } }, "94d990fdc1f5d799aaa05fc120ac31cf1220b272": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 37.7351000000000027512214728631079196929931640625, "raw_values": [ 37.92519999999999669171302230097353458404541015625, 37.714799999999996771293808706104755401611328125, 37.56530000000000057980287238024175167083740234375 ], "test_run_times": [ 49.409999999999996589394868351519107818603515625, 45.47999999999999687361196265555918216705322265625, 45.24000000000000198951966012828052043914794921875 ] }, "b": { "value": 37.9455999999999988858689903281629085540771484375, "test_run_times": [ 45.090000000000003410605131648480892181396484375 ] }, "c": { "value": 37.9380000000000023874235921539366245269775390625, "raw_values": [ 38.3943000000000012050804798491299152374267578125, 37.89309999999999689634933019988238811492919921875, 37.52649999999999863575794734060764312744140625 ], "test_run_times": [ 45.31000000000000227373675443232059478759765625, 45.02000000000000312638803734444081783294677734375, 45.030000000000001136868377216160297393798828125 ] }, "d": { "value": 37.4534000000000020236257114447653293609619140625, "raw_values": [ 37.63409999999999655528881703503429889678955078125, 37.2939999999999969304553815163671970367431640625, 37.4320000000000021600499167107045650482177734375 ], "test_run_times": [ 45.24000000000000198951966012828052043914794921875, 45.13000000000000255795384873636066913604736328125, 45.38000000000000255795384873636066913604736328125 ] } } }, "45f6d0177f8c6a689eb02824f962c055c66a9292": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario async", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 841.425899999999955980456434190273284912109375, "raw_values": [ 837.282500000000027284841053187847137451171875, 841.71559999999999490682967007160186767578125, 845.2795999999999594365363009274005889892578125 ], "test_run_times": [ 49.409999999999996589394868351519107818603515625, 45.47999999999999687361196265555918216705322265625, 45.24000000000000198951966012828052043914794921875 ] }, "b": { "value": 837.4580999999999448846210725605487823486328125, "test_run_times": [ 45.090000000000003410605131648480892181396484375 ] }, "c": { "value": 837.1417999999999892679625190794467926025390625, "raw_values": [ 824.538099999999985811882652342319488525390625, 843.9666999999999461579136550426483154296875, 842.9206000000000358340912498533725738525390625 ], "test_run_times": [ 45.31000000000000227373675443232059478759765625, 45.02000000000000312638803734444081783294677734375, 45.030000000000001136868377216160297393798828125 ] }, "d": { "value": 845.4438000000000101863406598567962646484375, "raw_values": [ 840.2595000000000027284841053187847137451171875, 848.2696999999999434294295497238636016845703125, 847.8021999999999707142706029117107391357421875 ], "test_run_times": [ 45.24000000000000198951966012828052043914794921875, 45.13000000000000255795384873636066913604736328125, 45.38000000000000255795384873636066913604736328125 ] } } }, "a7579910c8f49ef834c189504eac153d4889bd74": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "items\/sec", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 14.0751000000000008327560863108374178409576416015625, "raw_values": [ 14.2312999999999991729282555752433836460113525390625, 13.9396000000000004348521542851813137531280517578125, 14.0542999999999995708321876008994877338409423828125 ], "test_run_times": [ 45.50999999999999801048033987171947956085205078125, 45.56000000000000227373675443232059478759765625, 45.469999999999998863131622783839702606201171875 ] }, "b": { "value": 14.3078000000000002955857780762016773223876953125, "test_run_times": [ 45.3599999999999994315658113919198513031005859375 ] }, "c": { "value": 14.1047999999999991160848367144353687763214111328125, "raw_values": [ 14.3421000000000002927436071331612765789031982421875, 14.1227000000000000312638803734444081783294677734375, 13.8496000000000005769607014372013509273529052734375 ], "test_run_times": [ 45.3900000000000005684341886080801486968994140625, 45.27000000000000312638803734444081783294677734375, 45.38000000000000255795384873636066913604736328125 ] }, "d": { "value": 13.999700000000000699174051987938582897186279296875, "raw_values": [ 14.0127000000000005996980689815245568752288818359375, 13.940799999999999414512785733677446842193603515625, 14.045700000000000073896444519050419330596923828125 ], "test_run_times": [ 45.56000000000000227373675443232059478759765625, 45.5, 45.5 ] } } }, "f685725c528a5d2cf742e05056ea0eefacd5a426": { "identifier": "pts\/deepsparse-1.6.0", "title": "Neural Magic DeepSparse", "app_version": "1.6", "arguments": "zoo:nlp\/token_classification\/bert-base\/pytorch\/huggingface\/conll2003\/base-none --scenario sync", "description": "Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream", "scale": "ms\/batch", "proportion": "LIB", "display_format": "BAR_GRAPH", "results": { "a": { "value": 71.0390000000000014779288903810083866119384765625, "raw_values": [ 70.2537999999999982492226990871131420135498046875, 71.7240000000000037516656448133289813995361328125, 71.1390999999999991132426657713949680328369140625 ], "test_run_times": [ 45.50999999999999801048033987171947956085205078125, 45.56000000000000227373675443232059478759765625, 45.469999999999998863131622783839702606201171875 ] }, "b": { "value": 69.87839999999999918145476840436458587646484375, "test_run_times": [ 45.3599999999999994315658113919198513031005859375 ] }, "c": { "value": 70.898899999999997589839040301740169525146484375, "raw_values": [ 69.711399999999997589839040301740169525146484375, 70.794499999999999317878973670303821563720703125, 72.1907000000000067529981606639921665191650390625 ], "test_run_times": [ 45.3900000000000005684341886080801486968994140625, 45.27000000000000312638803734444081783294677734375, 45.38000000000000255795384873636066913604736328125 ] }, "d": { "value": 71.4164999999999992041921359486877918243408203125, "raw_values": [ 71.3499000000000052068571676500141620635986328125, 71.7180000000000035242919693700969219207763671875, 71.181499999999999772626324556767940521240234375 ], "test_run_times": [ 45.56000000000000227373675443232059478759765625, 45.5, 45.5 ] } } } } }