Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2112300-NE-2101277HA07

Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Desktop Graphics ^{5 Tests}
OpenGL Demos Test Suite ^{4 Tests}
Unigine Test Suite ^{4 Tests}

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Table

Show Detailed System Result Table

Run Management

Highlight
Result

Hide
Result

Result
Identifier

Performance Per
Dollar

Date
Run

Test
Duration

Baseline

January 27 2021

1 Hour, 36 Minutes

Micro optimizations applied

January 27 2021

1 Hour, 35 Minutes

Navi2-virgl-async-comannd-stream

December 30 2021

1 Hour, 39 Minutes

Invert Hiding All Results Option

1 Hour, 37 Minutes

Only show results where is faster than

Only show results matching title/arguments (delimit multiple options with a comma):

Do not show results matching title/arguments (delimit multiple options with a comma):

{ "title": "Virgl optimization benchmarks", "last_modified": "2021-12-30 17:01:07", "description": "Asynchronous command stream submission", "reference_id": "2101277-HA-2101266HA38", "systems": { "Micro optimizations applied": { "identifier": "Micro optimizations applied", "hardware": { "Processor": "5 x QEMU Virtual 2.5+ (5 Cores)", "Motherboard": "QEMU Standard PC (Q35 + ICH9 2009) (rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org BIOS)", "Chipset": "Intel 82G33\/G31\/P35\/P31 + ICH9", "Memory": "8GB", "Disk": "49GB", "Graphics": "virgl", "Monitor": "QEMU Monitor", "Network": "Red Hat Virtio device" }, "software": { "OS": "Ubuntu 20.10", "Kernel": "5.8.0-40-generic (x86_64)", "Display Server": "X Server 1.20.9", "Display Driver": "modesetting 1.20.9", "OpenGL": "4.3 Mesa 21.1.0-devel (git-10b3eecd36)", "Compiler": "GCC 10.2.0 + LLVM 11.0.0", "File-System": "ext4", "Screen Resolution": "1440x900", "System Layer": "KVM QEMU" }, "user": "gerddie", "timestamp": "2021-01-27 12:06:46", "data": { "cpu-microcode": "0x1000065", "python": "Python 2.7.18 + Python 3.8.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } }, "Baseline": { "identifier": "Baseline", "hardware": { "Processor": "5 x QEMU Virtual 2.5+ (5 Cores)", "Motherboard": "QEMU Standard PC (Q35 + ICH9 2009) (rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org BIOS)", "Chipset": "Intel 82G33\/G31\/P35\/P31 + ICH9", "Memory": "8GB", "Disk": "49GB", "Graphics": "virgl", "Monitor": "QEMU Monitor", "Network": "Red Hat Virtio device" }, "software": { "OS": "Ubuntu 20.10", "Kernel": "5.8.0-40-generic (x86_64)", "Display Server": "X Server 1.20.9", "Display Driver": "modesetting 1.20.9", "OpenGL": "4.3 Mesa 21.1.0-devel (git-10b3eecd36)", "Compiler": "GCC 10.2.0 + LLVM 11.0.0", "File-System": "ext4", "Screen Resolution": "1440x900", "System Layer": "KVM QEMU" }, "user": "gerddie", "timestamp": "2021-01-27 13:49:42", "data": { "cpu-microcode": "0x1000065", "python": "Python 2.7.18 + Python 3.8.6", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } }, "Navi2-virgl-async-comannd-stream": { "identifier": "Navi2-virgl-async-comannd-stream", "hardware": { "Processor": "8 x QEMU Virtual 2.5+ (8 Cores)", "Motherboard": "QEMU Standard PC (Q35 + ICH9 2009) (rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org BIOS)", "Chipset": "Intel 82G33\/G31\/P35\/P31 + ICH9", "Memory": "16GB", "Disk": "97GB", "Graphics": "virgl 12288GB", "Audio": "QEMU Generic", "Monitor": "QEMU Monitor", "Network": "Red Hat Virtio device" }, "software": { "OS": "Debian unstable", "Kernel": "5.15.0-2-amd64 (x86_64)", "Display Server": "X Server 1.20.13", "OpenGL": "4.3 Mesa 22.0.0-devel (git-b952b93393) (LLVM 13.0.0 D...)", "Compiler": "GCC 11.2.0", "File-System": "ext4", "Screen Resolution": "1440x900", "System Layer": "KVM QEMU" }, "user": "gerddie", "timestamp": "2021-12-30 14:09:14", "client_version": "10.8.0", "data": { "cpu-microcode": "0x1000065", "kernel-extra-details": "Transparent Huge Pages: always", "python": "Python 3.9.9", "security": "itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of usercopy\/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected" } } }, "results": { "bd4c918253bf3bd8d09f6443eb65614362958667": { "identifier": "pts\/unigine-sanctuary-1.6.4", "title": "Unigine Sanctuary", "app_version": "2.3", "arguments": "-video_width 1024 -video_height 768 -video_fullscreen 0", "description": "Resolution: 1024 x 768 - Mode: Fullscreen", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 145.765999999999991132426657713949680328369140625, "raw_values": [ 136.270999999999986584953148849308490753173828125, 151.34600000000000363797880709171295166015625, 136.349999999999994315658113919198513031005859375, 136.633999999999986130205797962844371795654296875, 153.652999999999991587174008600413799285888671875, 152.30099999999998772182152606546878814697265625, 137.203000000000002955857780762016773223876953125, 149.438999999999992951416061259806156158447265625, 150.22300000000001318767317570745944976806640625, 147.2930000000000063664629124104976654052734375, 149.167000000000001591615728102624416351318359375, 149.3120000000000118234311230480670928955078125 ], "test_run_times": [ 187.009999999999990905052982270717620849609375, 186.840000000000003410605131648480892181396484375, 186.849999999999994315658113919198513031005859375, 186.780000000000001136868377216160297393798828125, 186.840000000000003410605131648480892181396484375, 186.849999999999994315658113919198513031005859375, 186.80000000000001136868377216160297393798828125, 186.8600000000000136424205265939235687255859375, 186.8700000000000045474735088646411895751953125, 186.840000000000003410605131648480892181396484375, 186.830000000000012505552149377763271331787109375, 186.8600000000000136424205265939235687255859375 ] }, "Baseline": { "value": 141.913999999999987267074175179004669189453125, "raw_values": [ 135.344999999999998863131622783839702606201171875, 133.875, 148.4379999999999881765688769519329071044921875, 149.945999999999997953636921010911464691162109375, 148.760999999999995679900166578590869903564453125, 140.705999999999988858689903281629085540771484375, 144.323000000000007503331289626657962799072265625, 143.34600000000000363797880709171295166015625, 138.47100000000000363797880709171295166015625, 136.705999999999988858689903281629085540771484375, 140.181000000000011596057447604835033416748046875, 142.87299999999999045030563138425350189208984375 ], "test_run_times": [ 187.080000000000012505552149377763271331787109375, 186.830000000000012505552149377763271331787109375, 186.81000000000000227373675443232059478759765625, 186.81999999999999317878973670303821563720703125, 186.830000000000012505552149377763271331787109375, 186.900000000000005684341886080801486968994140625, 186.8799999999999954525264911353588104248046875, 186.849999999999994315658113919198513031005859375, 186.909999999999996589394868351519107818603515625, 187.090000000000003410605131648480892181396484375, 186.93999999999999772626324556767940521240234375, 186.919999999999987494447850622236728668212890625 ] }, "Navi2-virgl-async-comannd-stream": { "value": 249.974999999999994315658113919198513031005859375, "raw_values": [ 211.631000000000000227373675443232059478759765625, 249.673000000000001818989403545856475830078125, 205.144000000000005456968210637569427490234375, 247.240000000000009094947017729282379150390625, 381.93500000000000227373675443232059478759765625, 256.7930000000000063664629124104976654052734375, 243.741000000000013869794202037155628204345703125, 241.17500000000001136868377216160297393798828125, 212.43999999999999772626324556767940521240234375 ], "test_run_times": [ 183.849999999999994315658113919198513031005859375, 181.56999999999999317878973670303821563720703125, 181.6299999999999954525264911353588104248046875, 181.6100000000000136424205265939235687255859375, 181.650000000000005684341886080801486968994140625, 181.539999999999992041921359486877918243408203125, 181.530000000000001136868377216160297393798828125, 181.520000000000010231815394945442676544189453125, 181.539999999999992041921359486877918243408203125 ] } } }, "94c291ddc6909bb78a4615f973aca06352264080": { "identifier": "pts\/unigine-tropics-1.6.4", "title": "Unigine Tropics", "app_version": "1.3", "arguments": "-video_width 1024 -video_height 768 -video_fullscreen 0", "description": "Resolution: 1024 x 768 - Mode: Fullscreen", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 121.929000000000002046363078989088535308837890625, "raw_values": [ 122.0160000000000053432813729159533977508544921875, 122.207999999999998408384271897375583648681640625, 121.563999999999992951416061259806156158447265625 ], "test_run_times": [ 210.789999999999992041921359486877918243408203125, 210.580000000000012505552149377763271331787109375, 210.590000000000003410605131648480892181396484375 ] }, "Baseline": { "value": 118.445999999999997953636921010911464691162109375, "raw_values": [ 118.1099999999999994315658113919198513031005859375, 118.4680000000000035242919693700969219207763671875, 118.7590000000000003410605131648480892181396484375 ], "test_run_times": [ 210.8600000000000136424205265939235687255859375, 210.669999999999987494447850622236728668212890625, 210.710000000000007958078640513122081756591796875 ] }, "Navi2-virgl-async-comannd-stream": { "value": 227.72399999999998954081092961132526397705078125, "raw_values": [ 216.104000000000013415046851150691509246826171875, 221.8319999999999936335370875895023345947265625, 229.931000000000011596057447604835033416748046875, 232.258000000000009777068044058978557586669921875, 220.663999999999987267074175179004669189453125, 230.239000000000004320099833421409130096435546875, 234.679000000000002046363078989088535308837890625, 238.628999999999990677679306827485561370849609375, 243.89199999999999590727384202182292938232421875, 209.008000000000009777068044058978557586669921875 ], "test_run_times": [ 206.31000000000000227373675443232059478759765625, 204.270000000000010231815394945442676544189453125, 204.219999999999998863131622783839702606201171875, 204.280000000000001136868377216160297393798828125, 204.240000000000009094947017729282379150390625, 204.18999999999999772626324556767940521240234375, 204.270000000000010231815394945442676544189453125, 204.31000000000000227373675443232059478759765625, 204.259999999999990905052982270717620849609375, 204.31000000000000227373675443232059478759765625 ] } } }, "f06ead5dd4b02dfaf679e3e2963aa431c25bdd59": { "identifier": "pts\/unigine-heaven-1.6.5", "title": "Unigine Heaven", "app_version": "4.0", "arguments": "-video_width 1024 -video_height 768 -video_fullscreen 0 -video_app opengl", "description": "Resolution: 1024 x 768 - Mode: Fullscreen - Renderer: OpenGL", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 64.47259999999999990905052982270717620849609375, "raw_values": [ 64.7471000000000032059688237495720386505126953125, 64.167699999999996407495927996933460235595703125, 64.5031000000000034333424991928040981292724609375 ], "test_run_times": [ 311.6399999999999863575794734060764312744140625, 310.990000000000009094947017729282379150390625, 311.1000000000000227373675443232059478759765625 ] }, "Baseline": { "value": 60.70439999999999969304553815163671970367431640625, "raw_values": [ 59.8984999999999985220711096189916133880615234375, 60.28649999999999664623828721232712268829345703125, 61.928100000000000591171556152403354644775390625 ], "test_run_times": [ 316.95999999999997953636921010911464691162109375, 315.740000000000009094947017729282379150390625, 313.82999999999998408384271897375583648681640625 ] }, "Navi2-virgl-async-comannd-stream": { "value": 208.2450000000000045474735088646411895751953125, "raw_values": [ 209.032000000000010686562745831906795501708984375, 206.371000000000009322320693172514438629150390625, 209.330999999999988858689903281629085540771484375 ], "test_run_times": [ 288.029999999999972715158946812152862548828125, 288.32999999999998408384271897375583648681640625, 286.07999999999998408384271897375583648681640625 ] } } }, "3b5ac9c848023fb4ff493d9d51a44126ecd42773": { "identifier": "pts\/unigine-valley-1.1.8", "title": "Unigine Valley", "app_version": "1.0", "arguments": "-video_width 1024 -video_height 768 -video_fullscreen 0 -video_app opengl", "description": "Resolution: 1024 x 768 - Mode: Fullscreen - Renderer: OpenGL", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 42.54249999999999687361196265555918216705322265625, "raw_values": [ 42.3701999999999969759301166050136089324951171875, 42.74130000000000251247911364771425724029541015625, 42.51610000000000155750967678613960742950439453125 ], "test_run_times": [ 217.1299999999999954525264911353588104248046875, 216.919999999999987494447850622236728668212890625, 216.840000000000003410605131648480892181396484375 ] }, "Baseline": { "value": 41.64869999999999805595507496036589145660400390625, "raw_values": [ 41.605400000000003046807250939309597015380859375, 41.658400000000000318323145620524883270263671875, 41.68229999999999790816218592226505279541015625 ], "test_run_times": [ 218.25, 217.56999999999999317878973670303821563720703125, 217.479999999999989768184605054557323455810546875 ] }, "Navi2-virgl-async-comannd-stream": { "value": 187.813999999999992951416061259806156158447265625, "raw_values": [ 185.359000000000008867573342286050319671630859375, 189.953000000000002955857780762016773223876953125, 188.128999999999990677679306827485561370849609375 ], "test_run_times": [ 210.039999999999992041921359486877918243408203125, 208.719999999999998863131622783839702606201171875, 209.469999999999998863131622783839702606201171875 ] } } }, "0c8a7ade36c3cc8c6e767327f0988e84d488104a": { "identifier": "pts\/xonotic-1.5.1", "title": "Xonotic", "app_version": "0.8.2", "arguments": "+vid_width 1024 +vid_height 768 +exec effects-ultimate.cfg", "description": "Resolution: 1024 x 768 - Effects Quality: Ultimate", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 77.8778175000000061345417634584009647369384765625, "raw_values": [ 77.814021999999994250174495391547679901123046875, 78.4572634999999962701622280292212963104248046875, 77.362166900000005398396751843392848968505859375 ], "min_result": [ "16" ], "max_result": [ "175" ], "test_run_times": [ 146.30000000000001136868377216160297393798828125, 144.68999999999999772626324556767940521240234375, 146.56000000000000227373675443232059478759765625 ] }, "Baseline": { "value": 76.5941184999999933324943413026630878448486328125, "raw_values": [ 76.113198100000005297260941006243228912353515625, 76.74622709999999869978637434542179107666015625, 76.9229303000000044221451389603316783905029296875 ], "min_result": [ "17" ], "max_result": [ "178" ], "test_run_times": [ 149.580000000000012505552149377763271331787109375, 147.68000000000000682121026329696178436279296875, 147.469999999999998863131622783839702606201171875 ] }, "Navi2-virgl-async-comannd-stream": { "value": 244.75804160000001274966052733361721038818359375, "raw_values": [ 242.39687359999999216597643680870532989501953125, 244.294430699999992384618963114917278289794921875, 247.5828205999999909181497059762477874755859375 ], "min_result": [ "41" ], "max_result": [ "635" ], "test_run_times": [ 49.03999999999999914734871708787977695465087890625, 48.39999999999999857891452847979962825775146484375, 47.780000000000001136868377216160297393798828125 ] } } }, "341f8eacf60b129e719dd21f75e7666ace6a4ee9": { "identifier": "pts\/glmark2-1.2.0", "title": "GLmark2", "app_version": "2020.04", "arguments": "-s 1024x768", "description": "Resolution: 1024 x 768", "scale": "Score", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 1312, "test_run_times": [ 332.009999999999990905052982270717620849609375 ] }, "Baseline": { "value": 1273, "test_run_times": [ 332.029999999999972715158946812152862548828125 ] }, "Navi2-virgl-async-comannd-stream": { "value": 4887, "test_run_times": [ 330.94999999999998863131622783839702606201171875 ] } } }, "bbde0e676f2758277e932f4fe8fed7a531c48b1b": { "identifier": "pts\/gputest-1.3.2", "title": "GpuTest", "app_version": "0.7.0", "arguments": "\/width 1024 \/height 768 \/test=fur ", "description": "Resolution: 1024 x 768 - Mode: Fullscreen", "scale": "Points", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 6492, "raw_values": [ 6432, 6643, 6401 ], "test_run_times": [ 65.2300000000000039790393202565610408782958984375, 65.219999999999998863131622783839702606201171875, 65.2900000000000062527760746888816356658935546875 ] }, "Baseline": { "value": 6293, "raw_values": [ 6318, 6265, 6296 ], "test_run_times": [ 65.3599999999999994315658113919198513031005859375, 65.2300000000000039790393202565610408782958984375, 65.2600000000000051159076974727213382720947265625 ] }, "Navi2-virgl-async-comannd-stream": { "value": 11825, "raw_values": [ 11800, 11851, 11825 ], "test_run_times": [ 65.3700000000000045474735088646411895751953125, 65.06000000000000227373675443232059478759765625, 65.06000000000000227373675443232059478759765625 ] } } }, "723c01e28eda02b83171cf8f2ce6bbc5113facb2": { "title": "OpenArena", "app_version": "0.8.8", "arguments": "+set r_customWidth 1024 +set r_customHeight 768 +set r_fullscreen 0", "description": "Resolution: 1024 x 768 - Total Frame Time", "scale": "Milliseconds", "proportion": "LIB", "display_format": "LINE_GRAPH", "results": { "Micro optimizations applied": { "value": "13,32,15,8,7,8,8,9,8,8,8,8,8,8,7,9,11,6,7,9,7,6,8,8,8,7,8,8,8,10,8,16,10,7,8,8,10,10,9,12,13,14,12,15,19,16,17,17,16,17,28,16,15,15,17,16,16,14,17,21,15,22,20,18,16,20,17,16,18,14,16,15,17,15,14,16,25,18,18,17,19,14,15,15,15,15,15,16,15,16,18,17,14,18,16,19,18,14,16,15,16,14,18,13,14,16,15,17,16,20,15,11,24,16,12,14,12,16,14,13,14,13,13,14,13,13,12,10,12,13,10,21,15,11,16,14,11,14,12,13,14,13,16,15,13,12,14,13,16,14,19,12,19,14,15,16,16,14,15,13,13,13,16,14,19,15,17,17,16,17,17,16,13,20,17,15,16,17,15,17,14,15,15,18,21,17,16,21,18,20,22,18,19,18,20,19,26,19,15,18,17,19,18,18,21,18,17,19,17,15,26,17,18,16,15,17,16,14,15,17,14,16,16,16,22,28,20,18,16,19,22,20,19,19,21,20,17,19,27,18,17,14,13,10,12,8,5,6,5,9,11,10,10,12,11,12,9,11,10,11,10,19,16,10,14,12,10,11,10,11,10,10,11,9,10,9,11,13,10,9,10,10,9,9,11,16,12,10,9,9,10,8,9,10,8,7,7,8,7,8,4,8,4,9,4,6,9,5,9,8,10,8,11,10,10,18,9,10,9,10,8,9,9,11,10,10,11,12,9,10,12,11,11,11,10,11,8,5,11,14,20,16,12,10,12,12,14,15,11,16,12,15,14,14,12,12,12,12,11,19,15,11,15,11,11,11,11,10,12,9,12,9,11,10,11,9,13,11,10,9,9,9,17,10,11,9,7,6,7,7,7,6,7,6,7,7,6,6,6,10,7,7,7,9,8,7,7,9,8,9,8,8,7,7,8,18,11,9,9,7,8,8,9,8,8,8,8,8,8,7,8,7,7,7,8,7,8,8,8,7,8,7,8,8,12,13,16,11,9,11,9,10,10,11,10,10,10,11,10,9,9,8,10,9,9,8,9,7,9,8,7,8,17,13,7,9,9,9,9,9,8,8,9,9,8,8,9,10,7,8,9,8,9,8,9,8,9,10,8,10,11,17,14,14,10,9,10,10,12,12,10,13,15,14,11,12,12,12,11,13,13,12,17,13,14,14,12,12,13,11,9,9,8,9,7,8,7,7,7,6,7,7,6,6,6,7,6,6,7,5,6,5,13,8,5,7,6,6,5,6,5,7,8,9,11,10,12,10,11,12,11,10,10,11,12,11,9,11,11,11,14,10,13,12,10,12,10,12,12,10,12,12,10,7,11,11,9,10,10,9,9,11,8,9,17,12,9,8,9,9,9,8,8,8,8,7,8,8,13,8,7,9,7,7,8,8,8,7,8,8,9,7,7,7,4,18,4,8,3,10,4,9,3,8,4,10,3,8,2,7,4,8,4,8,4,8,3,9,4,6,8,4,9,7,5,9,3,10,4,10,3,9,3,9,2,11,10,4,4,7,3,8,3,8,4,9,6,12,5,4,9,7,8,9,8,8,9,7,7,7,7,5,9,4,10,3,9,4,8,3,8,5,7,3,7,11,4,7,4,6,3,7,3,6,3,6,3,7,3,6,3,7,3,8,3,7,3,7,3,8,3,8,3,7,3,8,3,8,4,5,8,4,9,4,9,4,5,6,7,5,8,3,17,3,6,5,9,5,6,8,5,6,5,9,10,10,11,11,11,11,10,10,10,11,11,12,14,10,11,10,12,11,7,6,9,5,9,6,4,8,6,10,6,11,14,16,11,11,8,9,7,8,7,8,8,7,7,7,8,7,17,8,10,8,8,9,8,9,10,8,8,8,8,7,8,9,8,8,9,8,7,8,10,8,7,8,7,5,9,3,9,16,7,7,7,6,8,7,7,7,6,6,7,6,6,8,12,14,8,8,2,6,3,7,3,8,3,7,3,9,4,7,4,9,4,8,3,8,4,10,13,6,5,9,2,7,3,10,3,6,6,3,7,3,8,3,8,4,10,4,10,4,9,3,9,6,10,4,10,4,10,6,9,5,6,4,8,4,5,8,12,7,5,8,4,7,3,8,3,10,4,8,6,9,8,6,6,7,9,9,9,11,10,10,10,13,13,11,11,10,10,19,12,11,10,11,12,11,10,12,11,11,12,10,10,9,8,10,9,9,11,9,10,9,10,17,11,8,9,8,8,7,8,8,8,8,8,10,11,11,13,11,12,11,11,11,10,10,11,11,9,16,11,9,10,10,10,10,8,10,9,9,10,9,11,9,11,9,9,9,9,10,9,10,9,9,9,15,11,9,10,10,10,10,9,10,9,9,9,9,8,11,8,6,6,6,6,9,9,11,10,11,11,10,20,14,8,10,10,10,10,10,11,9,11,9,10,8,9,9,9,9,9,9,10,8,8,9,10,8,16,12,7,8,8,8,7,8,7,8,9,9,9,8,8,9,9,8,8,8,10,11,10,10,9,10,10,13,17,13,10,11,9,10,12,10,10,11,11,13,14,10,10,12,11,11,11,11,11,10,8,17,9,10,10,9,7,9,11,10,12,10,10,10,10,10,9,9,9,9,9,10,8,10,10,10,11,19,15,13,13,13,16,19,17,16,15,14,15,15,16,16,17,22,14,17,17,17,14,15,14,12,16,14,13,11,11,10,10,10,8,8,9,15,10,8,9,7,8,9,7,8,9,7,9,7,8,9,9,8,9,10,9,8,7,10,9,8,9,7,8,9,7,15,8,8,9,7,8,8,7,8,9,8,8,10,7,8,6,7,7,7,7,6,6,6,6,8,6,7,6,6,8,6,6,4,4,8,4,16,6,12,12,11,13,13,15,13,17,16,15,15,17,18,14,14,15,25,19,21,19,18,16,20,18,20,19,17,18,18,26,22,19,19,17,17,17,17,17,18,17,20,17,19,23,17,16,16,14,15,16,17,15,17,15,15,15,16,19,17,21,17,13,17,19,17,15,16,22,17,18,21,19,16,22,17,16,16,17,16,17,16,16,17,16,15,20,18,19,26,18,20,18,15,21,18,16,19,18,18,16,17,13,17,16,15,13,16,16,14,19,16,15,16,16,17,16,14,19,17,17,14,14,19,17,17,16,16,14,11,9,5,5,9,8,11,9,10,12,9,9,18,11,12,12,13,13,13,11,13,12,13,13,11,15,12,14,13,10,13,13,21,16,14,10,13,12,15,13,12,11,12,12,11,12,11,11,12,12,10,11,11,16,11,11,10,11,10,10,10,11,9,10,9,9,9,8,9,10,10,10,11,10,13,8,9,9,19,13,7,10,8,9,8,9,9,10,11,12,11,11,11,11,13,12,12,12,11,12,11,10,19,12,13,12,18,17,13,9,5,7,10,4,10,4,13,6,9,5,10,4,5,8,4,9,5,5,7,9,18,10,10,7,7,7,8,8,7,7,8,7,8,7,8,6,6,6,7,4,8,3,10,4,9,5,11,15,19,20,21,14,15,11,9,10,11,13,11,12,12,13,10,18,19,17,17,19,23,21,17,16,16,17,16,13,16,15,16,16,17,16,15,14,20,15,16,17,18,16,17,16,15,16,15,17,16,12,14,13,22,18,12,14,15,11,14,12,12,12,11,12,12,13,13,12,12,13,11,13,17,12,13,14,12,13,15,11,13,11,12,12,9,10,9,9,10,9,9,9,9,11,18,12,10,11,12,12,10,14,14,14,12,14,13,12,13,15,13,16,10,13,20,14,9,8,6,6,4,6,10,13,11,11,12,11,10,11,10,10,10,11,13,11,12,11,11,17,11,10,12,11,10,10,11,10,8,10,11,9,10,9,10,10,10,9,10,12,10,14,11,18,11,11,9,9,6,11,12,12,10,10,11,11,10,13,11,6,11,4,9,6,9,11,13,16,19,17,14,17,15,16,16,20,18,19,18,15,16,16,16,25,20,15,16,20,16,7,3,8,5,8,8,5,14,15,12,14,12,13,11,11,11,17,14,17,16,15,14,15,13,13,13,13,11,12,13,11,13,12,12,12,18,14,11,10,10,10,10,10,11,10,10,9,10,10,10,10,9,12,12,11,9,8,11,9,16,9,10,8,6,6,6,7,6,6,6,6,7,11,7,9,11,9,7,9,9,9,9,8,9,6,8,9,9,10,21,13,11,8,11,9,8,8,9,9,8,7,8,10,9,10,10,9,9,10,9,9,10,8,7,8,7,8,15,10,7,8,7,8,8,8,6,7,7,6,7,5,4,9,11,10,11,13,12,12,11,11,11,10,10,8,18,10,7,8,8,4,9,8,7,6,6,5,6,6,7,6,6,6,8,8,7,8,9,8,9,8,9,10,12,12,11,11,18,9,11,10,10,10,10,10,11,11,11,11,16,10,17,14,13,11,12,5,13,10,16,11,9,15,17,12,15,14,14,15,16,19,12,14,14,14,12,15,22,15,10,11,11,11,10,18,16,15,15,15,12,10,13,13,12,13,13,13,19,11,12,8,10,9,10,10,12,9,11,11,11,11,11,11,10,12,11,11,12,13,12,19,17,17,17,16,16,16,16,16,17,13,14,15,18,15,16,19,17,17,16,16,15,14,11,9,8,9,8,8,8,7,8,8,9,8,9,8,8,6,7,7,13,9,8,7,7,6,7,6,8,7,8,8,8,8,8,8,9,10,11,13,11,12,10,11,12,11,13,24,15,13,12,13,13,15,15,17,12,16,17,19,18,21,19,23,17,14,13,14,14,15,15,16,14,14,14,13,13,11,12,13,12,11,16,11,11,11,11,9,11,9,10,10,10,9,11,9,9,10,9,10,10,9,9,9,9,10,11,17,10,10,9,9,10,9,9,9,9,8,8,9,7,9,7,8,5,5,9,8,9,8,5,9,3,10,8,8,9,15,9,9,8,11,9,8,8,8,8,8,8,7,8,9,10,8,9,8,8,8,8,9,8,10,9,8,8,9,8,14,10,9,8,8,5,9,4,6,9,7,6,10,6,6,9,5,9,5,6,6,9,4,9,4,5,9,5,11,7,8,9,8,10,16,12,10,9,9,9,10,11,12,11,10,12,11,12,11,10,11,10,10,10,11,10,10,10,21,11,10,12,9,9,9,9,10,9,11,10,11,14,11,10,9,9,9,8,9,8,9,8,8,7,14,8,8,7,8,7,5,7,6,7,6,7,7,7,6,12,7,7,6,5,7,6,7,6,6,6,8,6,6,8,7,6,7,6,6,8,15,8,7,6,7,8,7,8,7,7,7,7,8,7,7,9,8,8,8,10,9,8,8,9,8,9,8,8,8,10,9,7,14,10,9,8,7,8,11,9,8,9,8,8,8,8,8,8,8,9,8,9,7,9,8,9,8,7,13,13,23,13,15,14,16,14,15,19,16,19,17,14,14,16,17,17,20,17,17,17,17,16,20,19,18,16,18,21,22,21,21,21,22,21,23,20,18,20,20,21,19,18,29,23,19,20,17,18,20,20,20,21,23,19,19,21,19,19,21,23,21,22,20,19,17,18,11,12,10,18,14,9,8,7,9,11,9,7,6,10,9,9,11,11,11,8,8,8,10,9,9,9,10,9,11,13,20,14,8,10,10,10,10,9,9,10,10,9,9,9,8,9,9,9,8,8,9,9,9,7,8,5,10,19,21,20,20,17,21,20,22,21,20,20,18,18,16,18,19,19,18,16,17,18,20,17,17,17,19,19,26,20,19,17,17,19,15,11,11,13,14,18,17,14,17,18,17,18,16,16,15,14,15,12,13,13,11,15,12,14,13,12,11,10,10,15,13,13,12,18,16,14,12,14,9,8,8,9,9,9,8,8,9,9,9,11,10,10,17,11,10,9,10,9,8,8,9,9,8,10,10,11,12,12,10,13,12,13,12,10,7,9,8,15,9,7,8,7,6,8,9,8,12,8,10,9,8,8,9,8,8,8,9,11,12,12,12,15,14,24,12,14,13,12,12,11,12,13,13,13,14,14,17,15,16,13,15,14,17,15,15,11,13,13,13,13,12,12,13,13,13,15,17,17,16,14,24,16,10,13,12,11,11,11,12,10,10,13,12,13,13,13,14,15,13,15,19,16,14,11,13,12,10,14,12,11,12,10,14,12,12,12,14,12,17,23,20,18,18,17,16,14,13,16,16,13,19,19,18,17,28,16,17,17,17,14,16,17,16,15,16,11,13,10,10,10,14,9,16,11,9,9,9,9,8,9,8,9,8,9,9,9,7,7,7,6,7,6,7,6,8,7,7,6,6,6,6,6,7,6,6,18,7,8,6,7,5,6,5,6,6,6,8,6,7,8,10,10,10,9,10,9,9,9,8,9,9,10,8,11,10,9,17,12,8,10,9,9,9,9,9,10,12,9,12,11,15,13,12,13,12,12,14,14,11,15,13,13,13,12,12,11,13,11,12,8,9,7,5,10,9,11,11,11,10,10,11,10,9,14,8,9,13,8,8,7,7,8,7,9,8,8,7,8,8,7,7,9,7,8,7,8,9,8,8,8,7,5,9,5,10,11,5,5,9,4,10,13,11,12,15,12,16,13,13,14,14,15,14,15,15,13,19,13,13,12,12,13,13,14,9,11,12,11,11,11,10,10,12,11,10,10,12,10,15,10,11,10,10,11,10,11,10,10,12,11,11,10,10,10,8,9,9,9,8,8,8,9,8,9,14,8,12,9,9,9,9,8,10,10,10,9,10,10,10,9,9,8,9,9,7,8,10,11,8,8,9,16,12,9,8,9,9,12,10,9,8,9,7,7,8,7,7,8,7,7,7,8,6,5,6,6,6,9,12,11,13,18,10,11,10,8,9,9,9,8,9,8,9,8,9,8,7,6,6,6,7,7,8,6,6,6,6,6,7,6,5,6,7,5,14,9,7,7,5,7,7,10,11,11,11,12,13,13,12,13,13,12,11,11,11,12,16,23,17,17,15,11,14,13,15,13,13,10,10,9,8,8,11,8,10,9,8,9,9,9,16,10,8,10,9,10,9,11,12,10,10,11,13,12,12,13,12,15,12,9,6,6,3,8,4,8,12,5,4,8,3,7,10,14,15,13,14,12,14,14,10,12,12,12,11,13,14,12,11,19,13,10,9,10,10,10,10,14,10,10,10,11,9,10,10,9,10,8,9,8,10,8,8,10,16,11,9,9,8,8,10,9,7,8,8,8,8,8,8,7,8,8,7,8,7,8,8,7,9,8,7,8,8,7,8,17,7,10,6,11,8,9,6,5,4,7,4,8,4,8,3,10,9,7,7,7,7,7,6,7,8,7,6,7,8,6,7,7,6,6,8,15,7,7,7,8,7,6,7,6,6,6,6,6,6,6,7,6,8,7,6,6,7,6,6,4,9,3,8,4,5,8,3,8,4,9,4,10,12,18,14,13,15,17,16,17,17,16,16,18,17,18,20,18,23,17,18,17,17,20,18,17,19,20,19,19,19,20,21,19,16,17,16,18,19,18,19,19,18,22,18,19,21,22,19,21,20,21,19,23,21,21,19,20,27,21,21,20,21,23,21,21,19,21,21,19,27,20,20,17,17,17,17,17,18,22,17,18,17,19,29,17,18,18,19,20,19,22,18,17,18,19,18,25,20,19,19,21,20,19,16,17,16,19,20,17,18,20", "test_run_times": [ 44.4200000000000017053025658242404460906982421875, 42.10000000000000142108547152020037174224853515625, 42.60000000000000142108547152020037174224853515625 ] }, "Baseline": { "value": "5,25,18,10,8,7,8,7,9,8,8,7,8,16,9,7,6,7,7,9,8,7,8,9,7,8,7,7,8,6,7,8,7,7,7,8,9,9,9,14,14,15,22,18,19,21,22,21,20,19,17,18,17,16,16,16,26,18,14,19,18,17,17,16,15,17,17,17,17,16,15,22,22,18,16,18,21,16,17,17,18,17,16,15,15,14,18,15,17,17,15,15,16,18,19,15,19,17,16,13,15,22,19,14,24,20,15,16,16,18,14,13,13,14,11,14,15,21,15,14,15,15,15,13,12,14,10,13,16,12,12,11,13,10,16,12,18,19,15,13,16,13,12,11,14,10,14,13,13,15,16,13,14,13,20,14,13,14,13,13,12,12,15,14,16,15,16,16,16,15,15,22,14,16,14,17,15,17,16,16,18,15,16,15,17,13,16,23,18,16,18,16,19,19,19,19,17,16,16,17,16,18,21,15,18,17,16,18,18,19,16,17,15,17,16,17,16,24,18,15,15,18,17,15,20,18,20,18,22,19,21,19,17,16,17,15,18,20,16,13,14,12,14,10,11,10,10,11,6,11,12,11,11,10,11,10,9,13,10,11,10,11,10,10,13,12,11,11,10,10,10,12,8,19,9,10,10,11,9,10,9,8,10,10,11,9,10,10,9,9,11,9,9,8,9,7,8,8,8,7,5,16,5,8,3,5,6,5,8,8,9,9,10,9,10,13,11,10,9,9,11,9,11,11,11,9,10,9,10,17,15,9,12,10,10,10,7,5,9,12,15,11,13,10,12,12,13,14,12,11,13,21,13,13,11,13,13,10,12,12,11,12,13,12,15,12,11,11,12,9,11,10,19,11,11,10,10,10,9,9,9,10,9,12,10,11,8,8,8,7,8,6,9,7,8,8,7,7,7,6,8,16,8,9,8,7,7,8,8,8,9,8,7,8,8,9,8,8,8,7,8,8,9,9,8,9,9,8,8,10,8,8,15,8,10,8,8,8,8,7,8,8,8,8,11,10,11,11,11,10,11,10,11,13,12,11,10,10,15,12,8,11,10,10,10,9,8,8,8,7,8,8,11,8,9,8,8,8,9,8,9,8,9,10,8,8,15,10,8,8,7,7,9,8,9,8,8,8,9,10,11,12,13,12,12,9,10,11,14,12,13,18,18,12,12,13,10,12,14,11,13,13,12,13,13,12,12,12,11,12,9,9,16,10,7,7,8,7,9,7,7,6,6,6,7,7,6,6,7,5,6,5,7,6,6,5,5,4,5,6,6,8,7,9,10,10,10,18,15,11,11,11,12,11,9,10,10,11,10,12,13,11,12,10,11,10,12,11,16,22,13,11,13,6,10,13,9,11,10,11,9,12,8,9,9,8,8,9,9,12,9,8,8,8,8,14,8,9,8,9,8,8,7,7,8,7,9,8,9,8,10,7,7,8,4,8,4,9,4,5,9,2,8,7,10,4,8,4,8,10,9,3,9,3,7,4,9,4,11,5,5,10,3,8,3,11,3,9,5,9,2,8,3,9,5,8,3,7,4,11,4,10,2,8,4,9,4,10,4,17,11,9,8,9,7,8,8,10,6,6,7,5,10,4,5,5,8,4,8,2,8,4,9,3,9,3,8,3,7,3,8,3,7,3,7,3,7,3,16,5,4,7,3,8,2,7,4,7,2,7,3,7,2,7,3,6,3,8,4,4,5,5,9,5,10,4,10,5,10,4,4,4,9,6,5,5,9,5,12,4,10,8,10,8,11,9,11,10,9,10,10,12,11,10,11,11,14,12,11,9,4,10,4,10,5,6,9,6,4,16,5,11,6,6,11,17,13,10,8,8,9,8,8,7,8,7,7,7,8,8,7,9,12,9,9,8,8,9,15,10,8,9,9,9,8,9,7,8,9,6,7,7,9,8,6,7,7,10,4,11,4,8,9,9,7,7,7,7,7,6,14,7,7,6,7,9,14,13,9,8,7,3,7,3,7,3,8,3,7,2,8,2,8,3,7,3,7,3,9,3,8,3,8,3,7,2,8,3,8,6,5,14,4,7,3,8,4,11,3,5,5,8,3,8,4,6,10,5,5,9,4,8,5,8,3,9,3,10,4,5,7,4,9,3,10,3,9,5,9,4,9,4,15,8,7,7,7,8,8,9,9,11,10,11,13,11,11,11,12,11,9,12,11,11,11,11,11,15,13,11,11,12,9,11,9,9,9,8,10,10,10,10,9,9,10,8,7,6,7,8,8,7,8,7,15,9,9,9,11,11,14,11,12,13,11,11,10,11,9,10,10,8,8,9,9,10,9,9,9,18,11,8,11,10,9,9,10,11,10,10,9,9,8,9,9,12,8,10,9,13,9,9,10,9,10,17,9,10,10,8,9,9,9,7,6,6,6,9,9,11,10,12,12,9,10,9,10,10,10,10,10,10,18,11,10,11,9,9,9,9,8,9,9,9,9,8,9,8,8,9,8,9,7,9,7,9,8,8,8,8,7,18,9,8,8,8,9,9,10,10,11,10,11,10,10,11,9,10,11,11,10,11,11,9,12,11,18,13,9,10,11,11,12,11,11,12,11,11,10,9,11,11,9,9,8,9,9,8,9,15,16,13,11,13,11,11,11,13,10,11,10,10,12,9,11,10,12,11,12,17,13,21,14,16,17,20,18,16,16,17,16,20,20,20,21,27,19,17,17,14,15,15,13,13,13,14,10,9,8,8,8,7,9,8,7,8,9,18,11,8,8,8,9,8,12,8,8,8,8,8,8,9,8,8,8,9,9,8,8,8,7,8,7,7,8,7,8,16,10,7,7,8,7,8,7,7,9,7,7,7,6,7,7,6,6,7,8,7,6,6,7,6,6,7,6,5,9,4,11,4,5,9,9,16,15,12,13,14,16,19,17,17,18,17,16,18,14,17,29,22,18,18,17,19,21,20,20,21,17,19,17,16,20,20,20,18,19,18,19,19,21,20,20,18,14,26,19,18,15,13,15,13,20,16,13,14,15,14,15,13,14,14,19,13,20,16,15,17,17,17,17,17,18,18,19,17,17,20,15,17,17,17,18,18,16,15,16,16,20,19,18,27,19,19,22,20,18,18,18,19,19,16,16,17,14,28,16,16,15,13,20,15,13,14,18,15,15,16,12,14,13,16,17,16,17,17,15,15,15,13,9,5,12,6,12,11,11,10,11,12,9,9,10,21,16,11,13,13,13,13,13,12,12,14,12,12,13,10,12,12,12,16,21,17,15,12,13,15,12,12,12,13,10,11,11,9,12,12,11,10,11,10,13,15,12,10,12,11,11,10,9,10,10,10,11,8,9,9,10,9,10,10,10,10,8,9,11,10,16,9,9,8,10,8,10,9,12,11,10,12,12,13,12,13,10,12,12,11,13,11,13,16,15,16,13,18,18,12,9,5,9,5,11,5,5,9,4,9,6,5,10,5,9,4,9,4,9,8,9,15,8,9,9,6,7,7,9,7,6,7,6,6,7,6,7,6,7,6,4,6,9,4,9,3,7,10,12,16,21,26,14,11,10,9,10,12,11,13,15,13,12,11,13,17,23,14,19,16,19,17,15,12,14,15,13,14,15,16,15,15,14,14,16,14,16,20,16,16,14,18,17,14,15,17,17,16,14,12,14,14,14,22,12,14,14,14,12,13,12,13,12,13,12,12,12,13,11,13,11,14,16,19,14,12,13,11,12,13,12,13,11,9,9,9,10,9,8,9,9,10,11,13,10,11,17,14,13,13,14,17,15,13,12,14,15,12,14,13,13,12,12,12,10,15,6,6,5,4,7,10,10,11,12,12,12,10,10,11,10,10,9,11,12,14,13,10,11,12,19,14,10,10,12,10,9,10,11,10,9,10,10,15,11,10,10,9,13,15,10,10,11,18,14,8,10,7,10,11,10,12,10,12,10,11,11,13,6,10,9,11,6,9,9,12,16,21,15,16,15,15,18,17,15,16,18,17,17,18,16,17,28,21,17,16,16,14,7,3,7,5,8,6,5,13,14,15,13,15,12,12,13,20,17,12,14,14,14,14,13,15,14,11,13,10,11,10,13,12,12,10,12,18,9,11,10,9,11,11,11,10,11,12,10,10,10,10,10,10,10,10,8,7,8,9,9,8,16,11,12,10,6,6,6,5,5,6,6,7,8,7,8,10,8,7,8,7,7,8,8,8,8,7,8,9,11,11,12,18,12,11,10,8,10,8,9,9,9,8,9,10,9,10,10,9,9,9,8,9,8,8,7,8,7,8,9,15,9,7,7,8,7,6,7,6,7,9,7,3,9,11,12,13,16,13,11,11,12,10,10,9,9,9,8,15,8,9,4,10,7,7,9,7,7,6,7,6,6,6,6,7,7,7,9,7,8,8,8,9,10,12,12,10,10,10,18,15,9,11,11,10,11,10,10,10,11,11,12,14,14,12,12,7,14,5,10,8,10,18,20,15,16,14,16,14,15,15,16,17,13,13,12,12,12,12,14,19,10,11,13,14,13,17,15,15,16,12,12,11,15,15,12,15,12,13,19,11,11,9,10,10,10,10,10,10,10,11,11,11,10,10,11,14,10,14,11,15,26,20,15,15,16,13,18,15,13,19,17,17,12,15,15,16,23,18,13,15,14,12,12,9,10,10,8,9,8,9,8,9,9,7,8,8,7,7,6,6,7,6,8,18,8,7,7,6,6,7,7,8,9,9,10,8,9,9,13,10,14,12,11,11,12,11,11,11,15,17,15,13,13,14,13,14,14,14,15,17,17,21,20,20,19,17,16,15,11,15,12,14,13,12,13,14,13,11,15,10,11,12,12,12,10,16,12,10,11,11,9,9,10,10,9,10,10,9,9,9,10,10,10,9,11,11,9,13,11,10,16,12,10,9,10,10,9,9,10,8,8,8,9,9,7,5,10,8,9,8,8,4,9,4,10,9,10,8,7,16,10,8,10,8,9,8,8,9,8,9,8,8,8,8,8,7,8,8,8,8,8,10,11,9,10,7,9,8,8,15,10,8,8,6,10,7,11,13,12,4,9,6,11,6,7,11,6,6,9,5,5,10,3,10,5,8,8,8,9,10,17,13,8,12,10,10,8,9,10,10,10,11,11,10,11,13,9,12,9,12,9,11,9,10,19,14,8,11,11,11,9,9,9,10,10,10,10,9,10,9,10,9,8,9,11,8,9,10,8,8,16,8,7,7,7,7,8,6,6,6,6,6,6,6,6,6,6,8,8,6,7,5,6,6,6,6,7,5,5,5,6,8,6,6,6,7,6,8,7,14,7,6,9,6,7,8,7,7,7,8,7,7,7,8,8,7,9,11,8,8,8,9,8,8,7,8,8,8,8,8,8,16,8,8,8,8,10,8,8,8,7,7,9,9,8,8,8,9,10,8,9,8,7,8,8,8,16,16,25,12,15,18,14,17,17,14,18,18,16,16,16,16,16,16,24,16,17,19,15,16,18,18,14,20,23,22,19,20,19,19,23,21,22,20,20,22,19,19,19,21,29,22,20,20,21,20,23,19,23,20,20,22,30,21,20,19,20,19,21,23,19,20,18,15,11,11,19,11,9,9,8,9,7,9,8,7,7,8,10,9,10,8,10,8,9,9,9,7,10,8,9,9,10,12,23,13,10,10,11,11,11,11,9,10,8,11,10,10,9,9,10,10,8,9,9,9,9,7,8,5,9,19,21,20,20,21,21,19,19,20,19,19,19,17,20,19,20,18,17,16,17,17,18,17,16,20,20,21,21,16,18,16,18,16,14,13,10,13,16,20,17,17,15,17,22,17,17,15,15,17,17,16,14,14,14,13,13,12,12,12,11,19,12,10,12,13,14,13,13,13,15,14,8,8,8,8,7,8,8,8,8,8,9,10,11,16,10,9,11,10,9,9,8,8,9,7,8,10,10,10,12,11,11,9,11,11,12,8,7,7,8,8,15,8,8,8,7,7,8,8,8,10,8,7,8,8,7,8,8,8,8,10,11,12,12,13,14,14,12,19,13,12,12,11,11,12,15,15,12,14,14,15,14,13,21,14,17,22,17,17,16,12,15,10,12,13,12,16,13,15,13,16,17,15,24,17,13,12,14,12,15,9,12,11,11,10,12,12,11,13,12,12,13,12,11,19,12,13,13,11,9,11,11,11,12,11,10,11,12,12,10,11,14,14,14,13,17,14,13,17,18,16,15,16,16,15,14,14,15,15,17,17,24,15,15,16,12,15,15,14,14,11,11,11,11,9,11,10,9,10,9,10,9,10,15,10,8,10,8,9,8,7,7,8,7,8,7,7,6,7,8,7,7,7,7,8,7,6,6,6,6,6,5,6,5,6,5,5,6,7,14,7,9,9,9,10,10,8,9,9,8,8,8,9,11,8,10,10,8,10,8,10,10,8,9,9,8,12,18,12,10,9,11,14,13,13,12,13,12,15,14,13,11,12,14,10,13,12,19,12,13,14,10,9,10,5,11,12,8,11,9,10,9,10,10,9,9,9,12,12,10,9,7,15,8,7,8,7,8,8,7,8,8,8,7,9,8,8,7,8,9,8,8,8,7,5,9,4,9,4,11,6,11,5,10,19,11,13,13,16,15,15,14,14,13,16,14,15,14,12,15,10,12,21,14,14,10,11,12,12,12,9,11,11,11,12,11,11,10,10,14,10,10,9,11,9,16,16,11,13,10,10,10,11,11,10,9,10,9,10,9,8,8,9,9,8,9,8,8,9,11,15,10,9,8,9,9,8,9,10,9,9,8,8,7,7,9,8,8,8,7,8,8,9,8,8,8,8,9,8,7,16,11,9,8,7,7,7,8,7,8,9,7,7,7,8,6,6,5,6,5,9,14,16,13,11,11,9,9,9,16,9,8,9,8,7,8,8,8,7,7,6,6,6,6,5,6,6,7,6,6,7,8,6,6,7,7,7,7,6,7,6,7,6,6,9,16,17,9,12,14,11,12,13,12,12,12,12,12,12,14,15,17,11,15,21,16,15,15,14,15,11,10,9,9,10,11,9,10,9,10,9,13,8,8,10,10,10,18,10,9,9,9,10,11,10,12,12,12,11,14,9,12,10,6,7,3,8,4,8,3,9,3,9,4,8,10,18,12,15,12,13,12,12,11,12,13,11,10,12,12,12,12,12,11,10,11,9,17,11,10,14,10,10,10,10,8,10,10,9,9,9,10,9,9,8,8,8,9,8,8,7,8,8,10,19,11,8,7,8,7,8,7,8,8,8,8,7,8,8,7,8,8,7,9,7,8,7,8,8,5,11,4,12,8,10,6,14,4,9,3,5,8,2,8,4,9,7,6,6,7,7,7,7,7,7,9,6,6,7,8,7,7,7,6,6,6,7,7,7,7,6,7,7,14,6,7,7,6,7,6,7,9,7,6,7,6,7,8,5,8,3,8,4,5,9,3,9,4,9,5,9,11,14,15,13,15,20,20,23,17,18,16,16,16,18,18,17,16,16,18,30,22,19,24,20,16,17,18,19,18,20,16,18,25,17,17,20,19,17,20,20,20,23,20,20,18,29,20,19,21,20,20,19,18,18,21,21,18,20,29,22,19,17,20,21,21,21,19,19,19,22,29,25,19,18,20,21,18,18,20,20,20,18,20,27,21,20,19,20,19,22,16,17,20,20,19,18,25,19,16,18,21,19,18,18,19,20,20,15,19,27", "test_run_times": [ 43.1400000000000005684341886080801486968994140625, 42.36999999999999744204615126363933086395263671875, 42.6700000000000017053025658242404460906982421875 ] }, "Navi2-virgl-async-comannd-stream": { "value": "1,7,6,3,3,2,3,2,3,2,3,2,3,2,2,3,2,2,3,3,2,2,2,2,2,3,3,2,3,2,3,2,2,5,2,3,2,3,3,4,4,5,4,5,5,5,6,5,5,5,6,5,5,5,5,5,5,5,5,6,5,6,5,5,5,6,5,6,5,5,6,5,6,5,5,6,5,5,5,6,5,5,5,5,6,5,4,5,5,5,5,4,5,5,5,4,6,4,5,5,4,5,5,5,5,5,5,5,5,5,4,4,4,5,4,4,5,4,5,4,4,4,5,4,5,4,4,4,5,3,4,5,4,4,4,3,5,4,4,7,5,4,4,5,4,5,4,5,5,4,5,5,5,5,5,4,5,5,4,4,4,5,5,5,5,6,5,5,5,5,5,5,5,5,5,5,5,4,5,5,5,4,5,5,6,4,6,5,5,5,6,6,6,5,5,5,4,5,5,5,5,5,5,5,5,5,5,5,5,5,6,5,5,5,5,5,5,5,5,5,5,5,5,5,6,5,5,5,6,4,6,5,5,5,5,5,5,5,5,4,4,5,4,4,4,3,2,3,3,3,3,4,3,4,3,4,4,4,3,4,3,4,4,3,4,4,3,4,3,4,3,3,4,3,3,3,3,4,4,3,3,3,4,2,4,4,3,3,3,4,3,3,3,2,3,2,3,3,2,3,2,3,2,2,2,3,3,2,3,3,3,3,3,3,4,4,3,3,3,5,3,3,3,4,3,4,3,4,3,3,4,4,4,3,4,3,3,2,3,4,5,3,4,3,4,3,4,4,4,4,4,5,3,4,4,4,4,3,4,3,5,3,3,4,4,3,3,4,4,3,3,4,3,4,3,3,4,3,3,3,3,3,3,3,3,3,2,2,3,2,2,2,2,2,4,3,2,3,2,2,2,2,2,2,3,2,2,3,2,2,2,2,3,2,2,3,2,3,3,2,3,2,2,3,2,3,2,3,2,2,3,2,2,2,3,2,3,2,3,2,2,3,2,3,3,3,3,3,3,3,4,3,3,4,3,4,3,3,4,3,3,3,3,3,3,3,2,3,2,3,2,3,3,3,2,3,3,2,3,3,3,2,2,3,3,3,2,4,4,3,3,2,3,2,3,2,2,3,3,3,4,3,4,3,4,3,3,3,4,4,4,4,5,4,3,5,3,4,5,4,4,4,4,4,4,4,4,4,4,3,3,3,2,3,2,2,2,2,2,2,2,1,2,2,2,2,1,2,2,2,2,1,2,1,2,1,2,1,2,1,2,2,2,3,3,3,3,4,4,3,4,3,3,4,3,3,5,3,3,4,3,4,3,4,3,4,3,4,4,3,4,4,3,4,3,4,3,3,3,3,3,3,3,2,3,2,2,2,3,2,2,3,2,2,2,2,2,2,3,2,2,2,2,2,2,2,3,2,2,2,2,2,2,2,2,2,2,2,2,1,2,2,2,2,2,1,2,12,1,11,1,11,1,11,1,11,1,11,1,12,1,12,1,3,1,2,2,2,2,2,2,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,12,1,12,2,3,2,3,2,2,2,3,2,2,2,2,2,2,2,1,2,2,1,2,1,2,1,2,1,2,1,2,1,2,1,2,1,2,1,2,1,2,1,1,2,1,2,1,2,2,1,2,3,2,1,2,1,1,2,1,2,1,2,2,2,3,2,2,2,2,2,2,2,2,2,2,3,2,2,3,2,2,3,2,2,3,2,2,3,3,3,3,3,3,3,3,3,2,4,3,4,3,3,3,3,2,3,2,2,3,3,2,2,2,2,2,2,3,3,5,4,3,3,2,2,3,2,2,2,2,2,2,3,2,2,3,3,2,2,2,3,2,3,2,3,2,3,2,2,3,2,2,3,2,2,2,5,2,3,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,1,2,2,4,4,3,1,12,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,1,11,2,2,1,12,1,11,1,11,1,11,1,11,1,11,1,11,1,12,1,12,1,12,1,11,1,11,1,12,1,12,1,12,1,12,1,11,1,12,1,11,1,11,1,3,2,2,2,4,3,2,3,3,4,3,3,3,4,3,3,4,3,3,4,2,3,4,3,3,3,3,3,3,3,3,3,3,3,3,2,3,3,3,2,3,3,3,3,2,2,2,2,2,2,2,2,2,2,3,3,3,4,4,3,4,4,3,3,4,3,3,3,3,3,3,3,3,3,3,3,2,3,3,3,3,3,3,3,3,3,3,3,3,5,2,3,3,3,3,3,3,3,4,3,3,3,3,3,3,3,3,2,3,3,2,2,2,2,2,2,3,3,3,4,3,3,3,3,3,3,2,3,4,3,3,3,3,3,3,2,3,2,3,2,2,3,2,3,3,2,2,3,2,2,2,3,2,3,2,2,2,3,2,2,2,3,3,2,3,3,2,3,3,3,3,3,3,3,3,3,3,4,3,3,5,3,3,3,3,3,3,4,3,3,3,3,4,3,4,3,3,3,2,2,2,3,2,3,2,3,3,3,4,3,3,4,3,3,3,3,3,3,3,2,3,4,3,3,3,3,4,4,4,5,5,5,5,4,5,5,5,5,5,5,5,5,4,5,5,5,5,4,5,6,5,4,3,4,3,3,2,3,2,2,3,2,2,2,2,3,2,2,3,2,3,2,2,2,3,2,3,2,3,2,3,2,2,2,3,2,3,2,2,3,2,2,2,2,2,2,3,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,1,2,2,2,1,2,2,1,2,2,2,2,2,2,2,2,2,2,3,3,3,4,4,4,5,5,4,5,5,5,4,5,5,7,5,6,5,5,5,5,5,5,6,5,5,6,5,6,5,5,6,5,5,6,5,5,6,5,5,6,4,5,5,5,4,4,4,5,4,5,4,5,4,4,5,4,5,4,5,4,5,5,5,5,6,4,5,5,6,5,5,5,5,5,5,5,5,5,5,6,5,5,5,4,5,5,5,5,5,5,6,5,5,5,5,5,5,4,5,4,5,4,5,5,4,4,5,4,5,4,5,5,4,4,4,7,4,5,4,4,5,4,5,4,4,4,3,2,3,2,3,3,3,3,2,3,3,2,3,4,4,3,4,4,4,3,4,4,3,4,4,3,4,4,3,4,4,3,5,3,4,4,3,4,3,4,3,3,4,3,3,3,4,3,3,4,3,3,4,3,4,3,3,3,3,4,3,4,3,3,3,3,2,3,2,3,3,3,3,3,3,2,3,3,2,3,2,3,2,3,2,3,3,3,4,3,4,3,3,4,3,3,4,3,3,3,2,3,3,3,4,5,4,4,2,2,3,2,2,2,2,2,2,2,2,2,3,2,2,2,2,2,2,2,3,2,2,3,2,2,2,2,2,2,2,1,1,2,2,2,2,1,2,2,2,2,1,2,2,2,2,3,4,4,8,4,4,3,3,3,3,3,4,3,4,4,3,4,5,5,5,5,5,5,5,4,4,5,4,4,4,5,4,5,4,4,4,4,5,4,5,4,5,5,5,5,5,5,4,5,5,5,5,4,4,4,4,5,4,4,4,4,4,5,4,4,3,4,4,4,3,3,3,4,3,4,4,3,4,3,4,4,4,3,4,3,4,2,3,2,3,2,3,2,2,3,3,3,4,3,3,3,4,4,4,4,4,4,4,4,4,4,5,4,4,4,4,3,3,2,2,3,1,2,3,3,4,3,3,4,3,3,3,3,3,3,3,3,5,3,4,3,3,4,3,3,4,2,2,3,3,3,3,3,2,3,3,3,3,4,2,3,3,3,3,3,3,3,3,3,3,3,3,3,3,4,3,3,4,3,4,3,3,3,2,3,3,3,3,4,4,4,4,5,5,4,5,4,5,5,5,4,5,5,4,5,4,5,5,6,5,4,2,2,1,3,2,3,1,4,4,4,5,3,4,4,3,3,5,3,5,4,4,4,4,5,4,4,3,3,4,3,3,3,4,3,3,4,3,3,3,3,3,3,3,3,3,3,3,3,3,3,2,3,3,3,3,2,2,3,2,3,2,3,2,2,2,2,2,1,2,2,1,2,3,2,2,3,3,2,3,2,2,2,5,2,2,2,3,2,3,3,3,4,3,3,2,3,2,2,2,3,2,3,2,3,2,2,2,3,3,2,3,2,2,3,2,2,2,2,3,2,2,2,2,2,2,1,2,1,2,1,2,2,3,3,4,3,4,3,4,3,4,4,3,3,3,2,3,2,2,3,1,2,2,2,2,2,2,1,2,2,1,2,2,1,2,2,2,2,2,3,2,2,3,3,3,3,3,3,3,3,2,3,3,3,4,3,3,3,3,3,3,4,3,4,3,2,3,3,2,2,3,2,3,5,4,5,4,5,4,4,5,4,4,4,4,3,4,4,3,4,3,3,3,4,4,4,5,4,4,4,3,4,3,4,4,4,4,4,3,4,3,3,3,3,3,3,3,3,3,4,3,3,3,4,3,3,5,4,4,3,4,4,5,4,5,4,4,5,4,5,4,5,4,5,4,5,4,5,4,5,5,4,3,3,3,2,3,2,3,2,3,2,2,2,2,3,2,2,2,2,2,2,2,2,2,2,1,2,2,2,3,2,2,3,2,2,3,2,3,4,3,4,3,3,3,4,3,3,4,4,4,3,4,4,5,4,4,5,4,5,5,4,5,5,5,5,4,4,4,4,4,4,4,4,4,4,4,4,3,4,3,4,3,4,3,4,3,3,3,3,4,2,3,3,3,3,3,2,3,3,3,3,3,3,3,3,3,3,3,3,3,3,2,3,3,3,2,3,3,3,2,2,3,2,2,3,2,3,5,2,3,2,2,1,3,2,2,2,2,3,2,3,3,3,2,2,2,2,3,2,3,3,2,3,2,2,3,2,3,3,2,2,3,3,3,2,3,2,2,3,2,3,2,2,3,2,3,3,2,2,3,2,2,3,2,2,2,3,2,2,2,2,2,2,2,2,2,2,2,2,3,3,3,3,4,2,3,3,3,3,3,4,3,3,4,3,3,3,3,4,3,3,3,4,3,3,4,3,3,3,3,3,3,3,2,3,3,2,3,2,3,2,3,3,2,3,3,2,3,2,2,2,2,2,2,2,3,1,2,2,2,2,2,1,2,2,2,2,2,2,2,2,2,2,2,1,2,2,2,2,1,3,2,2,2,2,2,3,2,2,2,1,2,2,2,2,2,2,2,2,3,2,2,2,2,2,2,3,2,2,2,3,2,3,2,2,3,2,3,2,2,3,2,2,3,2,3,3,2,3,2,3,2,2,2,2,5,2,3,2,2,3,2,2,2,2,4,5,4,5,4,5,4,5,4,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,7,5,6,6,6,6,5,6,6,6,6,5,6,6,5,6,6,6,6,5,6,5,5,6,5,5,7,5,5,6,6,6,5,6,6,5,6,6,5,4,4,3,3,3,2,3,3,2,2,2,2,2,2,3,2,3,3,3,3,3,2,2,2,2,3,2,3,3,3,3,3,2,3,3,3,3,3,3,2,3,3,3,2,3,4,2,3,3,3,2,3,2,3,2,2,3,2,5,5,6,5,5,6,5,5,6,5,6,5,5,5,5,5,6,5,5,6,5,6,5,6,5,5,6,5,6,5,5,5,5,4,3,3,3,5,5,5,5,4,5,6,5,4,5,4,4,5,4,4,4,4,4,4,4,4,3,4,3,3,3,4,3,4,4,4,4,3,4,3,2,2,3,2,2,2,3,2,2,3,3,3,3,3,2,2,3,2,3,2,3,2,2,2,3,3,3,3,4,3,3,4,3,3,3,2,2,3,2,2,2,2,2,2,2,2,2,3,2,2,2,3,2,2,2,4,2,3,3,3,4,4,4,4,4,4,5,4,3,4,4,3,4,4,3,4,4,4,5,4,4,5,5,4,5,4,4,4,5,4,4,3,4,4,4,4,4,4,5,4,4,4,4,4,4,3,4,3,3,3,4,3,4,3,3,4,4,4,4,4,6,4,4,4,4,3,4,4,4,4,3,4,3,4,4,3,4,4,4,4,4,5,4,4,5,4,4,5,5,4,5,4,5,5,5,4,5,5,4,5,4,5,4,5,4,5,4,3,4,3,3,3,3,3,3,3,3,2,3,3,2,2,2,3,2,3,5,2,3,2,2,2,2,1,2,2,1,2,2,2,1,2,2,2,1,2,2,2,1,2,2,1,2,1,1,1,2,2,2,2,2,3,3,3,3,3,2,3,2,3,2,3,3,3,2,2,3,3,2,3,2,3,2,3,2,3,3,3,2,4,4,4,3,4,4,3,4,4,3,4,4,3,4,3,3,4,3,4,4,2,3,3,2,3,3,3,3,3,3,3,3,3,3,4,3,3,3,3,3,2,3,2,2,2,2,3,2,3,2,3,2,2,3,2,2,3,2,3,3,2,3,2,2,3,2,2,3,2,2,3,2,3,3,3,4,4,4,4,4,5,4,5,5,4,4,4,4,4,3,3,4,4,4,4,4,3,4,3,4,3,3,4,3,4,3,3,4,3,3,3,4,3,3,6,3,4,3,4,3,3,3,3,2,3,3,3,3,2,3,2,3,3,2,2,3,2,3,3,3,3,3,2,3,3,3,2,3,3,3,2,3,3,2,3,2,3,2,2,3,2,3,2,3,2,3,3,2,3,3,3,2,3,2,2,2,2,3,2,2,2,2,2,1,2,2,1,2,1,3,3,4,4,3,4,3,2,3,2,3,2,3,2,3,2,3,2,2,2,2,2,4,1,2,2,2,1,2,2,2,1,2,2,2,2,1,2,2,1,2,2,2,2,2,4,3,4,3,4,4,3,4,4,4,3,4,4,4,4,5,5,4,4,4,5,4,5,4,4,3,3,3,3,2,4,3,2,3,3,3,3,2,3,3,3,3,3,3,3,3,3,3,3,3,4,4,4,3,4,4,3,3,2,2,2,2,3,2,2,1,2,2,1,2,3,4,4,5,4,4,3,4,3,4,4,3,4,4,4,3,4,4,3,4,3,3,3,3,2,4,3,3,2,3,2,4,3,2,4,2,3,3,3,2,3,2,3,2,2,3,2,2,3,2,3,2,2,2,2,3,2,2,3,2,2,3,1,3,2,2,2,2,2,3,2,2,2,3,2,2,2,2,3,3,2,2,2,2,2,2,3,2,2,1,3,2,2,2,3,2,2,2,2,2,2,2,2,2,1,2,2,2,1,1,2,2,1,2,2,2,2,2,2,1,2,2,1,2,1,2,2,1,2,2,1,2,2,2,1,2,2,2,2,2,2,2,2,2,2,3,4,4,4,5,4,5,6,5,5,5,6,5,5,6,6,5,6,5,5,6,5,5,6,5,5,6,7,5,6,5,5,5,6,5,5,5,6,6,5,6,6,6,6,5,6,6,5,6,6,6,5,6,6,5,6,6,5,6,5,6,5,6,6,5,6,6,5,6,6,6,5,7,6,5,6,5,6,6,5,6,5,6,5,6,5,6,5,6,5,6,5,6,5,5,6,5,5,6,5,5,5,5,6,5,5,5,6,6,5,5", "test_run_times": [ 13.3699999999999992184029906638897955417633056640625, 13.5600000000000004973799150320701301097869873046875, 13.71000000000000085265128291212022304534912109375 ] } } }, "48f663b92c209b1511cbd1687c71c82e95db467d": { "identifier": "pts\/openarena-1.5.5", "title": "OpenArena", "app_version": "0.8.8", "arguments": "+set r_customWidth 1024 +set r_customHeight 768 +set r_fullscreen 0", "description": "Resolution: 1024 x 768", "scale": "Frames Per Second", "proportion": "HIB", "display_format": "BAR_GRAPH", "results": { "Micro optimizations applied": { "value": 89.2999999999999971578290569595992565155029296875, "raw_values": [ 87.7000000000000028421709430404007434844970703125, 90.599999999999994315658113919198513031005859375, 89.5 ], "min_result": [ "2" ], "test_run_times": [ 44.4200000000000017053025658242404460906982421875, 42.10000000000000142108547152020037174224853515625, 42.60000000000000142108547152020037174224853515625 ] }, "Baseline": { "value": 89.7000000000000028421709430404007434844970703125, "raw_values": [ 90, 89.900000000000005684341886080801486968994140625, 89.2000000000000028421709430404007434844970703125 ], "min_result": [ "2" ], "test_run_times": [ 43.1400000000000005684341886080801486968994140625, 42.36999999999999744204615126363933086395263671875, 42.6700000000000017053025658242404460906982421875 ] }, "Navi2-virgl-async-comannd-stream": { "value": 303.5, "raw_values": [ 309.19999999999998863131622783839702606201171875, 302.8999999999999772626324556767940521240234375, 298.5 ], "min_result": [ "1" ], "test_run_times": [ 13.3699999999999992184029906638897955417633056640625, 13.5600000000000004973799150320701301097869873046875, 13.71000000000000085265128291212022304534912109375 ] } } } } }