Collisionless Pattern Discovery in Robot Swarms Using Deep Reinforcement Learning Article Swipe
Nelson Sharma
,
A. Ghosh
,
Rajiv Misra
,
Supratik Mukhopadhyay
,
Gokarna Sharma
·
YOU?
·
· 2022
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2209.09865
YOU?
·
· 2022
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2209.09865
We present a deep reinforcement learning-based framework for automatically discovering patterns available in any given initial configuration of fat robot swarms. In particular, we model the problem of collision-less gathering and mutual visibility in fat robot swarms and discover patterns for solving them using our framework. We show that by shaping reward signals based on certain constraints like mutual visibility and safe proximity, the robots can discover collision-less trajectories leading to well-formed gathering and visibility patterns.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2209.09865
- https://arxiv.org/pdf/2209.09865
- OA Status
- green
- Cited By
- 1
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4296604245
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4296604245Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2209.09865Digital Object Identifier
- Title
-
Collisionless Pattern Discovery in Robot Swarms Using Deep Reinforcement LearningWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2022Year of publication
- Publication date
-
2022-09-20Full publication date if available
- Authors
-
Nelson Sharma, A. Ghosh, Rajiv Misra, Supratik Mukhopadhyay, Gokarna SharmaList of authors in order
- Landing page
-
https://arxiv.org/abs/2209.09865Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2209.09865Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2209.09865Direct OA link when available
- Concepts
-
Visibility, Reinforcement learning, Robot, Artificial intelligence, Computer science, Collision, Collision avoidance, Mobile robot, Robot learning, Geography, Computer security, MeteorologyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 1Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4296604245 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2209.09865 |
| ids.doi | https://doi.org/10.48550/arxiv.2209.09865 |
| ids.openalex | https://openalex.org/W4296604245 |
| fwci | |
| type | preprint |
| title | Collisionless Pattern Discovery in Robot Swarms Using Deep Reinforcement Learning |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12784 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.9890999794006348 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2210 |
| topics[0].subfield.display_name | Mechanical Engineering |
| topics[0].display_name | Modular Robots and Swarm Intelligence |
| topics[1].id | https://openalex.org/T10462 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9702000021934509 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Reinforcement Learning in Robotics |
| topics[2].id | https://openalex.org/T10249 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9666000008583069 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1705 |
| topics[2].subfield.display_name | Computer Networks and Communications |
| topics[2].display_name | Distributed Control Multi-Agent Systems |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C123403432 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8999726176261902 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q654068 |
| concepts[0].display_name | Visibility |
| concepts[1].id | https://openalex.org/C97541855 |
| concepts[1].level | 2 |
| concepts[1].score | 0.8780593276023865 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q830687 |
| concepts[1].display_name | Reinforcement learning |
| concepts[2].id | https://openalex.org/C90509273 |
| concepts[2].level | 2 |
| concepts[2].score | 0.7208462953567505 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q11012 |
| concepts[2].display_name | Robot |
| concepts[3].id | https://openalex.org/C154945302 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5968203544616699 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[3].display_name | Artificial intelligence |
| concepts[4].id | https://openalex.org/C41008148 |
| concepts[4].level | 0 |
| concepts[4].score | 0.5704054236412048 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[4].display_name | Computer science |
| concepts[5].id | https://openalex.org/C121704057 |
| concepts[5].level | 2 |
| concepts[5].score | 0.5073933005332947 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q352070 |
| concepts[5].display_name | Collision |
| concepts[6].id | https://openalex.org/C2780864053 |
| concepts[6].level | 3 |
| concepts[6].score | 0.49782896041870117 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q5147495 |
| concepts[6].display_name | Collision avoidance |
| concepts[7].id | https://openalex.org/C19966478 |
| concepts[7].level | 3 |
| concepts[7].score | 0.4482467770576477 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q4810574 |
| concepts[7].display_name | Mobile robot |
| concepts[8].id | https://openalex.org/C188888258 |
| concepts[8].level | 4 |
| concepts[8].score | 0.4165722727775574 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q7353390 |
| concepts[8].display_name | Robot learning |
| concepts[9].id | https://openalex.org/C205649164 |
| concepts[9].level | 0 |
| concepts[9].score | 0.1579296588897705 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q1071 |
| concepts[9].display_name | Geography |
| concepts[10].id | https://openalex.org/C38652104 |
| concepts[10].level | 1 |
| concepts[10].score | 0.05936893820762634 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q3510521 |
| concepts[10].display_name | Computer security |
| concepts[11].id | https://openalex.org/C153294291 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q25261 |
| concepts[11].display_name | Meteorology |
| keywords[0].id | https://openalex.org/keywords/visibility |
| keywords[0].score | 0.8999726176261902 |
| keywords[0].display_name | Visibility |
| keywords[1].id | https://openalex.org/keywords/reinforcement-learning |
| keywords[1].score | 0.8780593276023865 |
| keywords[1].display_name | Reinforcement learning |
| keywords[2].id | https://openalex.org/keywords/robot |
| keywords[2].score | 0.7208462953567505 |
| keywords[2].display_name | Robot |
| keywords[3].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[3].score | 0.5968203544616699 |
| keywords[3].display_name | Artificial intelligence |
| keywords[4].id | https://openalex.org/keywords/computer-science |
| keywords[4].score | 0.5704054236412048 |
| keywords[4].display_name | Computer science |
| keywords[5].id | https://openalex.org/keywords/collision |
| keywords[5].score | 0.5073933005332947 |
| keywords[5].display_name | Collision |
| keywords[6].id | https://openalex.org/keywords/collision-avoidance |
| keywords[6].score | 0.49782896041870117 |
| keywords[6].display_name | Collision avoidance |
| keywords[7].id | https://openalex.org/keywords/mobile-robot |
| keywords[7].score | 0.4482467770576477 |
| keywords[7].display_name | Mobile robot |
| keywords[8].id | https://openalex.org/keywords/robot-learning |
| keywords[8].score | 0.4165722727775574 |
| keywords[8].display_name | Robot learning |
| keywords[9].id | https://openalex.org/keywords/geography |
| keywords[9].score | 0.1579296588897705 |
| keywords[9].display_name | Geography |
| keywords[10].id | https://openalex.org/keywords/computer-security |
| keywords[10].score | 0.05936893820762634 |
| keywords[10].display_name | Computer security |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2209.09865 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2209.09865 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2209.09865 |
| locations[1].id | doi:10.48550/arxiv.2209.09865 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2209.09865 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5065031290 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-0138-9447 |
| authorships[0].author.display_name | Nelson Sharma |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Sharma, Nelson |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5066848113 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-4713-9854 |
| authorships[1].author.display_name | A. Ghosh |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Ghosh, Aswini |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5081123737 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-4910-5749 |
| authorships[2].author.display_name | Rajiv Misra |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Misra, Rajiv |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5061618260 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-7733-228X |
| authorships[3].author.display_name | Supratik Mukhopadhyay |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Mukhopadhyay, Supratik |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5002981812 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-4930-4609 |
| authorships[4].author.display_name | Gokarna Sharma |
| authorships[4].author_position | last |
| authorships[4].raw_author_name | Sharma, Gokarna |
| authorships[4].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2209.09865 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2022-09-23T00:00:00 |
| display_name | Collisionless Pattern Discovery in Robot Swarms Using Deep Reinforcement Learning |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12784 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.9890999794006348 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2210 |
| primary_topic.subfield.display_name | Mechanical Engineering |
| primary_topic.display_name | Modular Robots and Swarm Intelligence |
| related_works | https://openalex.org/W1819938260, https://openalex.org/W2340892746, https://openalex.org/W3005999311, https://openalex.org/W3042530408, https://openalex.org/W2930863966, https://openalex.org/W2126211886, https://openalex.org/W3153786280, https://openalex.org/W3127551068, https://openalex.org/W2165180011, https://openalex.org/W3165944253 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2209.09865 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2209.09865 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2209.09865 |
| primary_location.id | pmh:oai:arXiv.org:2209.09865 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2209.09865 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2209.09865 |
| publication_date | 2022-09-20 |
| publication_year | 2022 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 2 |
| abstract_inverted_index.In | 21 |
| abstract_inverted_index.We | 0, 46 |
| abstract_inverted_index.by | 49 |
| abstract_inverted_index.in | 12, 33 |
| abstract_inverted_index.of | 17, 27 |
| abstract_inverted_index.on | 54 |
| abstract_inverted_index.to | 70 |
| abstract_inverted_index.we | 23 |
| abstract_inverted_index.and | 30, 37, 60, 73 |
| abstract_inverted_index.any | 13 |
| abstract_inverted_index.can | 65 |
| abstract_inverted_index.fat | 18, 34 |
| abstract_inverted_index.for | 7, 40 |
| abstract_inverted_index.our | 44 |
| abstract_inverted_index.the | 25, 63 |
| abstract_inverted_index.deep | 3 |
| abstract_inverted_index.like | 57 |
| abstract_inverted_index.safe | 61 |
| abstract_inverted_index.show | 47 |
| abstract_inverted_index.that | 48 |
| abstract_inverted_index.them | 42 |
| abstract_inverted_index.based | 53 |
| abstract_inverted_index.given | 14 |
| abstract_inverted_index.model | 24 |
| abstract_inverted_index.robot | 19, 35 |
| abstract_inverted_index.using | 43 |
| abstract_inverted_index.mutual | 31, 58 |
| abstract_inverted_index.reward | 51 |
| abstract_inverted_index.robots | 64 |
| abstract_inverted_index.swarms | 36 |
| abstract_inverted_index.certain | 55 |
| abstract_inverted_index.initial | 15 |
| abstract_inverted_index.leading | 69 |
| abstract_inverted_index.present | 1 |
| abstract_inverted_index.problem | 26 |
| abstract_inverted_index.shaping | 50 |
| abstract_inverted_index.signals | 52 |
| abstract_inverted_index.solving | 41 |
| abstract_inverted_index.swarms. | 20 |
| abstract_inverted_index.discover | 38, 66 |
| abstract_inverted_index.patterns | 10, 39 |
| abstract_inverted_index.available | 11 |
| abstract_inverted_index.framework | 6 |
| abstract_inverted_index.gathering | 29, 72 |
| abstract_inverted_index.patterns. | 75 |
| abstract_inverted_index.framework. | 45 |
| abstract_inverted_index.proximity, | 62 |
| abstract_inverted_index.visibility | 32, 59, 74 |
| abstract_inverted_index.constraints | 56 |
| abstract_inverted_index.discovering | 9 |
| abstract_inverted_index.particular, | 22 |
| abstract_inverted_index.well-formed | 71 |
| abstract_inverted_index.trajectories | 68 |
| abstract_inverted_index.automatically | 8 |
| abstract_inverted_index.configuration | 16 |
| abstract_inverted_index.reinforcement | 4 |
| abstract_inverted_index.collision-less | 28, 67 |
| abstract_inverted_index.learning-based | 5 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 5 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/10 |
| sustainable_development_goals[0].score | 0.5799999833106995 |
| sustainable_development_goals[0].display_name | Reduced inequalities |
| citation_normalized_percentile |