Integrating Acting, Planning and Learning in Hierarchical Operational\n Models Article Swipe
Sunandita Patra
,
James Mason
,
Amit Kumar
,
Malik Ghallab
,
Paolo Traverso
,
Dana Nau
·
YOU?
·
· 2020
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2003.03932
YOU?
·
· 2020
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2003.03932
We present new planning and learning algorithms for RAE, the Refinement\nActing Engine. RAE uses hierarchical operational models to perform tasks in\ndynamically changing environments. Our planning procedure, UPOM, does a\nUCT-like search in the space of operational models in order to find a\nnear-optimal method to use for the task and context at hand. Our learning\nstrategies acquire, from online acting experiences and/or simulated planning\nresults, a mapping from decision contexts to method instances as well as a\nheuristic function to guide UPOM. Our experimental results show that UPOM and\nour learning strategies significantly improve RAE's performance in four test\ndomains using two different metrics: efficiency and success ratio.\n
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2003.03932
- https://arxiv.org/pdf/2003.03932
- OA Status
- green
- Cited By
- 1
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4297206256
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4297206256Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2003.03932Digital Object Identifier
- Title
-
Integrating Acting, Planning and Learning in Hierarchical Operational\n ModelsWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2020Year of publication
- Publication date
-
2020-03-09Full publication date if available
- Authors
-
Sunandita Patra, James Mason, Amit Kumar, Malik Ghallab, Paolo Traverso, Dana NauList of authors in order
- Landing page
-
https://arxiv.org/abs/2003.03932Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2003.03932Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2003.03932Direct OA link when available
- Concepts
-
Computer science, Task (project management), Heuristic, Machine learning, Context (archaeology), Artificial intelligence, Function (biology), Space (punctuation), Engineering, Systems engineering, Evolutionary biology, Operating system, Paleontology, BiologyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2023: 1Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4297206256 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2003.03932 |
| ids.openalex | https://openalex.org/W4297206256 |
| fwci | 0.14685955 |
| type | preprint |
| title | Integrating Acting, Planning and Learning in Hierarchical Operational\n Models |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10906 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9965999722480774 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | AI-based Problem Solving and Planning |
| topics[1].id | https://openalex.org/T13197 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9690999984741211 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1712 |
| topics[1].subfield.display_name | Software |
| topics[1].display_name | Spreadsheets and End-User Computing |
| topics[2].id | https://openalex.org/T11574 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9621999859809875 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Artificial Intelligence in Games |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.7421122789382935 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C2780451532 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6440795063972473 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q759676 |
| concepts[1].display_name | Task (project management) |
| concepts[2].id | https://openalex.org/C173801870 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5854724645614624 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q201413 |
| concepts[2].display_name | Heuristic |
| concepts[3].id | https://openalex.org/C119857082 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5551354289054871 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[3].display_name | Machine learning |
| concepts[4].id | https://openalex.org/C2779343474 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5267695188522339 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q3109175 |
| concepts[4].display_name | Context (archaeology) |
| concepts[5].id | https://openalex.org/C154945302 |
| concepts[5].level | 1 |
| concepts[5].score | 0.5147112011909485 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[5].display_name | Artificial intelligence |
| concepts[6].id | https://openalex.org/C14036430 |
| concepts[6].level | 2 |
| concepts[6].score | 0.5029792189598083 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q3736076 |
| concepts[6].display_name | Function (biology) |
| concepts[7].id | https://openalex.org/C2778572836 |
| concepts[7].level | 2 |
| concepts[7].score | 0.501197099685669 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q380933 |
| concepts[7].display_name | Space (punctuation) |
| concepts[8].id | https://openalex.org/C127413603 |
| concepts[8].level | 0 |
| concepts[8].score | 0.1448805332183838 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[8].display_name | Engineering |
| concepts[9].id | https://openalex.org/C201995342 |
| concepts[9].level | 1 |
| concepts[9].score | 0.08808833360671997 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q682496 |
| concepts[9].display_name | Systems engineering |
| concepts[10].id | https://openalex.org/C78458016 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q840400 |
| concepts[10].display_name | Evolutionary biology |
| concepts[11].id | https://openalex.org/C111919701 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q9135 |
| concepts[11].display_name | Operating system |
| concepts[12].id | https://openalex.org/C151730666 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q7205 |
| concepts[12].display_name | Paleontology |
| concepts[13].id | https://openalex.org/C86803240 |
| concepts[13].level | 0 |
| concepts[13].score | 0.0 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q420 |
| concepts[13].display_name | Biology |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.7421122789382935 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/task |
| keywords[1].score | 0.6440795063972473 |
| keywords[1].display_name | Task (project management) |
| keywords[2].id | https://openalex.org/keywords/heuristic |
| keywords[2].score | 0.5854724645614624 |
| keywords[2].display_name | Heuristic |
| keywords[3].id | https://openalex.org/keywords/machine-learning |
| keywords[3].score | 0.5551354289054871 |
| keywords[3].display_name | Machine learning |
| keywords[4].id | https://openalex.org/keywords/context |
| keywords[4].score | 0.5267695188522339 |
| keywords[4].display_name | Context (archaeology) |
| keywords[5].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[5].score | 0.5147112011909485 |
| keywords[5].display_name | Artificial intelligence |
| keywords[6].id | https://openalex.org/keywords/function |
| keywords[6].score | 0.5029792189598083 |
| keywords[6].display_name | Function (biology) |
| keywords[7].id | https://openalex.org/keywords/space |
| keywords[7].score | 0.501197099685669 |
| keywords[7].display_name | Space (punctuation) |
| keywords[8].id | https://openalex.org/keywords/engineering |
| keywords[8].score | 0.1448805332183838 |
| keywords[8].display_name | Engineering |
| keywords[9].id | https://openalex.org/keywords/systems-engineering |
| keywords[9].score | 0.08808833360671997 |
| keywords[9].display_name | Systems engineering |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2003.03932 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2003.03932 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2003.03932 |
| indexed_in | arxiv |
| authorships[0].author.id | https://openalex.org/A5004581055 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-6291-7565 |
| authorships[0].author.display_name | Sunandita Patra |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Patra, Sunandita |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5026581021 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-9210-4082 |
| authorships[1].author.display_name | James Mason |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Mason, James |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5029407896 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-3965-6627 |
| authorships[2].author.display_name | Amit Kumar |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Kumar, Amit |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5038185516 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-4326-049X |
| authorships[3].author.display_name | Malik Ghallab |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Ghallab, Malik |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5039482178 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-6301-0204 |
| authorships[4].author.display_name | Paolo Traverso |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Traverso, Paolo |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5084686808 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-6940-6293 |
| authorships[5].author.display_name | Dana Nau |
| authorships[5].author_position | last |
| authorships[5].raw_author_name | Nau, Dana |
| authorships[5].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2003.03932 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2022-09-27T00:00:00 |
| display_name | Integrating Acting, Planning and Learning in Hierarchical Operational\n Models |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10906 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9965999722480774 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | AI-based Problem Solving and Planning |
| related_works | https://openalex.org/W2961085424, https://openalex.org/W4224009465, https://openalex.org/W4306674287, https://openalex.org/W4286629047, https://openalex.org/W2370815826, https://openalex.org/W4389443772, https://openalex.org/W2433057514, https://openalex.org/W2373436826, https://openalex.org/W2167961874, https://openalex.org/W4205958290 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2023 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 1 |
| best_oa_location.id | pmh:oai:arXiv.org:2003.03932 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2003.03932 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2003.03932 |
| primary_location.id | pmh:oai:arXiv.org:2003.03932 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2003.03932 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2003.03932 |
| publication_date | 2020-03-09 |
| publication_year | 2020 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 61 |
| abstract_inverted_index.We | 0 |
| abstract_inverted_index.as | 69, 71 |
| abstract_inverted_index.at | 49 |
| abstract_inverted_index.in | 30, 36, 90 |
| abstract_inverted_index.of | 33 |
| abstract_inverted_index.to | 17, 38, 42, 66, 74 |
| abstract_inverted_index.Our | 23, 51, 77 |
| abstract_inverted_index.RAE | 12 |
| abstract_inverted_index.and | 4, 47, 98 |
| abstract_inverted_index.for | 7, 44 |
| abstract_inverted_index.new | 2 |
| abstract_inverted_index.the | 9, 31, 45 |
| abstract_inverted_index.two | 94 |
| abstract_inverted_index.use | 43 |
| abstract_inverted_index.RAE, | 8 |
| abstract_inverted_index.UPOM | 82 |
| abstract_inverted_index.does | 27 |
| abstract_inverted_index.find | 39 |
| abstract_inverted_index.four | 91 |
| abstract_inverted_index.from | 54, 63 |
| abstract_inverted_index.show | 80 |
| abstract_inverted_index.task | 46 |
| abstract_inverted_index.that | 81 |
| abstract_inverted_index.uses | 13 |
| abstract_inverted_index.well | 70 |
| abstract_inverted_index.RAE's | 88 |
| abstract_inverted_index.UPOM, | 26 |
| abstract_inverted_index.UPOM. | 76 |
| abstract_inverted_index.guide | 75 |
| abstract_inverted_index.hand. | 50 |
| abstract_inverted_index.order | 37 |
| abstract_inverted_index.space | 32 |
| abstract_inverted_index.tasks | 19 |
| abstract_inverted_index.using | 93 |
| abstract_inverted_index.acting | 56 |
| abstract_inverted_index.and/or | 58 |
| abstract_inverted_index.method | 41, 67 |
| abstract_inverted_index.models | 16, 35 |
| abstract_inverted_index.online | 55 |
| abstract_inverted_index.search | 29 |
| abstract_inverted_index.Engine. | 11 |
| abstract_inverted_index.context | 48 |
| abstract_inverted_index.improve | 87 |
| abstract_inverted_index.mapping | 62 |
| abstract_inverted_index.perform | 18 |
| abstract_inverted_index.present | 1 |
| abstract_inverted_index.results | 79 |
| abstract_inverted_index.success | 99 |
| abstract_inverted_index.acquire, | 53 |
| abstract_inverted_index.and\nour | 83 |
| abstract_inverted_index.changing | 21 |
| abstract_inverted_index.contexts | 65 |
| abstract_inverted_index.decision | 64 |
| abstract_inverted_index.function | 73 |
| abstract_inverted_index.learning | 5, 84 |
| abstract_inverted_index.metrics: | 96 |
| abstract_inverted_index.planning | 3, 24 |
| abstract_inverted_index.ratio.\n | 100 |
| abstract_inverted_index.different | 95 |
| abstract_inverted_index.instances | 68 |
| abstract_inverted_index.simulated | 59 |
| abstract_inverted_index.algorithms | 6 |
| abstract_inverted_index.efficiency | 97 |
| abstract_inverted_index.procedure, | 25 |
| abstract_inverted_index.strategies | 85 |
| abstract_inverted_index.a\nUCT-like | 28 |
| abstract_inverted_index.experiences | 57 |
| abstract_inverted_index.operational | 15, 34 |
| abstract_inverted_index.performance | 89 |
| abstract_inverted_index.a\nheuristic | 72 |
| abstract_inverted_index.experimental | 78 |
| abstract_inverted_index.hierarchical | 14 |
| abstract_inverted_index.environments. | 22 |
| abstract_inverted_index.significantly | 86 |
| abstract_inverted_index.test\ndomains | 92 |
| abstract_inverted_index.a\nnear-optimal | 40 |
| abstract_inverted_index.in\ndynamically | 20 |
| abstract_inverted_index.Refinement\nActing | 10 |
| abstract_inverted_index.planning\nresults, | 60 |
| abstract_inverted_index.learning\nstrategies | 52 |
| cited_by_percentile_year.max | 94 |
| cited_by_percentile_year.min | 89 |
| countries_distinct_count | 0 |
| institutions_distinct_count | 6 |
| citation_normalized_percentile.value | 0.6090334 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |