Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents (Extended Abstract) Article Swipe
Marlos C. Machado
,
Marc G. Bellemare
,
Erik Talvitie
,
Joel Veness
,
Matthew Hausknecht
,
Michael Bowling
·
YOU?
·
· 2018
· Open Access
·
· DOI: https://doi.org/10.24963/ijcai.2018/787
YOU?
·
· 2018
· Open Access
·
· DOI: https://doi.org/10.24963/ijcai.2018/787
The Arcade Learning Environment (ALE) is an evaluation platform that poses the challenge of building AI agents with general competency across dozens of Atari 2600 games. It supports a variety of different problem settings and it has been receiving increasing attention from the scientific community. In this paper we take a big picture look at how the ALE is being used by the research community. We focus on how diverse the evaluation methodologies in the ALE have become and we highlight some key concerns when evaluating agents in this platform. We use this discussion to present what we consider to be the best practices for future evaluations in the ALE. To further the progress in the field, we also introduce a new version of the ALE that supports multiple game modes and provides a form of stochasticity we call sticky actions.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.24963/ijcai.2018/787
- https://www.ijcai.org/proceedings/2018/0787.pdf
- OA Status
- gold
- Cited By
- 3
- References
- 20
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W2865216059
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2865216059Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.24963/ijcai.2018/787Digital Object Identifier
- Title
-
Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents (Extended Abstract)Work title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2018Year of publication
- Publication date
-
2018-07-01Full publication date if available
- Authors
-
Marlos C. Machado, Marc G. Bellemare, Erik Talvitie, Joel Veness, Matthew Hausknecht, Michael BowlingList of authors in order
- Landing page
-
https://doi.org/10.24963/ijcai.2018/787Publisher landing page
- PDF URL
-
https://www.ijcai.org/proceedings/2018/0787.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://www.ijcai.org/proceedings/2018/0787.pdfDirect OA link when available
- Concepts
-
Computer science, Variety (cybernetics), Key (lock), Field (mathematics), Focus (optics), Data science, Human–computer interaction, Artificial intelligence, Management science, Computer security, Engineering, Mathematics, Optics, Pure mathematics, PhysicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
3Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 1, 2021: 1, 2019: 1Per-year citation counts (last 5 years)
- References (count)
-
20Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2865216059 |
|---|---|
| doi | https://doi.org/10.24963/ijcai.2018/787 |
| ids.doi | https://doi.org/10.24963/ijcai.2018/787 |
| ids.mag | 2865216059 |
| ids.openalex | https://openalex.org/W2865216059 |
| fwci | 0.39712492 |
| type | article |
| title | Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents (Extended Abstract) |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | 5577 |
| biblio.first_page | 5573 |
| topics[0].id | https://openalex.org/T11574 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9988999962806702 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Artificial Intelligence in Games |
| topics[1].id | https://openalex.org/T10462 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9983999729156494 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Reinforcement Learning in Robotics |
| topics[2].id | https://openalex.org/T12101 |
| topics[2].field.id | https://openalex.org/fields/18 |
| topics[2].field.display_name | Decision Sciences |
| topics[2].score | 0.9819999933242798 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1803 |
| topics[2].subfield.display_name | Management Science and Operations Research |
| topics[2].display_name | Advanced Bandit Algorithms Research |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.7454687356948853 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C136197465 |
| concepts[1].level | 2 |
| concepts[1].score | 0.7084864377975464 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q1729295 |
| concepts[1].display_name | Variety (cybernetics) |
| concepts[2].id | https://openalex.org/C26517878 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6039256453514099 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q228039 |
| concepts[2].display_name | Key (lock) |
| concepts[3].id | https://openalex.org/C9652623 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5742928981781006 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q190109 |
| concepts[3].display_name | Field (mathematics) |
| concepts[4].id | https://openalex.org/C192209626 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5406955480575562 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q190909 |
| concepts[4].display_name | Focus (optics) |
| concepts[5].id | https://openalex.org/C2522767166 |
| concepts[5].level | 1 |
| concepts[5].score | 0.4617012143135071 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[5].display_name | Data science |
| concepts[6].id | https://openalex.org/C107457646 |
| concepts[6].level | 1 |
| concepts[6].score | 0.3739977180957794 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q207434 |
| concepts[6].display_name | Human–computer interaction |
| concepts[7].id | https://openalex.org/C154945302 |
| concepts[7].level | 1 |
| concepts[7].score | 0.3271397352218628 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[7].display_name | Artificial intelligence |
| concepts[8].id | https://openalex.org/C539667460 |
| concepts[8].level | 1 |
| concepts[8].score | 0.32063743472099304 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q2414942 |
| concepts[8].display_name | Management science |
| concepts[9].id | https://openalex.org/C38652104 |
| concepts[9].level | 1 |
| concepts[9].score | 0.13362130522727966 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q3510521 |
| concepts[9].display_name | Computer security |
| concepts[10].id | https://openalex.org/C127413603 |
| concepts[10].level | 0 |
| concepts[10].score | 0.13212254643440247 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[10].display_name | Engineering |
| concepts[11].id | https://openalex.org/C33923547 |
| concepts[11].level | 0 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[11].display_name | Mathematics |
| concepts[12].id | https://openalex.org/C120665830 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q14620 |
| concepts[12].display_name | Optics |
| concepts[13].id | https://openalex.org/C202444582 |
| concepts[13].level | 1 |
| concepts[13].score | 0.0 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q837863 |
| concepts[13].display_name | Pure mathematics |
| concepts[14].id | https://openalex.org/C121332964 |
| concepts[14].level | 0 |
| concepts[14].score | 0.0 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[14].display_name | Physics |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.7454687356948853 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/variety |
| keywords[1].score | 0.7084864377975464 |
| keywords[1].display_name | Variety (cybernetics) |
| keywords[2].id | https://openalex.org/keywords/key |
| keywords[2].score | 0.6039256453514099 |
| keywords[2].display_name | Key (lock) |
| keywords[3].id | https://openalex.org/keywords/field |
| keywords[3].score | 0.5742928981781006 |
| keywords[3].display_name | Field (mathematics) |
| keywords[4].id | https://openalex.org/keywords/focus |
| keywords[4].score | 0.5406955480575562 |
| keywords[4].display_name | Focus (optics) |
| keywords[5].id | https://openalex.org/keywords/data-science |
| keywords[5].score | 0.4617012143135071 |
| keywords[5].display_name | Data science |
| keywords[6].id | https://openalex.org/keywords/human–computer-interaction |
| keywords[6].score | 0.3739977180957794 |
| keywords[6].display_name | Human–computer interaction |
| keywords[7].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[7].score | 0.3271397352218628 |
| keywords[7].display_name | Artificial intelligence |
| keywords[8].id | https://openalex.org/keywords/management-science |
| keywords[8].score | 0.32063743472099304 |
| keywords[8].display_name | Management science |
| keywords[9].id | https://openalex.org/keywords/computer-security |
| keywords[9].score | 0.13362130522727966 |
| keywords[9].display_name | Computer security |
| keywords[10].id | https://openalex.org/keywords/engineering |
| keywords[10].score | 0.13212254643440247 |
| keywords[10].display_name | Engineering |
| language | en |
| locations[0].id | doi:10.24963/ijcai.2018/787 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | |
| locations[0].pdf_url | https://www.ijcai.org/proceedings/2018/0787.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | proceedings-article |
| locations[0].license_id | |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence |
| locations[0].landing_page_url | https://doi.org/10.24963/ijcai.2018/787 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5085413987 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-0117-6134 |
| authorships[0].author.display_name | Marlos C. Machado |
| authorships[0].countries | CA |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I154425047 |
| authorships[0].affiliations[0].raw_affiliation_string | University of Alberta |
| authorships[0].institutions[0].id | https://openalex.org/I154425047 |
| authorships[0].institutions[0].ror | https://ror.org/0160cpw27 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I154425047 |
| authorships[0].institutions[0].country_code | CA |
| authorships[0].institutions[0].display_name | University of Alberta |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Marlos C. Machado |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | University of Alberta |
| authorships[1].author.id | https://openalex.org/A5001087292 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-6096-0105 |
| authorships[1].author.display_name | Marc G. Bellemare |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I1291425158 |
| authorships[1].affiliations[0].raw_affiliation_string | Google Brain |
| authorships[1].institutions[0].id | https://openalex.org/I1291425158 |
| authorships[1].institutions[0].ror | https://ror.org/00njsd438 |
| authorships[1].institutions[0].type | company |
| authorships[1].institutions[0].lineage | https://openalex.org/I1291425158, https://openalex.org/I4210128969 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | Google (United States) |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Marc G. Bellemare |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Google Brain |
| authorships[2].author.id | https://openalex.org/A5054829924 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Erik Talvitie |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I173146385 |
| authorships[2].affiliations[0].raw_affiliation_string | Franklin & Marshall College |
| authorships[2].institutions[0].id | https://openalex.org/I173146385 |
| authorships[2].institutions[0].ror | https://ror.org/04fp4ps48 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I173146385 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | Franklin & Marshall College |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Erik Talvitie |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Franklin & Marshall College |
| authorships[3].author.id | https://openalex.org/A5060709021 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Joel Veness |
| authorships[3].countries | GB |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I4210090411 |
| authorships[3].affiliations[0].raw_affiliation_string | DeepMind |
| authorships[3].institutions[0].id | https://openalex.org/I4210090411 |
| authorships[3].institutions[0].ror | https://ror.org/00971b260 |
| authorships[3].institutions[0].type | company |
| authorships[3].institutions[0].lineage | https://openalex.org/I4210090411, https://openalex.org/I4210128969 |
| authorships[3].institutions[0].country_code | GB |
| authorships[3].institutions[0].display_name | DeepMind (United Kingdom) |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Joel Veness |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | DeepMind |
| authorships[4].author.id | https://openalex.org/A5011932968 |
| authorships[4].author.orcid | |
| authorships[4].author.display_name | Matthew Hausknecht |
| authorships[4].countries | GB |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I4210164937 |
| authorships[4].affiliations[0].raw_affiliation_string | Microsoft Research |
| authorships[4].institutions[0].id | https://openalex.org/I4210164937 |
| authorships[4].institutions[0].ror | https://ror.org/05k87vq12 |
| authorships[4].institutions[0].type | company |
| authorships[4].institutions[0].lineage | https://openalex.org/I1290206253, https://openalex.org/I4210164937 |
| authorships[4].institutions[0].country_code | GB |
| authorships[4].institutions[0].display_name | Microsoft Research (United Kingdom) |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Matthew Hausknecht |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | Microsoft Research |
| authorships[5].author.id | https://openalex.org/A5081163135 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-2960-8418 |
| authorships[5].author.display_name | Michael Bowling |
| authorships[5].countries | CA, GB |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I154425047 |
| authorships[5].affiliations[0].raw_affiliation_string | University of Alberta |
| authorships[5].affiliations[1].institution_ids | https://openalex.org/I4210090411 |
| authorships[5].affiliations[1].raw_affiliation_string | DeepMind |
| authorships[5].institutions[0].id | https://openalex.org/I154425047 |
| authorships[5].institutions[0].ror | https://ror.org/0160cpw27 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I154425047 |
| authorships[5].institutions[0].country_code | CA |
| authorships[5].institutions[0].display_name | University of Alberta |
| authorships[5].institutions[1].id | https://openalex.org/I4210090411 |
| authorships[5].institutions[1].ror | https://ror.org/00971b260 |
| authorships[5].institutions[1].type | company |
| authorships[5].institutions[1].lineage | https://openalex.org/I4210090411, https://openalex.org/I4210128969 |
| authorships[5].institutions[1].country_code | GB |
| authorships[5].institutions[1].display_name | DeepMind (United Kingdom) |
| authorships[5].author_position | last |
| authorships[5].raw_author_name | Michael Bowling |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | DeepMind, University of Alberta |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.ijcai.org/proceedings/2018/0787.pdf |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents (Extended Abstract) |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T11574 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9988999962806702 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Artificial Intelligence in Games |
| related_works | https://openalex.org/W2032233321, https://openalex.org/W3121970507, https://openalex.org/W2110028391, https://openalex.org/W54497855, https://openalex.org/W217960748, https://openalex.org/W3125814499, https://openalex.org/W2090827041, https://openalex.org/W2094012830, https://openalex.org/W187246281, https://openalex.org/W2079194830 |
| cited_by_count | 3 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2021 |
| counts_by_year[1].cited_by_count | 1 |
| counts_by_year[2].year | 2019 |
| counts_by_year[2].cited_by_count | 1 |
| locations_count | 1 |
| best_oa_location.id | doi:10.24963/ijcai.2018/787 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://www.ijcai.org/proceedings/2018/0787.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | proceedings-article |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence |
| best_oa_location.landing_page_url | https://doi.org/10.24963/ijcai.2018/787 |
| primary_location.id | doi:10.24963/ijcai.2018/787 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | |
| primary_location.pdf_url | https://www.ijcai.org/proceedings/2018/0787.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | proceedings-article |
| primary_location.license_id | |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence |
| primary_location.landing_page_url | https://doi.org/10.24963/ijcai.2018/787 |
| publication_date | 2018-07-01 |
| publication_year | 2018 |
| referenced_works | https://openalex.org/W2950527027, https://openalex.org/W1512866498, https://openalex.org/W1851604233, https://openalex.org/W2201581102, https://openalex.org/W2099397840, https://openalex.org/W2480004914, https://openalex.org/W2145339207, https://openalex.org/W2155968351, https://openalex.org/W2190606234, https://openalex.org/W1997165523, https://openalex.org/W2746553466, https://openalex.org/W2404342324, https://openalex.org/W2963276097, https://openalex.org/W2174227032, https://openalex.org/W2963403143, https://openalex.org/W3103780890, https://openalex.org/W779494576, https://openalex.org/W4302969537, https://openalex.org/W2963477884, https://openalex.org/W2100506021 |
| referenced_works_count | 20 |
| abstract_inverted_index.a | 28, 50, 120, 133 |
| abstract_inverted_index.AI | 15 |
| abstract_inverted_index.In | 45 |
| abstract_inverted_index.It | 26 |
| abstract_inverted_index.To | 110 |
| abstract_inverted_index.We | 65, 90 |
| abstract_inverted_index.an | 6 |
| abstract_inverted_index.at | 54 |
| abstract_inverted_index.be | 100 |
| abstract_inverted_index.by | 61 |
| abstract_inverted_index.in | 73, 87, 107, 114 |
| abstract_inverted_index.is | 5, 58 |
| abstract_inverted_index.it | 35 |
| abstract_inverted_index.of | 13, 22, 30, 123, 135 |
| abstract_inverted_index.on | 67 |
| abstract_inverted_index.to | 94, 99 |
| abstract_inverted_index.we | 48, 79, 97, 117, 137 |
| abstract_inverted_index.ALE | 57, 75, 125 |
| abstract_inverted_index.The | 0 |
| abstract_inverted_index.and | 34, 78, 131 |
| abstract_inverted_index.big | 51 |
| abstract_inverted_index.for | 104 |
| abstract_inverted_index.has | 36 |
| abstract_inverted_index.how | 55, 68 |
| abstract_inverted_index.key | 82 |
| abstract_inverted_index.new | 121 |
| abstract_inverted_index.the | 11, 42, 56, 62, 70, 74, 101, 108, 112, 115, 124 |
| abstract_inverted_index.use | 91 |
| abstract_inverted_index.2600 | 24 |
| abstract_inverted_index.ALE. | 109 |
| abstract_inverted_index.also | 118 |
| abstract_inverted_index.been | 37 |
| abstract_inverted_index.best | 102 |
| abstract_inverted_index.call | 138 |
| abstract_inverted_index.form | 134 |
| abstract_inverted_index.from | 41 |
| abstract_inverted_index.game | 129 |
| abstract_inverted_index.have | 76 |
| abstract_inverted_index.look | 53 |
| abstract_inverted_index.some | 81 |
| abstract_inverted_index.take | 49 |
| abstract_inverted_index.that | 9, 126 |
| abstract_inverted_index.this | 46, 88, 92 |
| abstract_inverted_index.used | 60 |
| abstract_inverted_index.what | 96 |
| abstract_inverted_index.when | 84 |
| abstract_inverted_index.with | 17 |
| abstract_inverted_index.(ALE) | 4 |
| abstract_inverted_index.Atari | 23 |
| abstract_inverted_index.being | 59 |
| abstract_inverted_index.focus | 66 |
| abstract_inverted_index.modes | 130 |
| abstract_inverted_index.paper | 47 |
| abstract_inverted_index.poses | 10 |
| abstract_inverted_index.Arcade | 1 |
| abstract_inverted_index.across | 20 |
| abstract_inverted_index.agents | 16, 86 |
| abstract_inverted_index.become | 77 |
| abstract_inverted_index.dozens | 21 |
| abstract_inverted_index.field, | 116 |
| abstract_inverted_index.future | 105 |
| abstract_inverted_index.games. | 25 |
| abstract_inverted_index.sticky | 139 |
| abstract_inverted_index.diverse | 69 |
| abstract_inverted_index.further | 111 |
| abstract_inverted_index.general | 18 |
| abstract_inverted_index.picture | 52 |
| abstract_inverted_index.present | 95 |
| abstract_inverted_index.problem | 32 |
| abstract_inverted_index.variety | 29 |
| abstract_inverted_index.version | 122 |
| abstract_inverted_index.Learning | 2 |
| abstract_inverted_index.actions. | 140 |
| abstract_inverted_index.building | 14 |
| abstract_inverted_index.concerns | 83 |
| abstract_inverted_index.consider | 98 |
| abstract_inverted_index.multiple | 128 |
| abstract_inverted_index.platform | 8 |
| abstract_inverted_index.progress | 113 |
| abstract_inverted_index.provides | 132 |
| abstract_inverted_index.research | 63 |
| abstract_inverted_index.settings | 33 |
| abstract_inverted_index.supports | 27, 127 |
| abstract_inverted_index.attention | 40 |
| abstract_inverted_index.challenge | 12 |
| abstract_inverted_index.different | 31 |
| abstract_inverted_index.highlight | 80 |
| abstract_inverted_index.introduce | 119 |
| abstract_inverted_index.platform. | 89 |
| abstract_inverted_index.practices | 103 |
| abstract_inverted_index.receiving | 38 |
| abstract_inverted_index.community. | 44, 64 |
| abstract_inverted_index.competency | 19 |
| abstract_inverted_index.discussion | 93 |
| abstract_inverted_index.evaluating | 85 |
| abstract_inverted_index.evaluation | 7, 71 |
| abstract_inverted_index.increasing | 39 |
| abstract_inverted_index.scientific | 43 |
| abstract_inverted_index.Environment | 3 |
| abstract_inverted_index.evaluations | 106 |
| abstract_inverted_index.methodologies | 72 |
| abstract_inverted_index.stochasticity | 136 |
| cited_by_percentile_year.max | 94 |
| cited_by_percentile_year.min | 89 |
| corresponding_author_ids | https://openalex.org/A5085413987 |
| countries_distinct_count | 3 |
| institutions_distinct_count | 6 |
| corresponding_institution_ids | https://openalex.org/I154425047 |
| citation_normalized_percentile.value | 0.67505203 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |