Shaking the foundations: delusions in sequence models for interaction\n and control Article Swipe

PDF

Pedro A. Ortega , Markus Kunesch , Grégoire Delétang , Tim Genewein , Jordi Grau-Moya , Joel Veness , Jonas Buchli , Jonas Degrave , Bilal Piot , Julien Pérolat , Tom Everitt , Corentin Tallec , Emilio Parisotto , Tom Erez , Yutian Chen , Scott Reed , Marcus Hütter , Nando de Freitas , Shane Legg ·

YOU? · · 2021 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2110.10819

The recent phenomenal success of language models has reinvigorated machine\nlearning research, and large sequence models such as transformers are being\napplied to a variety of domains. One important problem class that has remained\nrelatively elusive however is purposeful adaptive behavior. Currently there is\na common perception that sequence models "lack the understanding of the cause\nand effect of their actions" leading them to draw incorrect inferences due to\nauto-suggestive delusions. In this report we explain where this mismatch\noriginates, and show that it can be resolved by treating actions as causal\ninterventions. Finally, we show that in supervised learning, one can teach a\nsystem to condition or intervene on data by training with factual and\ncounterfactual error signals respectively.\n

Related Topics

Perception

Computer Science

Artificial Intelligence

Electrical Engineering

Voltage

Neuroscience

Concepts

Counterfactual thinking Variety (cybernetics) Perception Sequence (biology) Cognitive psychology Counterfactual conditional Computer science Artificial intelligence Sequence learning Transformer Psychology Class (philosophy) Cognitive science Control (management) Machine learning Social psychology Engineering Genetics Biology Electrical engineering Voltage Neuroscience

Metadata

Type: preprint
Language: en
Landing Page: http://arxiv.org/abs/2110.10819
PDF: https://arxiv.org/pdf/2110.10819
OA Status: green
Cited By: 19
Related Works: 10
OpenAlex ID: https://openalex.org/W4286899435

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4286899435

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.48550/arxiv.2110.10819

Digital Object Identifier
Title: Shaking the foundations: delusions in sequence models for interaction\n and control

Work title
Type: preprint

OpenAlex work type
Language: en

Primary language
Publication year: 2021

Year of publication
Publication date: 2021-10-20

Full publication date if available
Authors: Pedro A. Ortega, Markus Kunesch, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Joel Veness, Jonas Buchli, Jonas Degrave, Bilal Piot, Julien Pérolat, Tom Everitt, Corentin Tallec, Emilio Parisotto, Tom Erez, Yutian Chen, Scott Reed, Marcus Hütter, Nando de Freitas, Shane Legg

List of authors in order
Landing page: https://arxiv.org/abs/2110.10819

Publisher landing page
PDF URL: https://arxiv.org/pdf/2110.10819

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2110.10819

Direct OA link when available
Concepts: Counterfactual thinking, Variety (cybernetics), Perception, Sequence (biology), Cognitive psychology, Counterfactual conditional, Computer science, Artificial intelligence, Sequence learning, Transformer, Psychology, Class (philosophy), Cognitive science, Control (management), Machine learning, Social psychology, Engineering, Genetics, Biology, Electrical engineering, Voltage, Neuroscience

Top concepts (fields/topics) attached by OpenAlex
Cited by: 19

Total citation count in OpenAlex
Citations by year (recent): 2024: 5, 2023: 11, 2022: 3

Per-year citation counts (last 5 years)
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4286899435
doi	https://doi.org/10.48550/arxiv.2110.10819
ids.openalex	https://openalex.org/W4286899435
fwci	2.68096793
type	preprint
title	Shaking the foundations: delusions in sequence models for interaction\n and control
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T10028
topics[0].field.id	https://openalex.org/fields/17
topics[0].field.display_name	Computer Science
topics[0].score	0.9498999714851379
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/1702
topics[0].subfield.display_name	Artificial Intelligence
topics[0].display_name	Topic Modeling
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C108650721
concepts[0].level	2
concepts[0].score	0.8348958492279053
concepts[0].wikidata	https://www.wikidata.org/wiki/Q1783253
concepts[0].display_name	Counterfactual thinking
concepts[1].id	https://openalex.org/C136197465
concepts[1].level	2
concepts[1].score	0.6229300498962402
concepts[1].wikidata	https://www.wikidata.org/wiki/Q1729295
concepts[1].display_name	Variety (cybernetics)
concepts[2].id	https://openalex.org/C26760741
concepts[2].level	2
concepts[2].score	0.5986337065696716
concepts[2].wikidata	https://www.wikidata.org/wiki/Q160402
concepts[2].display_name	Perception
concepts[3].id	https://openalex.org/C2778112365
concepts[3].level	2
concepts[3].score	0.5606102347373962
concepts[3].wikidata	https://www.wikidata.org/wiki/Q3511065
concepts[3].display_name	Sequence (biology)
concepts[4].id	https://openalex.org/C180747234
concepts[4].level	1
concepts[4].score	0.5600380897521973
concepts[4].wikidata	https://www.wikidata.org/wiki/Q23373
concepts[4].display_name	Cognitive psychology
concepts[5].id	https://openalex.org/C71889745
concepts[5].level	3
concepts[5].score	0.5515307784080505
concepts[5].wikidata	https://www.wikidata.org/wiki/Q1783264
concepts[5].display_name	Counterfactual conditional
concepts[6].id	https://openalex.org/C41008148
concepts[6].level	0
concepts[6].score	0.5113189220428467
concepts[6].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[6].display_name	Computer science
concepts[7].id	https://openalex.org/C154945302
concepts[7].level	1
concepts[7].score	0.46382513642311096
concepts[7].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[7].display_name	Artificial intelligence
concepts[8].id	https://openalex.org/C40506919
concepts[8].level	2
concepts[8].score	0.45439743995666504
concepts[8].wikidata	https://www.wikidata.org/wiki/Q7452469
concepts[8].display_name	Sequence learning
concepts[9].id	https://openalex.org/C66322947
concepts[9].level	3
concepts[9].score	0.4513694941997528
concepts[9].wikidata	https://www.wikidata.org/wiki/Q11658
concepts[9].display_name	Transformer
concepts[10].id	https://openalex.org/C15744967
concepts[10].level	0
concepts[10].score	0.4316340386867523
concepts[10].wikidata	https://www.wikidata.org/wiki/Q9418
concepts[10].display_name	Psychology
concepts[11].id	https://openalex.org/C2777212361
concepts[11].level	2
concepts[11].score	0.4267638921737671
concepts[11].wikidata	https://www.wikidata.org/wiki/Q5127848
concepts[11].display_name	Class (philosophy)
concepts[12].id	https://openalex.org/C188147891
concepts[12].level	1
concepts[12].score	0.42516955733299255
concepts[12].wikidata	https://www.wikidata.org/wiki/Q147638
concepts[12].display_name	Cognitive science
concepts[13].id	https://openalex.org/C2775924081
concepts[13].level	2
concepts[13].score	0.4142664968967438
concepts[13].wikidata	https://www.wikidata.org/wiki/Q55608371
concepts[13].display_name	Control (management)
concepts[14].id	https://openalex.org/C119857082
concepts[14].level	1
concepts[14].score	0.37935638427734375
concepts[14].wikidata	https://www.wikidata.org/wiki/Q2539
concepts[14].display_name	Machine learning
concepts[15].id	https://openalex.org/C77805123
concepts[15].level	1
concepts[15].score	0.22909805178642273
concepts[15].wikidata	https://www.wikidata.org/wiki/Q161272
concepts[15].display_name	Social psychology
concepts[16].id	https://openalex.org/C127413603
concepts[16].level	0
concepts[16].score	0.13658544421195984
concepts[16].wikidata	https://www.wikidata.org/wiki/Q11023
concepts[16].display_name	Engineering
concepts[17].id	https://openalex.org/C54355233
concepts[17].level	1
concepts[17].score	0.0
concepts[17].wikidata	https://www.wikidata.org/wiki/Q7162
concepts[17].display_name	Genetics
concepts[18].id	https://openalex.org/C86803240
concepts[18].level	0
concepts[18].score	0.0
concepts[18].wikidata	https://www.wikidata.org/wiki/Q420
concepts[18].display_name	Biology
concepts[19].id	https://openalex.org/C119599485
concepts[19].level	1
concepts[19].score	0.0
concepts[19].wikidata	https://www.wikidata.org/wiki/Q43035
concepts[19].display_name	Electrical engineering
concepts[20].id	https://openalex.org/C165801399
concepts[20].level	2
concepts[20].score	0.0
concepts[20].wikidata	https://www.wikidata.org/wiki/Q25428
concepts[20].display_name	Voltage
concepts[21].id	https://openalex.org/C169760540
concepts[21].level	1
concepts[21].score	0.0
concepts[21].wikidata	https://www.wikidata.org/wiki/Q207011
concepts[21].display_name	Neuroscience
keywords[0].id	https://openalex.org/keywords/counterfactual-thinking
keywords[0].score	0.8348958492279053
keywords[0].display_name	Counterfactual thinking
keywords[1].id	https://openalex.org/keywords/variety
keywords[1].score	0.6229300498962402
keywords[1].display_name	Variety (cybernetics)
keywords[2].id	https://openalex.org/keywords/perception
keywords[2].score	0.5986337065696716
keywords[2].display_name	Perception
keywords[3].id	https://openalex.org/keywords/sequence
keywords[3].score	0.5606102347373962
keywords[3].display_name	Sequence (biology)
keywords[4].id	https://openalex.org/keywords/cognitive-psychology
keywords[4].score	0.5600380897521973
keywords[4].display_name	Cognitive psychology
keywords[5].id	https://openalex.org/keywords/counterfactual-conditional
keywords[5].score	0.5515307784080505
keywords[5].display_name	Counterfactual conditional
keywords[6].id	https://openalex.org/keywords/computer-science
keywords[6].score	0.5113189220428467
keywords[6].display_name	Computer science
keywords[7].id	https://openalex.org/keywords/artificial-intelligence
keywords[7].score	0.46382513642311096
keywords[7].display_name	Artificial intelligence
keywords[8].id	https://openalex.org/keywords/sequence-learning
keywords[8].score	0.45439743995666504
keywords[8].display_name	Sequence learning
keywords[9].id	https://openalex.org/keywords/transformer
keywords[9].score	0.4513694941997528
keywords[9].display_name	Transformer
keywords[10].id	https://openalex.org/keywords/psychology
keywords[10].score	0.4316340386867523
keywords[10].display_name	Psychology
keywords[11].id	https://openalex.org/keywords/class
keywords[11].score	0.4267638921737671
keywords[11].display_name	Class (philosophy)
keywords[12].id	https://openalex.org/keywords/cognitive-science
keywords[12].score	0.42516955733299255
keywords[12].display_name	Cognitive science
keywords[13].id	https://openalex.org/keywords/control
keywords[13].score	0.4142664968967438
keywords[13].display_name	Control (management)
keywords[14].id	https://openalex.org/keywords/machine-learning
keywords[14].score	0.37935638427734375
keywords[14].display_name	Machine learning
keywords[15].id	https://openalex.org/keywords/social-psychology
keywords[15].score	0.22909805178642273
keywords[15].display_name	Social psychology
keywords[16].id	https://openalex.org/keywords/engineering
keywords[16].score	0.13658544421195984
keywords[16].display_name	Engineering
language	en
locations[0].id	pmh:oai:arXiv.org:2110.10819
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4306400194
locations[0].source.issn
locations[0].source.type	repository
locations[0].source.is_oa	True
locations[0].source.issn_l
locations[0].source.is_core	False
locations[0].source.is_in_doaj	False
locations[0].source.display_name	arXiv (Cornell University)
locations[0].source.host_organization	https://openalex.org/I205783295
locations[0].source.host_organization_name	Cornell University
locations[0].source.host_organization_lineage	https://openalex.org/I205783295
locations[0].license
locations[0].pdf_url	https://arxiv.org/pdf/2110.10819
locations[0].version	submittedVersion
locations[0].raw_type	text
locations[0].license_id
locations[0].is_accepted	False
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	http://arxiv.org/abs/2110.10819
indexed_in	arxiv
authorships[0].author.id	https://openalex.org/A5035060247
authorships[0].author.orcid	https://orcid.org/0000-0003-2261-8453
authorships[0].author.display_name	Pedro A. Ortega
authorships[0].author_position	first
authorships[0].raw_author_name	Ortega, Pedro A.
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5043562314
authorships[1].author.orcid	https://orcid.org/0000-0003-3818-7897
authorships[1].author.display_name	Markus Kunesch
authorships[1].author_position	middle
authorships[1].raw_author_name	Kunesch, Markus
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5059962909
authorships[2].author.orcid
authorships[2].author.display_name	Grégoire Delétang
authorships[2].author_position	middle
authorships[2].raw_author_name	Delétang, Grégoire
authorships[2].is_corresponding	False
authorships[3].author.id	https://openalex.org/A5013602545
authorships[3].author.orcid	https://orcid.org/0000-0001-8039-4027
authorships[3].author.display_name	Tim Genewein
authorships[3].author_position	middle
authorships[3].raw_author_name	Genewein, Tim
authorships[3].is_corresponding	False
authorships[4].author.id	https://openalex.org/A5026686188
authorships[4].author.orcid
authorships[4].author.display_name	Jordi Grau-Moya
authorships[4].author_position	middle
authorships[4].raw_author_name	Grau-Moya, Jordi
authorships[4].is_corresponding	False
authorships[5].author.id	https://openalex.org/A5060709021
authorships[5].author.orcid
authorships[5].author.display_name	Joel Veness
authorships[5].author_position	middle
authorships[5].raw_author_name	Veness, Joel
authorships[5].is_corresponding	False
authorships[6].author.id	https://openalex.org/A5077279214
authorships[6].author.orcid	https://orcid.org/0000-0001-7494-8492
authorships[6].author.display_name	Jonas Buchli
authorships[6].author_position	middle
authorships[6].raw_author_name	Buchli, Jonas
authorships[6].is_corresponding	False
authorships[7].author.id	https://openalex.org/A5032189040
authorships[7].author.orcid	https://orcid.org/0000-0002-2738-6500
authorships[7].author.display_name	Jonas Degrave
authorships[7].author_position	middle
authorships[7].raw_author_name	Degrave, Jonas
authorships[7].is_corresponding	False
authorships[8].author.id	https://openalex.org/A5103033215
authorships[8].author.orcid	https://orcid.org/0000-0003-3906-950X
authorships[8].author.display_name	Bilal Piot
authorships[8].author_position	middle
authorships[8].raw_author_name	Piot, Bilal
authorships[8].is_corresponding	False
authorships[9].author.id	https://openalex.org/A5056707583
authorships[9].author.orcid	https://orcid.org/0000-0002-8176-1666
authorships[9].author.display_name	Julien Pérolat
authorships[9].author_position	middle
authorships[9].raw_author_name	Perolat, Julien
authorships[9].is_corresponding	False
authorships[10].author.id	https://openalex.org/A5020224050
authorships[10].author.orcid	https://orcid.org/0000-0003-1210-9866
authorships[10].author.display_name	Tom Everitt
authorships[10].author_position	middle
authorships[10].raw_author_name	Everitt, Tom
authorships[10].is_corresponding	False
authorships[11].author.id	https://openalex.org/A5106745356
authorships[11].author.orcid	https://orcid.org/0000-0003-3649-720X
authorships[11].author.display_name	Corentin Tallec
authorships[11].author_position	middle
authorships[11].raw_author_name	Tallec, Corentin
authorships[11].is_corresponding	False
authorships[12].author.id	https://openalex.org/A5045585535
authorships[12].author.orcid
authorships[12].author.display_name	Emilio Parisotto
authorships[12].author_position	middle
authorships[12].raw_author_name	Parisotto, Emilio
authorships[12].is_corresponding	False
authorships[13].author.id	https://openalex.org/A5080897805
authorships[13].author.orcid
authorships[13].author.display_name	Tom Erez
authorships[13].author_position	middle
authorships[13].raw_author_name	Erez, Tom
authorships[13].is_corresponding	False
authorships[14].author.id	https://openalex.org/A5074021977
authorships[14].author.orcid	https://orcid.org/0000-0001-8008-9014
authorships[14].author.display_name	Yutian Chen
authorships[14].author_position	middle
authorships[14].raw_author_name	Chen, Yutian
authorships[14].is_corresponding	False
authorships[15].author.id	https://openalex.org/A5059110895
authorships[15].author.orcid
authorships[15].author.display_name	Scott Reed
authorships[15].author_position	middle
authorships[15].raw_author_name	Reed, Scott
authorships[15].is_corresponding	False
authorships[16].author.id	https://openalex.org/A5073944062
authorships[16].author.orcid	https://orcid.org/0000-0002-3263-4097
authorships[16].author.display_name	Marcus Hütter
authorships[16].author_position	middle
authorships[16].raw_author_name	Hutter, Marcus
authorships[16].is_corresponding	False
authorships[17].author.id	https://openalex.org/A5082304130
authorships[17].author.orcid	https://orcid.org/0000-0003-4770-7217
authorships[17].author.display_name	Nando de Freitas
authorships[17].author_position	middle
authorships[17].raw_author_name	de Freitas, Nando
authorships[17].is_corresponding	False
authorships[18].author.id	https://openalex.org/A5008987732
authorships[18].author.orcid
authorships[18].author.display_name	Shane Legg
authorships[18].author_position	last
authorships[18].raw_author_name	Legg, Shane
authorships[18].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2110.10819
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2022-07-25T00:00:00
display_name	Shaking the foundations: delusions in sequence models for interaction\n and control
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T10028
primary_topic.field.id	https://openalex.org/fields/17
primary_topic.field.display_name	Computer Science
primary_topic.score	0.9498999714851379
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/1702
primary_topic.subfield.display_name	Artificial Intelligence
primary_topic.display_name	Topic Modeling
related_works	https://openalex.org/W2056582926, https://openalex.org/W3137864021, https://openalex.org/W2162910442, https://openalex.org/W2079879923, https://openalex.org/W4200271736, https://openalex.org/W2104420793, https://openalex.org/W3017854570, https://openalex.org/W2028689793, https://openalex.org/W4242448314, https://openalex.org/W3028884462
cited_by_count	19
counts_by_year[0].year	2024
counts_by_year[0].cited_by_count	5
counts_by_year[1].year	2023
counts_by_year[1].cited_by_count	11
counts_by_year[2].year	2022
counts_by_year[2].cited_by_count	3
locations_count	1
best_oa_location.id	pmh:oai:arXiv.org:2110.10819
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2110.10819
best_oa_location.version	submittedVersion
best_oa_location.raw_type	text
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2110.10819
primary_location.id	pmh:oai:arXiv.org:2110.10819
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4306400194
primary_location.source.issn
primary_location.source.type	repository
primary_location.source.is_oa	True
primary_location.source.issn_l
primary_location.source.is_core	False
primary_location.source.is_in_doaj	False
primary_location.source.display_name	arXiv (Cornell University)
primary_location.source.host_organization	https://openalex.org/I205783295
primary_location.source.host_organization_name	Cornell University
primary_location.source.host_organization_lineage	https://openalex.org/I205783295
primary_location.license
primary_location.pdf_url	https://arxiv.org/pdf/2110.10819
primary_location.version	submittedVersion
primary_location.raw_type	text
primary_location.license_id
primary_location.is_accepted	False
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	http://arxiv.org/abs/2110.10819
publication_date	2021-10-20
publication_year	2021
referenced_works_count	0
abstract_inverted_index.a	21
abstract_inverted_index.In	65
abstract_inverted_index.as	16, 83
abstract_inverted_index.be	78
abstract_inverted_index.by	80, 102
abstract_inverted_index.in	89
abstract_inverted_index.is	34
abstract_inverted_index.it	76
abstract_inverted_index.of	4, 23, 49, 53
abstract_inverted_index.on	100
abstract_inverted_index.or	98
abstract_inverted_index.to	20, 58, 96
abstract_inverted_index.we	68, 86
abstract_inverted_index.One	25
abstract_inverted_index.The	0
abstract_inverted_index.and	11, 73
abstract_inverted_index.are	18
abstract_inverted_index.can	77, 93
abstract_inverted_index.due	62
abstract_inverted_index.has	7, 30
abstract_inverted_index.one	92
abstract_inverted_index.the	47, 50
abstract_inverted_index.data	101
abstract_inverted_index.draw	59
abstract_inverted_index.show	74, 87
abstract_inverted_index.such	15
abstract_inverted_index.that	29, 43, 75, 88
abstract_inverted_index.them	57
abstract_inverted_index.this	66, 71
abstract_inverted_index.with	104
abstract_inverted_index."lack	46
abstract_inverted_index.class	28
abstract_inverted_index.error	107
abstract_inverted_index.is\na	40
abstract_inverted_index.large	12
abstract_inverted_index.teach	94
abstract_inverted_index.their	54
abstract_inverted_index.there	39
abstract_inverted_index.where	70
abstract_inverted_index.common	41
abstract_inverted_index.effect	52
abstract_inverted_index.models	6, 14, 45
abstract_inverted_index.recent	1
abstract_inverted_index.report	67
abstract_inverted_index.actions	82
abstract_inverted_index.elusive	32
abstract_inverted_index.explain	69
abstract_inverted_index.factual	105
abstract_inverted_index.however	33
abstract_inverted_index.leading	56
abstract_inverted_index.problem	27
abstract_inverted_index.signals	108
abstract_inverted_index.success	3
abstract_inverted_index.variety	22
abstract_inverted_index.Finally,	85
abstract_inverted_index.actions"	55
abstract_inverted_index.adaptive	36
abstract_inverted_index.domains.	24
abstract_inverted_index.language	5
abstract_inverted_index.resolved	79
abstract_inverted_index.sequence	13, 44
abstract_inverted_index.training	103
abstract_inverted_index.treating	81
abstract_inverted_index.Currently	38
abstract_inverted_index.a\nsystem	95
abstract_inverted_index.behavior.	37
abstract_inverted_index.condition	97
abstract_inverted_index.important	26
abstract_inverted_index.incorrect	60
abstract_inverted_index.intervene	99
abstract_inverted_index.learning,	91
abstract_inverted_index.research,	10
abstract_inverted_index.cause\nand	51
abstract_inverted_index.delusions.	64
abstract_inverted_index.inferences	61
abstract_inverted_index.perception	42
abstract_inverted_index.phenomenal	2
abstract_inverted_index.purposeful	35
abstract_inverted_index.supervised	90
abstract_inverted_index.transformers	17
abstract_inverted_index.reinvigorated	8
abstract_inverted_index.understanding	48
abstract_inverted_index.being\napplied	19
abstract_inverted_index.respectively.\n	109
abstract_inverted_index.machine\nlearning	9
abstract_inverted_index.and\ncounterfactual	106
abstract_inverted_index.to\nauto-suggestive	63
abstract_inverted_index.remained\nrelatively	31
abstract_inverted_index.mismatch\noriginates,	72
abstract_inverted_index.causal\ninterventions.	84
cited_by_percentile_year.max	99
cited_by_percentile_year.min	96
countries_distinct_count	0
institutions_distinct_count	19
sustainable_development_goals[0].id	https://metadata.un.org/sdg/4
sustainable_development_goals[0].score	0.6299999952316284
sustainable_development_goals[0].display_name	Quality Education
citation_normalized_percentile.value	0.91910343
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	True