Dynamics of striatal action selection and reinforcement learning Article Swipe

View

Jack Lindsey , Jeffrey E. Markowitz , Winthrop F. Gillis , Sandeep Robert Datta , Ashok Litwin-Kumar ·

YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.7554/elife.101747.1

Spiny projection neurons (SPNs) in dorsal striatum are often proposed as a locus of reinforcement learning in the basal ganglia. Here, we identify and resolve a fundamental inconsistency between striatal reinforcement learning models and known SPN synaptic plasticity rules. Direct-pathway (dSPN) and indirect-pathway (iSPN) neurons, which promote and suppress actions, respectively, exhibit synaptic plasticity that reinforces activity associated with elevated or suppressed dopamine release. We show that iSPN plasticity prevents successful learning, as it reinforces activity patterns associated with negative outcomes. However, this pathological behavior is reversed if functionally opponent dSPNs and iSPNs, which promote and suppress the current behavior, are simultaneously activated by efferent input following action selection. This prediction is supported by striatal recordings and contrasts with prior models of SPN representations. In our model, learning and action selection signals can be multiplexed without interference, enabling learning algorithms beyond those of standard temporal difference models.

Related Topics

Reinforcement Learning

Artificial Intelligence

Biology

Perception

Physics

Central Nervous System

Social Psychology

Biochemistry

Concepts

Reinforcement learning Neuroscience Medium spiny neuron Action selection Striatum Basal ganglia Indirect pathway of movement Reinforcement Psychology Synaptic plasticity Plasticity Dopamine Computer science Artificial intelligence Biology Perception Physics Central nervous system Social psychology Biochemistry Receptor Thermodynamics

Metadata

Type: preprint
Language: en
Landing Page: https://doi.org/10.7554/elife.101747.1
OA Status: gold
Cited By: 2
References: 69
Related Works: 10
OpenAlex ID: https://openalex.org/W4405105404

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4405105404

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.7554/elife.101747.1

Digital Object Identifier
Title: Dynamics of striatal action selection and reinforcement learning

Work title
Type: preprint

OpenAlex work type
Language: en

Primary language
Publication year: 2024

Year of publication
Publication date: 2024-12-06

Full publication date if available
Authors: Jack Lindsey, Jeffrey E. Markowitz, Winthrop F. Gillis, Sandeep Robert Datta, Ashok Litwin-Kumar

List of authors in order
Landing page: https://doi.org/10.7554/elife.101747.1

Publisher landing page
Open access: Yes

Whether a free full text is available
OA status: gold

Open access status per OpenAlex
OA URL: https://doi.org/10.7554/elife.101747.1

Direct OA link when available
Concepts: Reinforcement learning, Neuroscience, Medium spiny neuron, Action selection, Striatum, Basal ganglia, Indirect pathway of movement, Reinforcement, Psychology, Synaptic plasticity, Plasticity, Dopamine, Computer science, Artificial intelligence, Biology, Perception, Physics, Central nervous system, Social psychology, Biochemistry, Receptor, Thermodynamics

Top concepts (fields/topics) attached by OpenAlex
Cited by: 2

Total citation count in OpenAlex
Citations by year (recent): 2025: 1, 2019: 1

Per-year citation counts (last 5 years)
References (count): 69

Number of works referenced by this work
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4405105404
doi	https://doi.org/10.7554/elife.101747.1
ids.doi	https://doi.org/10.7554/elife.101747.1
ids.openalex	https://openalex.org/W4405105404
fwci	0.52712871
type	preprint
title	Dynamics of striatal action selection and reinforcement learning
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T10056
topics[0].field.id	https://openalex.org/fields/28
topics[0].field.display_name	Neuroscience
topics[0].score	0.9995999932289124
topics[0].domain.id	https://openalex.org/domains/1
topics[0].domain.display_name	Life Sciences
topics[0].subfield.id	https://openalex.org/subfields/2804
topics[0].subfield.display_name	Cellular and Molecular Neuroscience
topics[0].display_name	Neurotransmitter Receptor Influence on Behavior
topics[1].id	https://openalex.org/T10919
topics[1].field.id	https://openalex.org/fields/27
topics[1].field.display_name	Medicine
topics[1].score	0.9987000226974487
topics[1].domain.id	https://openalex.org/domains/4
topics[1].domain.display_name	Health Sciences
topics[1].subfield.id	https://openalex.org/subfields/2728
topics[1].subfield.display_name	Neurology
topics[1].display_name	Neurological disorders and treatments
topics[2].id	https://openalex.org/T10077
topics[2].field.id	https://openalex.org/fields/28
topics[2].field.display_name	Neuroscience
topics[2].score	0.9976999759674072
topics[2].domain.id	https://openalex.org/domains/1
topics[2].domain.display_name	Life Sciences
topics[2].subfield.id	https://openalex.org/subfields/2804
topics[2].subfield.display_name	Cellular and Molecular Neuroscience
topics[2].display_name	Neuroscience and Neuropharmacology Research
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C97541855
concepts[0].level	2
concepts[0].score	0.740601658821106
concepts[0].wikidata	https://www.wikidata.org/wiki/Q830687
concepts[0].display_name	Reinforcement learning
concepts[1].id	https://openalex.org/C169760540
concepts[1].level	1
concepts[1].score	0.6913309097290039
concepts[1].wikidata	https://www.wikidata.org/wiki/Q207011
concepts[1].display_name	Neuroscience
concepts[2].id	https://openalex.org/C85714458
concepts[2].level	4
concepts[2].score	0.6808072924613953
concepts[2].wikidata	https://www.wikidata.org/wiki/Q17152690
concepts[2].display_name	Medium spiny neuron
concepts[3].id	https://openalex.org/C166109690
concepts[3].level	3
concepts[3].score	0.6599115133285522
concepts[3].wikidata	https://www.wikidata.org/wiki/Q4677422
concepts[3].display_name	Action selection
concepts[4].id	https://openalex.org/C2780062018
concepts[4].level	3
concepts[4].score	0.6392147541046143
concepts[4].wikidata	https://www.wikidata.org/wiki/Q1319792
concepts[4].display_name	Striatum
concepts[5].id	https://openalex.org/C2778187257
concepts[5].level	3
concepts[5].score	0.5935584306716919
concepts[5].wikidata	https://www.wikidata.org/wiki/Q464210
concepts[5].display_name	Basal ganglia
concepts[6].id	https://openalex.org/C162536842
concepts[6].level	4
concepts[6].score	0.5538710355758667
concepts[6].wikidata	https://www.wikidata.org/wiki/Q6025117
concepts[6].display_name	Indirect pathway of movement
concepts[7].id	https://openalex.org/C67203356
concepts[7].level	2
concepts[7].score	0.5228505730628967
concepts[7].wikidata	https://www.wikidata.org/wiki/Q1321905
concepts[7].display_name	Reinforcement
concepts[8].id	https://openalex.org/C15744967
concepts[8].level	0
concepts[8].score	0.45320653915405273
concepts[8].wikidata	https://www.wikidata.org/wiki/Q9418
concepts[8].display_name	Psychology
concepts[9].id	https://openalex.org/C98229152
concepts[9].level	3
concepts[9].score	0.4308548867702484
concepts[9].wikidata	https://www.wikidata.org/wiki/Q1551556
concepts[9].display_name	Synaptic plasticity
concepts[10].id	https://openalex.org/C79186407
concepts[10].level	2
concepts[10].score	0.4141595959663391
concepts[10].wikidata	https://www.wikidata.org/wiki/Q472074
concepts[10].display_name	Plasticity
concepts[11].id	https://openalex.org/C513476851
concepts[11].level	2
concepts[11].score	0.3862478733062744
concepts[11].wikidata	https://www.wikidata.org/wiki/Q170304
concepts[11].display_name	Dopamine
concepts[12].id	https://openalex.org/C41008148
concepts[12].level	0
concepts[12].score	0.3211422562599182
concepts[12].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[12].display_name	Computer science
concepts[13].id	https://openalex.org/C154945302
concepts[13].level	1
concepts[13].score	0.28942131996154785
concepts[13].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[13].display_name	Artificial intelligence
concepts[14].id	https://openalex.org/C86803240
concepts[14].level	0
concepts[14].score	0.20926225185394287
concepts[14].wikidata	https://www.wikidata.org/wiki/Q420
concepts[14].display_name	Biology
concepts[15].id	https://openalex.org/C26760741
concepts[15].level	2
concepts[15].score	0.1575491726398468
concepts[15].wikidata	https://www.wikidata.org/wiki/Q160402
concepts[15].display_name	Perception
concepts[16].id	https://openalex.org/C121332964
concepts[16].level	0
concepts[16].score	0.11236023902893066
concepts[16].wikidata	https://www.wikidata.org/wiki/Q413
concepts[16].display_name	Physics
concepts[17].id	https://openalex.org/C529278444
concepts[17].level	2
concepts[17].score	0.08018079400062561
concepts[17].wikidata	https://www.wikidata.org/wiki/Q47273
concepts[17].display_name	Central nervous system
concepts[18].id	https://openalex.org/C77805123
concepts[18].level	1
concepts[18].score	0.0
concepts[18].wikidata	https://www.wikidata.org/wiki/Q161272
concepts[18].display_name	Social psychology
concepts[19].id	https://openalex.org/C55493867
concepts[19].level	1
concepts[19].score	0.0
concepts[19].wikidata	https://www.wikidata.org/wiki/Q7094
concepts[19].display_name	Biochemistry
concepts[20].id	https://openalex.org/C170493617
concepts[20].level	2
concepts[20].score	0.0
concepts[20].wikidata	https://www.wikidata.org/wiki/Q208467
concepts[20].display_name	Receptor
concepts[21].id	https://openalex.org/C97355855
concepts[21].level	1
concepts[21].score	0.0
concepts[21].wikidata	https://www.wikidata.org/wiki/Q11473
concepts[21].display_name	Thermodynamics
keywords[0].id	https://openalex.org/keywords/reinforcement-learning
keywords[0].score	0.740601658821106
keywords[0].display_name	Reinforcement learning
keywords[1].id	https://openalex.org/keywords/neuroscience
keywords[1].score	0.6913309097290039
keywords[1].display_name	Neuroscience
keywords[2].id	https://openalex.org/keywords/medium-spiny-neuron
keywords[2].score	0.6808072924613953
keywords[2].display_name	Medium spiny neuron
keywords[3].id	https://openalex.org/keywords/action-selection
keywords[3].score	0.6599115133285522
keywords[3].display_name	Action selection
keywords[4].id	https://openalex.org/keywords/striatum
keywords[4].score	0.6392147541046143
keywords[4].display_name	Striatum
keywords[5].id	https://openalex.org/keywords/basal-ganglia
keywords[5].score	0.5935584306716919
keywords[5].display_name	Basal ganglia
keywords[6].id	https://openalex.org/keywords/indirect-pathway-of-movement
keywords[6].score	0.5538710355758667
keywords[6].display_name	Indirect pathway of movement
keywords[7].id	https://openalex.org/keywords/reinforcement
keywords[7].score	0.5228505730628967
keywords[7].display_name	Reinforcement
keywords[8].id	https://openalex.org/keywords/psychology
keywords[8].score	0.45320653915405273
keywords[8].display_name	Psychology
keywords[9].id	https://openalex.org/keywords/synaptic-plasticity
keywords[9].score	0.4308548867702484
keywords[9].display_name	Synaptic plasticity
keywords[10].id	https://openalex.org/keywords/plasticity
keywords[10].score	0.4141595959663391
keywords[10].display_name	Plasticity
keywords[11].id	https://openalex.org/keywords/dopamine
keywords[11].score	0.3862478733062744
keywords[11].display_name	Dopamine
keywords[12].id	https://openalex.org/keywords/computer-science
keywords[12].score	0.3211422562599182
keywords[12].display_name	Computer science
keywords[13].id	https://openalex.org/keywords/artificial-intelligence
keywords[13].score	0.28942131996154785
keywords[13].display_name	Artificial intelligence
keywords[14].id	https://openalex.org/keywords/biology
keywords[14].score	0.20926225185394287
keywords[14].display_name	Biology
keywords[15].id	https://openalex.org/keywords/perception
keywords[15].score	0.1575491726398468
keywords[15].display_name	Perception
keywords[16].id	https://openalex.org/keywords/physics
keywords[16].score	0.11236023902893066
keywords[16].display_name	Physics
keywords[17].id	https://openalex.org/keywords/central-nervous-system
keywords[17].score	0.08018079400062561
keywords[17].display_name	Central nervous system
language	en
locations[0].id	doi:10.7554/elife.101747.1
locations[0].is_oa	True
locations[0].source
locations[0].license	cc-by
locations[0].pdf_url
locations[0].version	acceptedVersion
locations[0].raw_type	posted-content
locations[0].license_id	https://openalex.org/licenses/cc-by
locations[0].is_accepted	True
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	https://doi.org/10.7554/elife.101747.1
indexed_in	crossref
authorships[0].author.id	https://openalex.org/A5006832724
authorships[0].author.orcid	https://orcid.org/0000-0003-0930-7327
authorships[0].author.display_name	Jack Lindsey
authorships[0].countries	DE, US
authorships[0].affiliations[0].institution_ids	https://openalex.org/I4210113520, https://openalex.org/I78577930
authorships[0].affiliations[0].raw_affiliation_string	Zuckerman Mind Brain Behavior Institute, Columbia University
authorships[0].institutions[0].id	https://openalex.org/I4210113520
authorships[0].institutions[0].ror	https://ror.org/01gamcy45
authorships[0].institutions[0].type	company
authorships[0].institutions[0].lineage	https://openalex.org/I4210113520
authorships[0].institutions[0].country_code	DE
authorships[0].institutions[0].display_name	Brain (Germany)
authorships[0].institutions[1].id	https://openalex.org/I78577930
authorships[0].institutions[1].ror	https://ror.org/00hj8s172
authorships[0].institutions[1].type	education
authorships[0].institutions[1].lineage	https://openalex.org/I78577930
authorships[0].institutions[1].country_code	US
authorships[0].institutions[1].display_name	Columbia University
authorships[0].author_position	first
authorships[0].raw_author_name	Jack Lindsey
authorships[0].is_corresponding	False
authorships[0].raw_affiliation_strings	Zuckerman Mind Brain Behavior Institute, Columbia University
authorships[1].author.id	https://openalex.org/A5054782713
authorships[1].author.orcid	https://orcid.org/0000-0003-2362-1937
authorships[1].author.display_name	Jeffrey E. Markowitz
authorships[1].countries	US
authorships[1].affiliations[0].institution_ids	https://openalex.org/I130701444, https://openalex.org/I2802612298
authorships[1].affiliations[0].raw_affiliation_string	Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University
authorships[1].institutions[0].id	https://openalex.org/I130701444
authorships[1].institutions[0].ror	https://ror.org/01zkghx44
authorships[1].institutions[0].type	education
authorships[1].institutions[0].lineage	https://openalex.org/I130701444
authorships[1].institutions[0].country_code	US
authorships[1].institutions[0].display_name	Georgia Institute of Technology
authorships[1].institutions[1].id	https://openalex.org/I2802612298
authorships[1].institutions[1].ror	https://ror.org/02j15s898
authorships[1].institutions[1].type	education
authorships[1].institutions[1].lineage	https://openalex.org/I130701444, https://openalex.org/I150468666, https://openalex.org/I2802612298
authorships[1].institutions[1].country_code	US
authorships[1].institutions[1].display_name	The Wallace H. Coulter Department of Biomedical Engineering
authorships[1].author_position	middle
authorships[1].raw_author_name	Jeffrey E Markowitz
authorships[1].is_corresponding	False
authorships[1].raw_affiliation_strings	Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University
authorships[2].author.id	https://openalex.org/A5071807646
authorships[2].author.orcid	https://orcid.org/0000-0002-1659-8639
authorships[2].author.display_name	Winthrop F. Gillis
authorships[2].countries	US
authorships[2].affiliations[0].institution_ids	https://openalex.org/I136199984
authorships[2].affiliations[0].raw_affiliation_string	Department of Neurobiology, Harvard Medical School
authorships[2].institutions[0].id	https://openalex.org/I136199984
authorships[2].institutions[0].ror	https://ror.org/03vek6s52
authorships[2].institutions[0].type	education
authorships[2].institutions[0].lineage	https://openalex.org/I136199984
authorships[2].institutions[0].country_code	US
authorships[2].institutions[0].display_name	Harvard University
authorships[2].author_position	middle
authorships[2].raw_author_name	Winthrop F Gillis
authorships[2].is_corresponding	False
authorships[2].raw_affiliation_strings	Department of Neurobiology, Harvard Medical School
authorships[3].author.id	https://openalex.org/A5000350952
authorships[3].author.orcid	https://orcid.org/0000-0002-8068-3862
authorships[3].author.display_name	Sandeep Robert Datta
authorships[3].countries	US
authorships[3].affiliations[0].institution_ids	https://openalex.org/I136199984
authorships[3].affiliations[0].raw_affiliation_string	Department of Neurobiology, Harvard Medical School
authorships[3].institutions[0].id	https://openalex.org/I136199984
authorships[3].institutions[0].ror	https://ror.org/03vek6s52
authorships[3].institutions[0].type	education
authorships[3].institutions[0].lineage	https://openalex.org/I136199984
authorships[3].institutions[0].country_code	US
authorships[3].institutions[0].display_name	Harvard University
authorships[3].author_position	middle
authorships[3].raw_author_name	Sandeep Robert Datta
authorships[3].is_corresponding	False
authorships[3].raw_affiliation_strings	Department of Neurobiology, Harvard Medical School
authorships[4].author.id	https://openalex.org/A5020551914
authorships[4].author.orcid	https://orcid.org/0000-0003-2422-6576
authorships[4].author.display_name	Ashok Litwin-Kumar
authorships[4].countries	DE, US
authorships[4].affiliations[0].institution_ids	https://openalex.org/I4210113520, https://openalex.org/I78577930
authorships[4].affiliations[0].raw_affiliation_string	Zuckerman Mind Brain Behavior Institute, Columbia University
authorships[4].institutions[0].id	https://openalex.org/I4210113520
authorships[4].institutions[0].ror	https://ror.org/01gamcy45
authorships[4].institutions[0].type	company
authorships[4].institutions[0].lineage	https://openalex.org/I4210113520
authorships[4].institutions[0].country_code	DE
authorships[4].institutions[0].display_name	Brain (Germany)
authorships[4].institutions[1].id	https://openalex.org/I78577930
authorships[4].institutions[1].ror	https://ror.org/00hj8s172
authorships[4].institutions[1].type	education
authorships[4].institutions[1].lineage	https://openalex.org/I78577930
authorships[4].institutions[1].country_code	US
authorships[4].institutions[1].display_name	Columbia University
authorships[4].author_position	last
authorships[4].raw_author_name	Ashok Litwin-Kumar
authorships[4].is_corresponding	False
authorships[4].raw_affiliation_strings	Zuckerman Mind Brain Behavior Institute, Columbia University
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://doi.org/10.7554/elife.101747.1
open_access.oa_status	gold
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Dynamics of striatal action selection and reinforcement learning
has_fulltext	False
is_retracted	False
updated_date	2025-11-25T14:43:58.451035
primary_topic.id	https://openalex.org/T10056
primary_topic.field.id	https://openalex.org/fields/28
primary_topic.field.display_name	Neuroscience
primary_topic.score	0.9995999932289124
primary_topic.domain.id	https://openalex.org/domains/1
primary_topic.domain.display_name	Life Sciences
primary_topic.subfield.id	https://openalex.org/subfields/2804
primary_topic.subfield.display_name	Cellular and Molecular Neuroscience
primary_topic.display_name	Neurotransmitter Receptor Influence on Behavior
related_works	https://openalex.org/W2547372596, https://openalex.org/W2888570661, https://openalex.org/W2118830830, https://openalex.org/W2808795888, https://openalex.org/W3150486400, https://openalex.org/W2089643759, https://openalex.org/W2141716990, https://openalex.org/W2417473972, https://openalex.org/W2585455344, https://openalex.org/W2897576008
cited_by_count	2
counts_by_year[0].year	2025
counts_by_year[0].cited_by_count	1
counts_by_year[1].year	2019
counts_by_year[1].cited_by_count	1
locations_count	1
best_oa_location.id	doi:10.7554/elife.101747.1
best_oa_location.is_oa	True
best_oa_location.source
best_oa_location.license	cc-by
best_oa_location.pdf_url
best_oa_location.version	acceptedVersion
best_oa_location.raw_type	posted-content
best_oa_location.license_id	https://openalex.org/licenses/cc-by
best_oa_location.is_accepted	True
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	https://doi.org/10.7554/elife.101747.1
primary_location.id	doi:10.7554/elife.101747.1
primary_location.is_oa	True
primary_location.source
primary_location.license	cc-by
primary_location.pdf_url
primary_location.version	acceptedVersion
primary_location.raw_type	posted-content
primary_location.license_id	https://openalex.org/licenses/cc-by
primary_location.is_accepted	True
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	https://doi.org/10.7554/elife.101747.1
publication_date	2024-12-06
publication_year	2024
referenced_works	https://openalex.org/W3100789280, https://openalex.org/W2128238934, https://openalex.org/W2024365408, https://openalex.org/W2521836369, https://openalex.org/W2895540533, https://openalex.org/W2798091161, https://openalex.org/W2761617879, https://openalex.org/W4293082841, https://openalex.org/W2017934537, https://openalex.org/W4281640213, https://openalex.org/W1982670892, https://openalex.org/W1506311850, https://openalex.org/W4284893488, https://openalex.org/W2057029832, https://openalex.org/W3180104741, https://openalex.org/W1969089145, https://openalex.org/W2952557035, https://openalex.org/W1974471620, https://openalex.org/W2148038306, https://openalex.org/W2005291990, https://openalex.org/W2061691592, https://openalex.org/W2025542749, https://openalex.org/W2749662979, https://openalex.org/W1976284302, https://openalex.org/W1987953899, https://openalex.org/W1976710123, https://openalex.org/W2982531040, https://openalex.org/W3011755845, https://openalex.org/W2099641266, https://openalex.org/W4353018853, https://openalex.org/W2128562176, https://openalex.org/W1970585834, https://openalex.org/W4254152649, https://openalex.org/W1986352548, https://openalex.org/W1971797700, https://openalex.org/W3208538415, https://openalex.org/W3116416936, https://openalex.org/W6839820896, https://openalex.org/W2115515200, https://openalex.org/W2804636914, https://openalex.org/W4317390654, https://openalex.org/W2507447634, https://openalex.org/W2005269174, https://openalex.org/W6838833564, https://openalex.org/W1652173018, https://openalex.org/W2081030963, https://openalex.org/W2129478155, https://openalex.org/W2096240659, https://openalex.org/W2073003335, https://openalex.org/W3098022599, https://openalex.org/W3125348427, https://openalex.org/W2085376923, https://openalex.org/W3016724125, https://openalex.org/W2117726420, https://openalex.org/W2064319583, https://openalex.org/W1971999279, https://openalex.org/W3092771291, https://openalex.org/W3096933494, https://openalex.org/W2102248966, https://openalex.org/W2086841290, https://openalex.org/W4385950653, https://openalex.org/W1980046851, https://openalex.org/W2053214069, https://openalex.org/W4240046814, https://openalex.org/W2219858099, https://openalex.org/W41554520, https://openalex.org/W1607052939, https://openalex.org/W4386438420, https://openalex.org/W4283830785
referenced_works_count	69
abstract_inverted_index.a	12, 26
abstract_inverted_index.In	125
abstract_inverted_index.We	65
abstract_inverted_index.as	11, 73
abstract_inverted_index.be	134
abstract_inverted_index.by	104, 114
abstract_inverted_index.if	88
abstract_inverted_index.in	5, 17
abstract_inverted_index.is	86, 112
abstract_inverted_index.it	74
abstract_inverted_index.of	14, 122, 143
abstract_inverted_index.or	61
abstract_inverted_index.we	22
abstract_inverted_index.SPN	36, 123
abstract_inverted_index.and	24, 34, 42, 48, 92, 96, 117, 129
abstract_inverted_index.are	8, 101
abstract_inverted_index.can	133
abstract_inverted_index.our	126
abstract_inverted_index.the	18, 98
abstract_inverted_index.This	110
abstract_inverted_index.iSPN	68
abstract_inverted_index.show	66
abstract_inverted_index.that	55, 67
abstract_inverted_index.this	83
abstract_inverted_index.with	59, 79, 119
abstract_inverted_index.Here,	21
abstract_inverted_index.Spiny	1
abstract_inverted_index.basal	19
abstract_inverted_index.dSPNs	91
abstract_inverted_index.input	106
abstract_inverted_index.known	35
abstract_inverted_index.locus	13
abstract_inverted_index.often	9
abstract_inverted_index.prior	120
abstract_inverted_index.those	142
abstract_inverted_index.which	46, 94
abstract_inverted_index.(SPNs)	4
abstract_inverted_index.(dSPN)	41
abstract_inverted_index.(iSPN)	44
abstract_inverted_index.action	108, 130
abstract_inverted_index.beyond	141
abstract_inverted_index.dorsal	6
abstract_inverted_index.iSPNs,	93
abstract_inverted_index.model,	127
abstract_inverted_index.models	33, 121
abstract_inverted_index.rules.	39
abstract_inverted_index.between	29
abstract_inverted_index.current	99
abstract_inverted_index.exhibit	52
abstract_inverted_index.models.	147
abstract_inverted_index.neurons	3
abstract_inverted_index.promote	47, 95
abstract_inverted_index.resolve	25
abstract_inverted_index.signals	132
abstract_inverted_index.without	136
abstract_inverted_index.Abstract	0
abstract_inverted_index.However,	82
abstract_inverted_index.actions,	50
abstract_inverted_index.activity	57, 76
abstract_inverted_index.behavior	85
abstract_inverted_index.dopamine	63
abstract_inverted_index.efferent	105
abstract_inverted_index.elevated	60
abstract_inverted_index.enabling	138
abstract_inverted_index.ganglia.	20
abstract_inverted_index.identify	23
abstract_inverted_index.learning	16, 32, 128, 139
abstract_inverted_index.negative	80
abstract_inverted_index.neurons,	45
abstract_inverted_index.opponent	90
abstract_inverted_index.patterns	77
abstract_inverted_index.prevents	70
abstract_inverted_index.proposed	10
abstract_inverted_index.release.	64
abstract_inverted_index.reversed	87
abstract_inverted_index.standard	144
abstract_inverted_index.striatal	30, 115
abstract_inverted_index.striatum	7
abstract_inverted_index.suppress	49, 97
abstract_inverted_index.synaptic	37, 53
abstract_inverted_index.temporal	145
abstract_inverted_index.activated	103
abstract_inverted_index.behavior,	100
abstract_inverted_index.contrasts	118
abstract_inverted_index.following	107
abstract_inverted_index.learning,	72
abstract_inverted_index.outcomes.	81
abstract_inverted_index.selection	131
abstract_inverted_index.supported	113
abstract_inverted_index.algorithms	140
abstract_inverted_index.associated	58, 78
abstract_inverted_index.difference	146
abstract_inverted_index.plasticity	38, 54, 69
abstract_inverted_index.prediction	111
abstract_inverted_index.projection	2
abstract_inverted_index.recordings	116
abstract_inverted_index.reinforces	56, 75
abstract_inverted_index.selection.	109
abstract_inverted_index.successful	71
abstract_inverted_index.suppressed	62
abstract_inverted_index.fundamental	27
abstract_inverted_index.multiplexed	135
abstract_inverted_index.functionally	89
abstract_inverted_index.pathological	84
abstract_inverted_index.inconsistency	28
abstract_inverted_index.interference,	137
abstract_inverted_index.reinforcement	15, 31
abstract_inverted_index.respectively,	51
abstract_inverted_index.Direct-pathway	40
abstract_inverted_index.simultaneously	102
abstract_inverted_index.indirect-pathway	43
abstract_inverted_index.representations.	124
cited_by_percentile_year.max	95
cited_by_percentile_year.min	90
countries_distinct_count	2
institutions_distinct_count	5
citation_normalized_percentile.value	0.63436853
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	False