Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values? Article Swipe

PDF

Hua Shen , Nicholas A. Clark , Tanushree Mitra ·

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2501.15463

Existing research primarily evaluates the values of LLMs by examining their stated inclinations towards specific values. However, the "Value-Action Gap," a phenomenon rooted in environmental and social psychology, reveals discrepancies between individuals' stated values and their actions in real-world contexts. To what extent do LLMs exhibit a similar gap between their stated values and their actions informed by those values? This study introduces ValueActionLens, an evaluation framework to assess the alignment between LLMs' stated values and their value-informed actions. The framework encompasses the generation of a dataset comprising 14.8k value-informed actions across twelve cultures and eleven social topics, and two tasks to evaluate how well LLMs' stated value inclinations and value-informed actions align across three different alignment measures. Extensive experiments reveal that the alignment between LLMs' stated values and actions is sub-optimal, varying significantly across scenarios and models. Analysis of misaligned results identifies potential harms from certain value-action gaps. To predict the value-action gaps, we also uncover that leveraging reasoned explanations improves performance. These findings underscore the risks of relying solely on the LLMs' stated values to predict their behaviors and emphasize the importance of context-aware evaluations of LLM values and value-action gaps.

Related Topics

Concepts

Action (physics) Value (mathematics) Political science Psychology Mathematics Physics Statistics Quantum mechanics

Metadata

Type: preprint
Language: en
Landing Page: http://arxiv.org/abs/2501.15463
PDF: https://arxiv.org/pdf/2501.15463
OA Status: green
Related Works: 10
OpenAlex ID: https://openalex.org/W4406880626

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4406880626

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.48550/arxiv.2501.15463

Digital Object Identifier
Title: Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?

Work title
Type: preprint

OpenAlex work type
Language: en

Primary language
Publication year: 2025

Year of publication
Publication date: 2025-01-26

Full publication date if available
Authors: Hua Shen, Nicholas A. Clark, Tanushree Mitra

List of authors in order
Landing page: https://arxiv.org/abs/2501.15463

Publisher landing page
PDF URL: https://arxiv.org/pdf/2501.15463

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: green

Open access status per OpenAlex
OA URL: https://arxiv.org/pdf/2501.15463

Direct OA link when available
Concepts: Action (physics), Value (mathematics), Political science, Psychology, Mathematics, Physics, Statistics, Quantum mechanics

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4406880626
doi	https://doi.org/10.48550/arxiv.2501.15463
ids.doi	https://doi.org/10.48550/arxiv.2501.15463
ids.openalex	https://openalex.org/W4406880626
fwci
type	preprint
title	Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?
biblio.issue
biblio.volume
biblio.last_page
biblio.first_page
topics[0].id	https://openalex.org/T13713
topics[0].field.id	https://openalex.org/fields/20
topics[0].field.display_name	Economics, Econometrics and Finance
topics[0].score	0.7982000112533569
topics[0].domain.id	https://openalex.org/domains/2
topics[0].domain.display_name	Social Sciences
topics[0].subfield.id	https://openalex.org/subfields/2002
topics[0].subfield.display_name	Economics and Econometrics
topics[0].display_name	Diverse Perspectives in Modern Studies
topics[1].id	https://openalex.org/T13972
topics[1].field.id	https://openalex.org/fields/14
topics[1].field.display_name	Business, Management and Accounting
topics[1].score	0.7139999866485596
topics[1].domain.id	https://openalex.org/domains/2
topics[1].domain.display_name	Social Sciences
topics[1].subfield.id	https://openalex.org/subfields/1402
topics[1].subfield.display_name	Accounting
topics[1].display_name	Business Law and Ethics
topics[2].id	https://openalex.org/T12509
topics[2].field.id	https://openalex.org/fields/14
topics[2].field.display_name	Business, Management and Accounting
topics[2].score	0.6894999742507935
topics[2].domain.id	https://openalex.org/domains/2
topics[2].domain.display_name	Social Sciences
topics[2].subfield.id	https://openalex.org/subfields/1402
topics[2].subfield.display_name	Accounting
topics[2].display_name	Corporate Insolvency and Governance
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C2780791683
concepts[0].level	2
concepts[0].score	0.669893741607666
concepts[0].wikidata	https://www.wikidata.org/wiki/Q846785
concepts[0].display_name	Action (physics)
concepts[1].id	https://openalex.org/C2776291640
concepts[1].level	2
concepts[1].score	0.6453637480735779
concepts[1].wikidata	https://www.wikidata.org/wiki/Q2912517
concepts[1].display_name	Value (mathematics)
concepts[2].id	https://openalex.org/C17744445
concepts[2].level	0
concepts[2].score	0.37770789861679077
concepts[2].wikidata	https://www.wikidata.org/wiki/Q36442
concepts[2].display_name	Political science
concepts[3].id	https://openalex.org/C15744967
concepts[3].level	0
concepts[3].score	0.33963361382484436
concepts[3].wikidata	https://www.wikidata.org/wiki/Q9418
concepts[3].display_name	Psychology
concepts[4].id	https://openalex.org/C33923547
concepts[4].level	0
concepts[4].score	0.14461490511894226
concepts[4].wikidata	https://www.wikidata.org/wiki/Q395
concepts[4].display_name	Mathematics
concepts[5].id	https://openalex.org/C121332964
concepts[5].level	0
concepts[5].score	0.09356856346130371
concepts[5].wikidata	https://www.wikidata.org/wiki/Q413
concepts[5].display_name	Physics
concepts[6].id	https://openalex.org/C105795698
concepts[6].level	1
concepts[6].score	0.08310481905937195
concepts[6].wikidata	https://www.wikidata.org/wiki/Q12483
concepts[6].display_name	Statistics
concepts[7].id	https://openalex.org/C62520636
concepts[7].level	1
concepts[7].score	0.0
concepts[7].wikidata	https://www.wikidata.org/wiki/Q944
concepts[7].display_name	Quantum mechanics
keywords[0].id	https://openalex.org/keywords/action
keywords[0].score	0.669893741607666
keywords[0].display_name	Action (physics)
keywords[1].id	https://openalex.org/keywords/value
keywords[1].score	0.6453637480735779
keywords[1].display_name	Value (mathematics)
keywords[2].id	https://openalex.org/keywords/political-science
keywords[2].score	0.37770789861679077
keywords[2].display_name	Political science
keywords[3].id	https://openalex.org/keywords/psychology
keywords[3].score	0.33963361382484436
keywords[3].display_name	Psychology
keywords[4].id	https://openalex.org/keywords/mathematics
keywords[4].score	0.14461490511894226
keywords[4].display_name	Mathematics
keywords[5].id	https://openalex.org/keywords/physics
keywords[5].score	0.09356856346130371
keywords[5].display_name	Physics
keywords[6].id	https://openalex.org/keywords/statistics
keywords[6].score	0.08310481905937195
keywords[6].display_name	Statistics
language	en
locations[0].id	pmh:oai:arXiv.org:2501.15463
locations[0].is_oa	True
locations[0].source.id	https://openalex.org/S4306400194
locations[0].source.issn
locations[0].source.type	repository
locations[0].source.is_oa	True
locations[0].source.issn_l
locations[0].source.is_core	False
locations[0].source.is_in_doaj	False
locations[0].source.display_name	arXiv (Cornell University)
locations[0].source.host_organization	https://openalex.org/I205783295
locations[0].source.host_organization_name	Cornell University
locations[0].source.host_organization_lineage	https://openalex.org/I205783295
locations[0].license
locations[0].pdf_url	https://arxiv.org/pdf/2501.15463
locations[0].version	submittedVersion
locations[0].raw_type	text
locations[0].license_id
locations[0].is_accepted	False
locations[0].is_published	False
locations[0].raw_source_name
locations[0].landing_page_url	http://arxiv.org/abs/2501.15463
locations[1].id	doi:10.48550/arxiv.2501.15463
locations[1].is_oa	True
locations[1].source.id	https://openalex.org/S4306400194
locations[1].source.issn
locations[1].source.type	repository
locations[1].source.is_oa	True
locations[1].source.issn_l
locations[1].source.is_core	False
locations[1].source.is_in_doaj	False
locations[1].source.display_name	arXiv (Cornell University)
locations[1].source.host_organization	https://openalex.org/I205783295
locations[1].source.host_organization_name	Cornell University
locations[1].source.host_organization_lineage	https://openalex.org/I205783295
locations[1].license
locations[1].pdf_url
locations[1].version
locations[1].raw_type	article
locations[1].license_id
locations[1].is_accepted	False
locations[1].is_published
locations[1].raw_source_name
locations[1].landing_page_url	https://doi.org/10.48550/arxiv.2501.15463
indexed_in	arxiv, datacite
authorships[0].author.id	https://openalex.org/A5073404039
authorships[0].author.orcid	https://orcid.org/0009-0008-6300-5710
authorships[0].author.display_name	Hua Shen
authorships[0].author_position	first
authorships[0].raw_author_name	Shen, Hua
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5034948347
authorships[1].author.orcid	https://orcid.org/0000-0003-0105-9605
authorships[1].author.display_name	Nicholas A. Clark
authorships[1].author_position	middle
authorships[1].raw_author_name	Clark, Nicholas
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5062498796
authorships[2].author.orcid	https://orcid.org/0000-0002-9507-6192
authorships[2].author.display_name	Tanushree Mitra
authorships[2].author_position	last
authorships[2].raw_author_name	Mitra, Tanushree
authorships[2].is_corresponding	False
has_content.pdf	False
has_content.grobid_xml	False
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://arxiv.org/pdf/2501.15463
open_access.oa_status	green
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T06:51:31.235846
primary_topic.id	https://openalex.org/T13713
primary_topic.field.id	https://openalex.org/fields/20
primary_topic.field.display_name	Economics, Econometrics and Finance
primary_topic.score	0.7982000112533569
primary_topic.domain.id	https://openalex.org/domains/2
primary_topic.domain.display_name	Social Sciences
primary_topic.subfield.id	https://openalex.org/subfields/2002
primary_topic.subfield.display_name	Economics and Econometrics
primary_topic.display_name	Diverse Perspectives in Modern Studies
related_works	https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2931662336, https://openalex.org/W2077865380, https://openalex.org/W3006817050, https://openalex.org/W4401768695, https://openalex.org/W2765597752, https://openalex.org/W2134894512, https://openalex.org/W4212921133
cited_by_count	0
locations_count	2
best_oa_location.id	pmh:oai:arXiv.org:2501.15463
best_oa_location.is_oa	True
best_oa_location.source.id	https://openalex.org/S4306400194
best_oa_location.source.issn
best_oa_location.source.type	repository
best_oa_location.source.is_oa	True
best_oa_location.source.issn_l
best_oa_location.source.is_core	False
best_oa_location.source.is_in_doaj	False
best_oa_location.source.display_name	arXiv (Cornell University)
best_oa_location.source.host_organization	https://openalex.org/I205783295
best_oa_location.source.host_organization_name	Cornell University
best_oa_location.source.host_organization_lineage	https://openalex.org/I205783295
best_oa_location.license
best_oa_location.pdf_url	https://arxiv.org/pdf/2501.15463
best_oa_location.version	submittedVersion
best_oa_location.raw_type	text
best_oa_location.license_id
best_oa_location.is_accepted	False
best_oa_location.is_published	False
best_oa_location.raw_source_name
best_oa_location.landing_page_url	http://arxiv.org/abs/2501.15463
primary_location.id	pmh:oai:arXiv.org:2501.15463
primary_location.is_oa	True
primary_location.source.id	https://openalex.org/S4306400194
primary_location.source.issn
primary_location.source.type	repository
primary_location.source.is_oa	True
primary_location.source.issn_l
primary_location.source.is_core	False
primary_location.source.is_in_doaj	False
primary_location.source.display_name	arXiv (Cornell University)
primary_location.source.host_organization	https://openalex.org/I205783295
primary_location.source.host_organization_name	Cornell University
primary_location.source.host_organization_lineage	https://openalex.org/I205783295
primary_location.license
primary_location.pdf_url	https://arxiv.org/pdf/2501.15463
primary_location.version	submittedVersion
primary_location.raw_type	text
primary_location.license_id
primary_location.is_accepted	False
primary_location.is_published	False
primary_location.raw_source_name
primary_location.landing_page_url	http://arxiv.org/abs/2501.15463
publication_date	2025-01-26
publication_year	2025
referenced_works_count	0
abstract_inverted_index.a	20, 46, 85
abstract_inverted_index.To	40, 149
abstract_inverted_index.an	64
abstract_inverted_index.by	8, 57
abstract_inverted_index.do	43
abstract_inverted_index.in	23, 37
abstract_inverted_index.is	130
abstract_inverted_index.of	6, 84, 139, 168, 184, 187
abstract_inverted_index.on	171
abstract_inverted_index.to	67, 101, 176
abstract_inverted_index.we	154
abstract_inverted_index.LLM	188
abstract_inverted_index.The	79
abstract_inverted_index.and	25, 34, 53, 75, 94, 98, 109, 128, 136, 180, 190
abstract_inverted_index.gap	48
abstract_inverted_index.how	103
abstract_inverted_index.the	4, 17, 69, 82, 122, 151, 166, 172, 182
abstract_inverted_index.two	99
abstract_inverted_index.LLMs	7, 44
abstract_inverted_index.This	60
abstract_inverted_index.also	155
abstract_inverted_index.from	145
abstract_inverted_index.that	121, 157
abstract_inverted_index.well	104
abstract_inverted_index.what	41
abstract_inverted_index.14.8k	88
abstract_inverted_index.Gap,"	19
abstract_inverted_index.LLMs'	72, 105, 125, 173
abstract_inverted_index.These	163
abstract_inverted_index.align	112
abstract_inverted_index.gaps,	153
abstract_inverted_index.gaps.	148, 192
abstract_inverted_index.harms	144
abstract_inverted_index.risks	167
abstract_inverted_index.study	61
abstract_inverted_index.tasks	100
abstract_inverted_index.their	10, 35, 50, 54, 76, 178
abstract_inverted_index.those	58
abstract_inverted_index.three	114
abstract_inverted_index.value	107
abstract_inverted_index.across	91, 113, 134
abstract_inverted_index.assess	68
abstract_inverted_index.eleven	95
abstract_inverted_index.extent	42
abstract_inverted_index.reveal	120
abstract_inverted_index.rooted	22
abstract_inverted_index.social	26, 96
abstract_inverted_index.solely	170
abstract_inverted_index.stated	11, 32, 51, 73, 106, 126, 174
abstract_inverted_index.twelve	92
abstract_inverted_index.values	5, 33, 52, 74, 127, 175, 189
abstract_inverted_index.actions	36, 55, 90, 111, 129
abstract_inverted_index.between	30, 49, 71, 124
abstract_inverted_index.certain	146
abstract_inverted_index.dataset	86
abstract_inverted_index.exhibit	45
abstract_inverted_index.models.	137
abstract_inverted_index.predict	150, 177
abstract_inverted_index.relying	169
abstract_inverted_index.results	141
abstract_inverted_index.reveals	28
abstract_inverted_index.similar	47
abstract_inverted_index.topics,	97
abstract_inverted_index.towards	13
abstract_inverted_index.uncover	156
abstract_inverted_index.values.	15
abstract_inverted_index.values?	59
abstract_inverted_index.varying	132
abstract_inverted_index.Analysis	138
abstract_inverted_index.Existing	0
abstract_inverted_index.However,	16
abstract_inverted_index.actions.	78
abstract_inverted_index.cultures	93
abstract_inverted_index.evaluate	102
abstract_inverted_index.findings	164
abstract_inverted_index.improves	161
abstract_inverted_index.informed	56
abstract_inverted_index.reasoned	159
abstract_inverted_index.research	1
abstract_inverted_index.specific	14
abstract_inverted_index.Extensive	118
abstract_inverted_index.alignment	70, 116, 123
abstract_inverted_index.behaviors	179
abstract_inverted_index.contexts.	39
abstract_inverted_index.different	115
abstract_inverted_index.emphasize	181
abstract_inverted_index.evaluates	3
abstract_inverted_index.examining	9
abstract_inverted_index.framework	66, 80
abstract_inverted_index.measures.	117
abstract_inverted_index.potential	143
abstract_inverted_index.primarily	2
abstract_inverted_index.scenarios	135
abstract_inverted_index.comprising	87
abstract_inverted_index.evaluation	65
abstract_inverted_index.generation	83
abstract_inverted_index.identifies	142
abstract_inverted_index.importance	183
abstract_inverted_index.introduces	62
abstract_inverted_index.leveraging	158
abstract_inverted_index.misaligned	140
abstract_inverted_index.phenomenon	21
abstract_inverted_index.real-world	38
abstract_inverted_index.underscore	165
abstract_inverted_index.encompasses	81
abstract_inverted_index.evaluations	186
abstract_inverted_index.experiments	119
abstract_inverted_index.psychology,	27
abstract_inverted_index.explanations	160
abstract_inverted_index.inclinations	12, 108
abstract_inverted_index.individuals'	31
abstract_inverted_index.performance.	162
abstract_inverted_index.sub-optimal,	131
abstract_inverted_index.value-action	147, 152, 191
abstract_inverted_index."Value-Action	18
abstract_inverted_index.context-aware	185
abstract_inverted_index.discrepancies	29
abstract_inverted_index.environmental	24
abstract_inverted_index.significantly	133
abstract_inverted_index.value-informed	77, 89, 110
abstract_inverted_index.ValueActionLens,	63
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	3
citation_normalized_percentile