To Trust or Distrust Trust Measures: Validating Questionnaires for Trust in AI Article Swipe
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2403.00582
Despite the importance of trust in human-AI interactions, researchers must adopt questionnaires from other disciplines that lack validation in the AI context. Motivated by the need for reliable and valid measures, we investigated the psychometric quality of two trust questionnaires, the Trust between People and Automation scale (TPA) by Jian et al. (2000) and the Trust Scale for the AI Context (TAI) by Hoffman et al. (2023). In a pre-registered online experiment (N = 1485), participants observed interactions with trustworthy and untrustworthy AI (autonomous vehicle and chatbot). Results support the psychometric quality of the TAI while revealing opportunities to improve the TPA, which we outline in our recommendations for using the two questionnaires. Furthermore, our findings provide additional empirical evidence of trust and distrust as two distinct constructs that may coexist independently. Building on our findings, we highlight the opportunities and added value of measuring both trust and distrust in human-AI research and advocate for further work on both constructs.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2403.00582
- https://arxiv.org/pdf/2403.00582
- OA Status
- green
- Cited By
- 4
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4392427637
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4392427637Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2403.00582Digital Object Identifier
- Title
-
To Trust or Distrust Trust Measures: Validating Questionnaires for Trust in AIWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-03-01Full publication date if available
- Authors
-
Nicolas Scharowski, Sebastian A. C. Perrig, Lena Fanya Aeschbach, Nick von Felten, Klaus Opwis, Philipp Wintersberger, Florian BrühlmannList of authors in order
- Landing page
-
https://arxiv.org/abs/2403.00582Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2403.00582Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2403.00582Direct OA link when available
- Concepts
-
Distrust, Trustworthiness, Psychology, Public trust, Social psychology, Business, Political science, Public relations, PsychotherapistTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
4Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 4Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4392427637 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2403.00582 |
| ids.doi | https://doi.org/10.48550/arxiv.2403.00582 |
| ids.openalex | https://openalex.org/W4392427637 |
| fwci | |
| type | preprint |
| title | To Trust or Distrust Trust Measures: Validating Questionnaires for Trust in AI |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12026 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.8220999836921692 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1702 |
| topics[0].subfield.display_name | Artificial Intelligence |
| topics[0].display_name | Explainable Artificial Intelligence (XAI) |
| topics[1].id | https://openalex.org/T10927 |
| topics[1].field.id | https://openalex.org/fields/33 |
| topics[1].field.display_name | Social Sciences |
| topics[1].score | 0.7071999907493591 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/3312 |
| topics[1].subfield.display_name | Sociology and Political Science |
| topics[1].display_name | Access Control and Trust |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2778321746 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9734363555908203 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q621922 |
| concepts[0].display_name | Distrust |
| concepts[1].id | https://openalex.org/C153701036 |
| concepts[1].level | 2 |
| concepts[1].score | 0.5317203998565674 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q659974 |
| concepts[1].display_name | Trustworthiness |
| concepts[2].id | https://openalex.org/C15744967 |
| concepts[2].level | 0 |
| concepts[2].score | 0.4572541117668152 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[2].display_name | Psychology |
| concepts[3].id | https://openalex.org/C2777825026 |
| concepts[3].level | 2 |
| concepts[3].score | 0.42410963773727417 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q3410431 |
| concepts[3].display_name | Public trust |
| concepts[4].id | https://openalex.org/C77805123 |
| concepts[4].level | 1 |
| concepts[4].score | 0.3688593804836273 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q161272 |
| concepts[4].display_name | Social psychology |
| concepts[5].id | https://openalex.org/C144133560 |
| concepts[5].level | 0 |
| concepts[5].score | 0.36679327487945557 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q4830453 |
| concepts[5].display_name | Business |
| concepts[6].id | https://openalex.org/C17744445 |
| concepts[6].level | 0 |
| concepts[6].score | 0.3502156138420105 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q36442 |
| concepts[6].display_name | Political science |
| concepts[7].id | https://openalex.org/C39549134 |
| concepts[7].level | 1 |
| concepts[7].score | 0.2980155348777771 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q133080 |
| concepts[7].display_name | Public relations |
| concepts[8].id | https://openalex.org/C542102704 |
| concepts[8].level | 1 |
| concepts[8].score | 0.0 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q183257 |
| concepts[8].display_name | Psychotherapist |
| keywords[0].id | https://openalex.org/keywords/distrust |
| keywords[0].score | 0.9734363555908203 |
| keywords[0].display_name | Distrust |
| keywords[1].id | https://openalex.org/keywords/trustworthiness |
| keywords[1].score | 0.5317203998565674 |
| keywords[1].display_name | Trustworthiness |
| keywords[2].id | https://openalex.org/keywords/psychology |
| keywords[2].score | 0.4572541117668152 |
| keywords[2].display_name | Psychology |
| keywords[3].id | https://openalex.org/keywords/public-trust |
| keywords[3].score | 0.42410963773727417 |
| keywords[3].display_name | Public trust |
| keywords[4].id | https://openalex.org/keywords/social-psychology |
| keywords[4].score | 0.3688593804836273 |
| keywords[4].display_name | Social psychology |
| keywords[5].id | https://openalex.org/keywords/business |
| keywords[5].score | 0.36679327487945557 |
| keywords[5].display_name | Business |
| keywords[6].id | https://openalex.org/keywords/political-science |
| keywords[6].score | 0.3502156138420105 |
| keywords[6].display_name | Political science |
| keywords[7].id | https://openalex.org/keywords/public-relations |
| keywords[7].score | 0.2980155348777771 |
| keywords[7].display_name | Public relations |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2403.00582 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2403.00582 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2403.00582 |
| locations[1].id | doi:10.48550/arxiv.2403.00582 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2403.00582 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5073186689 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-5983-346X |
| authorships[0].author.display_name | Nicolas Scharowski |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Scharowski, Nicolas |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5072853760 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-4301-8206 |
| authorships[1].author.display_name | Sebastian A. C. Perrig |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Perrig, Sebastian A. C. |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5045926341 |
| authorships[2].author.orcid | https://orcid.org/0000-0001-9092-6103 |
| authorships[2].author.display_name | Lena Fanya Aeschbach |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Aeschbach, Lena Fanya |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5066534572 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-0278-9896 |
| authorships[3].author.display_name | Nick von Felten |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | von Felten, Nick |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5050235442 |
| authorships[4].author.orcid | https://orcid.org/0000-0003-0509-8070 |
| authorships[4].author.display_name | Klaus Opwis |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Opwis, Klaus |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5082850934 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-9287-3770 |
| authorships[5].author.display_name | Philipp Wintersberger |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Wintersberger, Philipp |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5080631961 |
| authorships[6].author.orcid | https://orcid.org/0000-0001-8945-3273 |
| authorships[6].author.display_name | Florian Brühlmann |
| authorships[6].author_position | last |
| authorships[6].raw_author_name | Brühlmann, Florian |
| authorships[6].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2403.00582 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | To Trust or Distrust Trust Measures: Validating Questionnaires for Trust in AI |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12026 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.8220999836921692 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1702 |
| primary_topic.subfield.display_name | Artificial Intelligence |
| primary_topic.display_name | Explainable Artificial Intelligence (XAI) |
| related_works | https://openalex.org/W3099737524, https://openalex.org/W4392012396, https://openalex.org/W2035706118, https://openalex.org/W2183426483, https://openalex.org/W2183676324, https://openalex.org/W2041428054, https://openalex.org/W2340387507, https://openalex.org/W4205825248, https://openalex.org/W4206322726, https://openalex.org/W3200097369 |
| cited_by_count | 4 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 4 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2403.00582 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2403.00582 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2403.00582 |
| primary_location.id | pmh:oai:arXiv.org:2403.00582 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2403.00582 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2403.00582 |
| publication_date | 2024-03-01 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.= | 73 |
| abstract_inverted_index.a | 68 |
| abstract_inverted_index.(N | 72 |
| abstract_inverted_index.AI | 20, 59, 82 |
| abstract_inverted_index.In | 67 |
| abstract_inverted_index.as | 124 |
| abstract_inverted_index.by | 23, 48, 62 |
| abstract_inverted_index.et | 50, 64 |
| abstract_inverted_index.in | 5, 18, 105, 149 |
| abstract_inverted_index.of | 3, 36, 92, 120, 143 |
| abstract_inverted_index.on | 133, 157 |
| abstract_inverted_index.to | 98 |
| abstract_inverted_index.we | 31, 103, 136 |
| abstract_inverted_index.TAI | 94 |
| abstract_inverted_index.al. | 51, 65 |
| abstract_inverted_index.and | 28, 44, 53, 80, 85, 122, 140, 147, 152 |
| abstract_inverted_index.for | 26, 57, 108, 154 |
| abstract_inverted_index.may | 129 |
| abstract_inverted_index.our | 106, 114, 134 |
| abstract_inverted_index.the | 1, 19, 24, 33, 40, 54, 58, 89, 93, 100, 110, 138 |
| abstract_inverted_index.two | 37, 111, 125 |
| abstract_inverted_index.Jian | 49 |
| abstract_inverted_index.TPA, | 101 |
| abstract_inverted_index.both | 145, 158 |
| abstract_inverted_index.from | 12 |
| abstract_inverted_index.lack | 16 |
| abstract_inverted_index.must | 9 |
| abstract_inverted_index.need | 25 |
| abstract_inverted_index.that | 15, 128 |
| abstract_inverted_index.with | 78 |
| abstract_inverted_index.work | 156 |
| abstract_inverted_index.(TAI) | 61 |
| abstract_inverted_index.(TPA) | 47 |
| abstract_inverted_index.Scale | 56 |
| abstract_inverted_index.Trust | 41, 55 |
| abstract_inverted_index.added | 141 |
| abstract_inverted_index.adopt | 10 |
| abstract_inverted_index.other | 13 |
| abstract_inverted_index.scale | 46 |
| abstract_inverted_index.trust | 4, 38, 121, 146 |
| abstract_inverted_index.using | 109 |
| abstract_inverted_index.valid | 29 |
| abstract_inverted_index.value | 142 |
| abstract_inverted_index.which | 102 |
| abstract_inverted_index.while | 95 |
| abstract_inverted_index.(2000) | 52 |
| abstract_inverted_index.1485), | 74 |
| abstract_inverted_index.People | 43 |
| abstract_inverted_index.online | 70 |
| abstract_inverted_index.(2023). | 66 |
| abstract_inverted_index.Context | 60 |
| abstract_inverted_index.Despite | 0 |
| abstract_inverted_index.Hoffman | 63 |
| abstract_inverted_index.Results | 87 |
| abstract_inverted_index.between | 42 |
| abstract_inverted_index.coexist | 130 |
| abstract_inverted_index.further | 155 |
| abstract_inverted_index.improve | 99 |
| abstract_inverted_index.outline | 104 |
| abstract_inverted_index.provide | 116 |
| abstract_inverted_index.quality | 35, 91 |
| abstract_inverted_index.support | 88 |
| abstract_inverted_index.vehicle | 84 |
| abstract_inverted_index.Building | 132 |
| abstract_inverted_index.advocate | 153 |
| abstract_inverted_index.context. | 21 |
| abstract_inverted_index.distinct | 126 |
| abstract_inverted_index.distrust | 123, 148 |
| abstract_inverted_index.evidence | 119 |
| abstract_inverted_index.findings | 115 |
| abstract_inverted_index.human-AI | 6, 150 |
| abstract_inverted_index.observed | 76 |
| abstract_inverted_index.reliable | 27 |
| abstract_inverted_index.research | 151 |
| abstract_inverted_index.Motivated | 22 |
| abstract_inverted_index.chatbot). | 86 |
| abstract_inverted_index.empirical | 118 |
| abstract_inverted_index.findings, | 135 |
| abstract_inverted_index.highlight | 137 |
| abstract_inverted_index.measures, | 30 |
| abstract_inverted_index.measuring | 144 |
| abstract_inverted_index.revealing | 96 |
| abstract_inverted_index.Automation | 45 |
| abstract_inverted_index.additional | 117 |
| abstract_inverted_index.constructs | 127 |
| abstract_inverted_index.experiment | 71 |
| abstract_inverted_index.importance | 2 |
| abstract_inverted_index.validation | 17 |
| abstract_inverted_index.(autonomous | 83 |
| abstract_inverted_index.constructs. | 159 |
| abstract_inverted_index.disciplines | 14 |
| abstract_inverted_index.researchers | 8 |
| abstract_inverted_index.trustworthy | 79 |
| abstract_inverted_index.Furthermore, | 113 |
| abstract_inverted_index.interactions | 77 |
| abstract_inverted_index.investigated | 32 |
| abstract_inverted_index.participants | 75 |
| abstract_inverted_index.psychometric | 34, 90 |
| abstract_inverted_index.interactions, | 7 |
| abstract_inverted_index.opportunities | 97, 139 |
| abstract_inverted_index.untrustworthy | 81 |
| abstract_inverted_index.independently. | 131 |
| abstract_inverted_index.pre-registered | 69 |
| abstract_inverted_index.questionnaires | 11 |
| abstract_inverted_index.questionnaires, | 39 |
| abstract_inverted_index.questionnaires. | 112 |
| abstract_inverted_index.recommendations | 107 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 7 |
| citation_normalized_percentile |