Improved Measures with the Experimental Psychometrics Framework Article Swipe
This paper proposes the experimental psychometrics framework, an approach that integrates causal inference and experimental design, representational measurement theory, and data theory to enhance psychological measurement. The framework addresses limitations of traditional psychometric methods by emphasizing the need for experimental control to account for sources of systematic error and to test the assumptions underlying psychometric models. It is argued that past propositions found in the literature have demonstrated how experimental manipulation can improve the validity of measures and provide better tests of theoretical expectations. However, the application of experimental manipulation and causal modeling as tool for assessing the abstract structure of the data, that can be tested from a representational measurement theory perspective are not well developed. Two empirical examples are presented to illustrate how the experimental psychometrics framework offers a structured approach for deriving more robust and replicable measurements. This work contributes to the growing discourse on improving the rigor of psychological measurement and theory, advocating for a more experimentally-driven and theory-informed approach. The potential for this framework to reshape psychometric practices is significant, promising to enhance the accuracy, validity, and reliability of psychological assessments.
Related Topics
Concepts
Psychometrics
Reliability (semiconductor)
Inference
Perspective (graphical)
Causal inference
Computer science
Psychological Theory
Test theory
Experimental data
Psychology
Item response theory
Data science
Cognitive psychology
Econometrics
Artificial intelligence
Social psychology
Clinical psychology
Mathematics
Statistics
Power (physics)
Quantum mechanics
Physics
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- https://doi.org/10.31234/osf.io/2rv6b
- https://osf.io/2rv6b/download
- OA Status
- gold
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4404567150
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4404567150Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.31234/osf.io/2rv6bDigital Object Identifier
- Title
-
Improved Measures with the Experimental Psychometrics FrameworkWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-11-20Full publication date if available
- Authors
-
Víthor Rosa FrancoList of authors in order
- Landing page
-
https://doi.org/10.31234/osf.io/2rv6bPublisher landing page
- PDF URL
-
https://osf.io/2rv6b/downloadDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://osf.io/2rv6b/downloadDirect OA link when available
- Concepts
-
Psychometrics, Reliability (semiconductor), Inference, Perspective (graphical), Causal inference, Computer science, Psychological Theory, Test theory, Experimental data, Psychology, Item response theory, Data science, Cognitive psychology, Econometrics, Artificial intelligence, Social psychology, Clinical psychology, Mathematics, Statistics, Power (physics), Quantum mechanics, PhysicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4404567150 |
|---|---|
| doi | https://doi.org/10.31234/osf.io/2rv6b |
| ids.doi | https://doi.org/10.31234/osf.io/2rv6b |
| ids.openalex | https://openalex.org/W4404567150 |
| fwci | 0.0 |
| type | preprint |
| title | Improved Measures with the Experimental Psychometrics Framework |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T13283 |
| topics[0].field.id | https://openalex.org/fields/32 |
| topics[0].field.display_name | Psychology |
| topics[0].score | 0.9970999956130981 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3205 |
| topics[0].subfield.display_name | Experimental and Cognitive Psychology |
| topics[0].display_name | Mental Health Research Topics |
| topics[1].id | https://openalex.org/T10241 |
| topics[1].field.id | https://openalex.org/fields/28 |
| topics[1].field.display_name | Neuroscience |
| topics[1].score | 0.980400025844574 |
| topics[1].domain.id | https://openalex.org/domains/1 |
| topics[1].domain.display_name | Life Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2805 |
| topics[1].subfield.display_name | Cognitive Neuroscience |
| topics[1].display_name | Functional Brain Connectivity Studies |
| topics[2].id | https://openalex.org/T10042 |
| topics[2].field.id | https://openalex.org/fields/28 |
| topics[2].field.display_name | Neuroscience |
| topics[2].score | 0.9528999924659729 |
| topics[2].domain.id | https://openalex.org/domains/1 |
| topics[2].domain.display_name | Life Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2805 |
| topics[2].subfield.display_name | Cognitive Neuroscience |
| topics[2].display_name | Neural and Behavioral Psychology Studies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C171606756 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6982370018959045 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q506132 |
| concepts[0].display_name | Psychometrics |
| concepts[1].id | https://openalex.org/C43214815 |
| concepts[1].level | 3 |
| concepts[1].score | 0.605899453163147 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q7310987 |
| concepts[1].display_name | Reliability (semiconductor) |
| concepts[2].id | https://openalex.org/C2776214188 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6003215312957764 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q408386 |
| concepts[2].display_name | Inference |
| concepts[3].id | https://openalex.org/C12713177 |
| concepts[3].level | 2 |
| concepts[3].score | 0.558539092540741 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q1900281 |
| concepts[3].display_name | Perspective (graphical) |
| concepts[4].id | https://openalex.org/C158600405 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5399508476257324 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q5054566 |
| concepts[4].display_name | Causal inference |
| concepts[5].id | https://openalex.org/C41008148 |
| concepts[5].level | 0 |
| concepts[5].score | 0.48120763897895813 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[5].display_name | Computer science |
| concepts[6].id | https://openalex.org/C2910200283 |
| concepts[6].level | 2 |
| concepts[6].score | 0.47980883717536926 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[6].display_name | Psychological Theory |
| concepts[7].id | https://openalex.org/C74143277 |
| concepts[7].level | 3 |
| concepts[7].score | 0.4580927789211273 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q7705812 |
| concepts[7].display_name | Test theory |
| concepts[8].id | https://openalex.org/C55037315 |
| concepts[8].level | 2 |
| concepts[8].score | 0.43612876534461975 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q5421151 |
| concepts[8].display_name | Experimental data |
| concepts[9].id | https://openalex.org/C15744967 |
| concepts[9].level | 0 |
| concepts[9].score | 0.42319566011428833 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[9].display_name | Psychology |
| concepts[10].id | https://openalex.org/C19875794 |
| concepts[10].level | 3 |
| concepts[10].score | 0.4163247346878052 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q1207340 |
| concepts[10].display_name | Item response theory |
| concepts[11].id | https://openalex.org/C2522767166 |
| concepts[11].level | 1 |
| concepts[11].score | 0.35754650831222534 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[11].display_name | Data science |
| concepts[12].id | https://openalex.org/C180747234 |
| concepts[12].level | 1 |
| concepts[12].score | 0.3428463041782379 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q23373 |
| concepts[12].display_name | Cognitive psychology |
| concepts[13].id | https://openalex.org/C149782125 |
| concepts[13].level | 1 |
| concepts[13].score | 0.25750043988227844 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q160039 |
| concepts[13].display_name | Econometrics |
| concepts[14].id | https://openalex.org/C154945302 |
| concepts[14].level | 1 |
| concepts[14].score | 0.245059072971344 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[14].display_name | Artificial intelligence |
| concepts[15].id | https://openalex.org/C77805123 |
| concepts[15].level | 1 |
| concepts[15].score | 0.23751065135002136 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q161272 |
| concepts[15].display_name | Social psychology |
| concepts[16].id | https://openalex.org/C70410870 |
| concepts[16].level | 1 |
| concepts[16].score | 0.11922866106033325 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q199906 |
| concepts[16].display_name | Clinical psychology |
| concepts[17].id | https://openalex.org/C33923547 |
| concepts[17].level | 0 |
| concepts[17].score | 0.11433729529380798 |
| concepts[17].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[17].display_name | Mathematics |
| concepts[18].id | https://openalex.org/C105795698 |
| concepts[18].level | 1 |
| concepts[18].score | 0.0929836630821228 |
| concepts[18].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[18].display_name | Statistics |
| concepts[19].id | https://openalex.org/C163258240 |
| concepts[19].level | 2 |
| concepts[19].score | 0.0 |
| concepts[19].wikidata | https://www.wikidata.org/wiki/Q25342 |
| concepts[19].display_name | Power (physics) |
| concepts[20].id | https://openalex.org/C62520636 |
| concepts[20].level | 1 |
| concepts[20].score | 0.0 |
| concepts[20].wikidata | https://www.wikidata.org/wiki/Q944 |
| concepts[20].display_name | Quantum mechanics |
| concepts[21].id | https://openalex.org/C121332964 |
| concepts[21].level | 0 |
| concepts[21].score | 0.0 |
| concepts[21].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[21].display_name | Physics |
| keywords[0].id | https://openalex.org/keywords/psychometrics |
| keywords[0].score | 0.6982370018959045 |
| keywords[0].display_name | Psychometrics |
| keywords[1].id | https://openalex.org/keywords/reliability |
| keywords[1].score | 0.605899453163147 |
| keywords[1].display_name | Reliability (semiconductor) |
| keywords[2].id | https://openalex.org/keywords/inference |
| keywords[2].score | 0.6003215312957764 |
| keywords[2].display_name | Inference |
| keywords[3].id | https://openalex.org/keywords/perspective |
| keywords[3].score | 0.558539092540741 |
| keywords[3].display_name | Perspective (graphical) |
| keywords[4].id | https://openalex.org/keywords/causal-inference |
| keywords[4].score | 0.5399508476257324 |
| keywords[4].display_name | Causal inference |
| keywords[5].id | https://openalex.org/keywords/computer-science |
| keywords[5].score | 0.48120763897895813 |
| keywords[5].display_name | Computer science |
| keywords[6].id | https://openalex.org/keywords/psychological-theory |
| keywords[6].score | 0.47980883717536926 |
| keywords[6].display_name | Psychological Theory |
| keywords[7].id | https://openalex.org/keywords/test-theory |
| keywords[7].score | 0.4580927789211273 |
| keywords[7].display_name | Test theory |
| keywords[8].id | https://openalex.org/keywords/experimental-data |
| keywords[8].score | 0.43612876534461975 |
| keywords[8].display_name | Experimental data |
| keywords[9].id | https://openalex.org/keywords/psychology |
| keywords[9].score | 0.42319566011428833 |
| keywords[9].display_name | Psychology |
| keywords[10].id | https://openalex.org/keywords/item-response-theory |
| keywords[10].score | 0.4163247346878052 |
| keywords[10].display_name | Item response theory |
| keywords[11].id | https://openalex.org/keywords/data-science |
| keywords[11].score | 0.35754650831222534 |
| keywords[11].display_name | Data science |
| keywords[12].id | https://openalex.org/keywords/cognitive-psychology |
| keywords[12].score | 0.3428463041782379 |
| keywords[12].display_name | Cognitive psychology |
| keywords[13].id | https://openalex.org/keywords/econometrics |
| keywords[13].score | 0.25750043988227844 |
| keywords[13].display_name | Econometrics |
| keywords[14].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[14].score | 0.245059072971344 |
| keywords[14].display_name | Artificial intelligence |
| keywords[15].id | https://openalex.org/keywords/social-psychology |
| keywords[15].score | 0.23751065135002136 |
| keywords[15].display_name | Social psychology |
| keywords[16].id | https://openalex.org/keywords/clinical-psychology |
| keywords[16].score | 0.11922866106033325 |
| keywords[16].display_name | Clinical psychology |
| keywords[17].id | https://openalex.org/keywords/mathematics |
| keywords[17].score | 0.11433729529380798 |
| keywords[17].display_name | Mathematics |
| keywords[18].id | https://openalex.org/keywords/statistics |
| keywords[18].score | 0.0929836630821228 |
| keywords[18].display_name | Statistics |
| language | en |
| locations[0].id | doi:10.31234/osf.io/2rv6b |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://osf.io/2rv6b/download |
| locations[0].version | acceptedVersion |
| locations[0].raw_type | posted-content |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.31234/osf.io/2rv6b |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5044797587 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-8929-3238 |
| authorships[0].author.display_name | Víthor Rosa Franco |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Víthor Rosa Franco |
| authorships[0].is_corresponding | True |
| has_content.pdf | True |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://osf.io/2rv6b/download |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Improved Measures with the Experimental Psychometrics Framework |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T13283 |
| primary_topic.field.id | https://openalex.org/fields/32 |
| primary_topic.field.display_name | Psychology |
| primary_topic.score | 0.9970999956130981 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3205 |
| primary_topic.subfield.display_name | Experimental and Cognitive Psychology |
| primary_topic.display_name | Mental Health Research Topics |
| related_works | https://openalex.org/W3116551622, https://openalex.org/W1484128031, https://openalex.org/W2975773103, https://openalex.org/W290369651, https://openalex.org/W2366053398, https://openalex.org/W1921901555, https://openalex.org/W1551136666, https://openalex.org/W1989318716, https://openalex.org/W2883625061, https://openalex.org/W2110702196 |
| cited_by_count | 0 |
| locations_count | 1 |
| best_oa_location.id | doi:10.31234/osf.io/2rv6b |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://osf.io/2rv6b/download |
| best_oa_location.version | acceptedVersion |
| best_oa_location.raw_type | posted-content |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.31234/osf.io/2rv6b |
| primary_location.id | doi:10.31234/osf.io/2rv6b |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://osf.io/2rv6b/download |
| primary_location.version | acceptedVersion |
| primary_location.raw_type | posted-content |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.31234/osf.io/2rv6b |
| publication_date | 2024-11-20 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 108, 130, 158 |
| abstract_inverted_index.It | 56 |
| abstract_inverted_index.an | 7 |
| abstract_inverted_index.as | 93 |
| abstract_inverted_index.be | 105 |
| abstract_inverted_index.by | 34 |
| abstract_inverted_index.in | 63 |
| abstract_inverted_index.is | 57, 173 |
| abstract_inverted_index.of | 30, 45, 75, 81, 87, 100, 151, 183 |
| abstract_inverted_index.on | 147 |
| abstract_inverted_index.to | 22, 41, 49, 122, 143, 169, 176 |
| abstract_inverted_index.The | 26, 164 |
| abstract_inverted_index.Two | 117 |
| abstract_inverted_index.and | 13, 19, 48, 77, 90, 137, 154, 161, 181 |
| abstract_inverted_index.are | 113, 120 |
| abstract_inverted_index.can | 71, 104 |
| abstract_inverted_index.for | 38, 43, 95, 133, 157, 166 |
| abstract_inverted_index.how | 68, 124 |
| abstract_inverted_index.not | 114 |
| abstract_inverted_index.the | 3, 36, 51, 64, 73, 85, 97, 101, 125, 144, 149, 178 |
| abstract_inverted_index.This | 0, 140 |
| abstract_inverted_index.data | 20 |
| abstract_inverted_index.from | 107 |
| abstract_inverted_index.have | 66 |
| abstract_inverted_index.more | 135, 159 |
| abstract_inverted_index.need | 37 |
| abstract_inverted_index.past | 60 |
| abstract_inverted_index.test | 50 |
| abstract_inverted_index.that | 9, 59, 103 |
| abstract_inverted_index.this | 167 |
| abstract_inverted_index.tool | 94 |
| abstract_inverted_index.well | 115 |
| abstract_inverted_index.work | 141 |
| abstract_inverted_index.data, | 102 |
| abstract_inverted_index.error | 47 |
| abstract_inverted_index.found | 62 |
| abstract_inverted_index.paper | 1 |
| abstract_inverted_index.rigor | 150 |
| abstract_inverted_index.tests | 80 |
| abstract_inverted_index.argued | 58 |
| abstract_inverted_index.better | 79 |
| abstract_inverted_index.causal | 11, 91 |
| abstract_inverted_index.offers | 129 |
| abstract_inverted_index.robust | 136 |
| abstract_inverted_index.tested | 106 |
| abstract_inverted_index.theory | 21, 111 |
| abstract_inverted_index.account | 42 |
| abstract_inverted_index.control | 40 |
| abstract_inverted_index.design, | 15 |
| abstract_inverted_index.enhance | 23, 177 |
| abstract_inverted_index.growing | 145 |
| abstract_inverted_index.improve | 72 |
| abstract_inverted_index.methods | 33 |
| abstract_inverted_index.models. | 55 |
| abstract_inverted_index.provide | 78 |
| abstract_inverted_index.reshape | 170 |
| abstract_inverted_index.sources | 44 |
| abstract_inverted_index.theory, | 18, 155 |
| abstract_inverted_index.However, | 84 |
| abstract_inverted_index.abstract | 98 |
| abstract_inverted_index.approach | 8, 132 |
| abstract_inverted_index.deriving | 134 |
| abstract_inverted_index.examples | 119 |
| abstract_inverted_index.measures | 76 |
| abstract_inverted_index.modeling | 92 |
| abstract_inverted_index.proposes | 2 |
| abstract_inverted_index.validity | 74 |
| abstract_inverted_index.accuracy, | 179 |
| abstract_inverted_index.addresses | 28 |
| abstract_inverted_index.approach. | 163 |
| abstract_inverted_index.assessing | 96 |
| abstract_inverted_index.discourse | 146 |
| abstract_inverted_index.empirical | 118 |
| abstract_inverted_index.framework | 27, 128, 168 |
| abstract_inverted_index.improving | 148 |
| abstract_inverted_index.inference | 12 |
| abstract_inverted_index.potential | 165 |
| abstract_inverted_index.practices | 172 |
| abstract_inverted_index.presented | 121 |
| abstract_inverted_index.promising | 175 |
| abstract_inverted_index.structure | 99 |
| abstract_inverted_index.validity, | 180 |
| abstract_inverted_index.advocating | 156 |
| abstract_inverted_index.developed. | 116 |
| abstract_inverted_index.framework, | 6 |
| abstract_inverted_index.illustrate | 123 |
| abstract_inverted_index.integrates | 10 |
| abstract_inverted_index.literature | 65 |
| abstract_inverted_index.replicable | 138 |
| abstract_inverted_index.structured | 131 |
| abstract_inverted_index.systematic | 46 |
| abstract_inverted_index.underlying | 53 |
| abstract_inverted_index.application | 86 |
| abstract_inverted_index.assumptions | 52 |
| abstract_inverted_index.contributes | 142 |
| abstract_inverted_index.emphasizing | 35 |
| abstract_inverted_index.limitations | 29 |
| abstract_inverted_index.measurement | 17, 110, 153 |
| abstract_inverted_index.perspective | 112 |
| abstract_inverted_index.reliability | 182 |
| abstract_inverted_index.theoretical | 82 |
| abstract_inverted_index.traditional | 31 |
| abstract_inverted_index.assessments. | 185 |
| abstract_inverted_index.demonstrated | 67 |
| abstract_inverted_index.experimental | 4, 14, 39, 69, 88, 126 |
| abstract_inverted_index.manipulation | 70, 89 |
| abstract_inverted_index.measurement. | 25 |
| abstract_inverted_index.propositions | 61 |
| abstract_inverted_index.psychometric | 32, 54, 171 |
| abstract_inverted_index.significant, | 174 |
| abstract_inverted_index.expectations. | 83 |
| abstract_inverted_index.measurements. | 139 |
| abstract_inverted_index.psychological | 24, 152, 184 |
| abstract_inverted_index.psychometrics | 5, 127 |
| abstract_inverted_index.theory-informed | 162 |
| abstract_inverted_index.representational | 16, 109 |
| abstract_inverted_index.experimentally-driven | 160 |
| cited_by_percentile_year | |
| corresponding_author_ids | https://openalex.org/A5044797587 |
| countries_distinct_count | 0 |
| institutions_distinct_count | 1 |
| citation_normalized_percentile.value | 0.29389107 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |