The process of replication target selection in psychology: what to consider? Article Swipe
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.1098/rsos.210586
Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.
Related Topics
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1098/rsos.210586
- OA Status
- gold
- Cited By
- 23
- References
- 59
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4318828009
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4318828009Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1098/rsos.210586Digital Object Identifier
- Title
-
The process of replication target selection in psychology: what to consider?Work title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2023Year of publication
- Publication date
-
2023-02-01Full publication date if available
- Authors
-
Merle-Marie Pittelkow, Sarahanne Field, Peder Mortvedt Isager, Anna van 't Veer, Thomas Anderson, Scott Cole, Tomáš Dominik, Roger Giner‐Sorolla, Sebahat Gok, Tom Heyman, Marc Jekel, Timothy J. Luke, David B. Mitchell, Rik Peels, Rosina Pendrous, Samuel Sarrazin, Jacob M. Schauer, Eva Specker, Ulrich S. Tran, Marek Vranka, Jelte M. Wicherts, Naoto Yoshimura, Rolf A. Zwaan, Don van RavenzwaaijList of authors in order
- Landing page
-
https://doi.org/10.1098/rsos.210586Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.1098/rsos.210586Direct OA link when available
- Concepts
-
Replication (statistics), Computer science, Selection (genetic algorithm), Credibility, Process (computing), Checklist, Psychology, Biology, Artificial intelligence, Cognitive psychology, Political science, Virology, Operating system, LawTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
23Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 14, 2024: 5, 2023: 4Per-year citation counts (last 5 years)
- References (count)
-
59Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4318828009 |
|---|---|
| doi | https://doi.org/10.1098/rsos.210586 |
| ids.doi | https://doi.org/10.1098/rsos.210586 |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/36756069 |
| ids.openalex | https://openalex.org/W4318828009 |
| fwci | 22.05820191 |
| type | article |
| title | The process of replication target selection in psychology: what to consider? |
| biblio.issue | 2 |
| biblio.volume | 10 |
| biblio.last_page | 210586 |
| biblio.first_page | 210586 |
| topics[0].id | https://openalex.org/T12443 |
| topics[0].field.id | https://openalex.org/fields/33 |
| topics[0].field.display_name | Social Sciences |
| topics[0].score | 0.9919999837875366 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3312 |
| topics[0].subfield.display_name | Sociology and Political Science |
| topics[0].display_name | Delphi Technique in Research |
| topics[1].id | https://openalex.org/T10206 |
| topics[1].field.id | https://openalex.org/fields/18 |
| topics[1].field.display_name | Decision Sciences |
| topics[1].score | 0.9760000109672546 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1804 |
| topics[1].subfield.display_name | Statistics, Probability and Uncertainty |
| topics[1].display_name | Meta-analysis and systematic reviews |
| topics[2].id | https://openalex.org/T10241 |
| topics[2].field.id | https://openalex.org/fields/28 |
| topics[2].field.display_name | Neuroscience |
| topics[2].score | 0.9542999863624573 |
| topics[2].domain.id | https://openalex.org/domains/1 |
| topics[2].domain.display_name | Life Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2805 |
| topics[2].subfield.display_name | Cognitive Neuroscience |
| topics[2].display_name | Functional Brain Connectivity Studies |
| is_xpac | False |
| apc_list.value | 1200 |
| apc_list.currency | GBP |
| apc_list.value_usd | 1471 |
| apc_paid.value | 1200 |
| apc_paid.currency | GBP |
| apc_paid.value_usd | 1471 |
| concepts[0].id | https://openalex.org/C12590798 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9150367379188538 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q3933199 |
| concepts[0].display_name | Replication (statistics) |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.6283352375030518 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C81917197 |
| concepts[2].level | 2 |
| concepts[2].score | 0.6180623173713684 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q628760 |
| concepts[2].display_name | Selection (genetic algorithm) |
| concepts[3].id | https://openalex.org/C2780224610 |
| concepts[3].level | 2 |
| concepts[3].score | 0.47580868005752563 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q1530061 |
| concepts[3].display_name | Credibility |
| concepts[4].id | https://openalex.org/C98045186 |
| concepts[4].level | 2 |
| concepts[4].score | 0.4371999204158783 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q205663 |
| concepts[4].display_name | Process (computing) |
| concepts[5].id | https://openalex.org/C2779356329 |
| concepts[5].level | 2 |
| concepts[5].score | 0.42252862453460693 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q922625 |
| concepts[5].display_name | Checklist |
| concepts[6].id | https://openalex.org/C15744967 |
| concepts[6].level | 0 |
| concepts[6].score | 0.3683544397354126 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[6].display_name | Psychology |
| concepts[7].id | https://openalex.org/C86803240 |
| concepts[7].level | 0 |
| concepts[7].score | 0.18027687072753906 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q420 |
| concepts[7].display_name | Biology |
| concepts[8].id | https://openalex.org/C154945302 |
| concepts[8].level | 1 |
| concepts[8].score | 0.17942607402801514 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[8].display_name | Artificial intelligence |
| concepts[9].id | https://openalex.org/C180747234 |
| concepts[9].level | 1 |
| concepts[9].score | 0.15980952978134155 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q23373 |
| concepts[9].display_name | Cognitive psychology |
| concepts[10].id | https://openalex.org/C17744445 |
| concepts[10].level | 0 |
| concepts[10].score | 0.11693641543388367 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q36442 |
| concepts[10].display_name | Political science |
| concepts[11].id | https://openalex.org/C159047783 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q7215 |
| concepts[11].display_name | Virology |
| concepts[12].id | https://openalex.org/C111919701 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q9135 |
| concepts[12].display_name | Operating system |
| concepts[13].id | https://openalex.org/C199539241 |
| concepts[13].level | 1 |
| concepts[13].score | 0.0 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q7748 |
| concepts[13].display_name | Law |
| keywords[0].id | https://openalex.org/keywords/replication |
| keywords[0].score | 0.9150367379188538 |
| keywords[0].display_name | Replication (statistics) |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.6283352375030518 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/selection |
| keywords[2].score | 0.6180623173713684 |
| keywords[2].display_name | Selection (genetic algorithm) |
| keywords[3].id | https://openalex.org/keywords/credibility |
| keywords[3].score | 0.47580868005752563 |
| keywords[3].display_name | Credibility |
| keywords[4].id | https://openalex.org/keywords/process |
| keywords[4].score | 0.4371999204158783 |
| keywords[4].display_name | Process (computing) |
| keywords[5].id | https://openalex.org/keywords/checklist |
| keywords[5].score | 0.42252862453460693 |
| keywords[5].display_name | Checklist |
| keywords[6].id | https://openalex.org/keywords/psychology |
| keywords[6].score | 0.3683544397354126 |
| keywords[6].display_name | Psychology |
| keywords[7].id | https://openalex.org/keywords/biology |
| keywords[7].score | 0.18027687072753906 |
| keywords[7].display_name | Biology |
| keywords[8].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[8].score | 0.17942607402801514 |
| keywords[8].display_name | Artificial intelligence |
| keywords[9].id | https://openalex.org/keywords/cognitive-psychology |
| keywords[9].score | 0.15980952978134155 |
| keywords[9].display_name | Cognitive psychology |
| keywords[10].id | https://openalex.org/keywords/political-science |
| keywords[10].score | 0.11693641543388367 |
| keywords[10].display_name | Political science |
| language | en |
| locations[0].id | doi:10.1098/rsos.210586 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S2737558550 |
| locations[0].source.issn | 2054-5703 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 2054-5703 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | Royal Society Open Science |
| locations[0].source.host_organization | https://openalex.org/P4310319787 |
| locations[0].source.host_organization_name | Royal Society |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319787 |
| locations[0].license | cc-by |
| locations[0].pdf_url | |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Royal Society Open Science |
| locations[0].landing_page_url | https://doi.org/10.1098/rsos.210586 |
| locations[1].id | pmid:36756069 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Royal Society open science |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/36756069 |
| locations[2].id | pmh:oai:ray.yorksj.ac.uk:7376 |
| locations[2].is_oa | False |
| locations[2].source.id | https://openalex.org/S4306400356 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | Research at York St John (York St John University) |
| locations[2].source.host_organization | https://openalex.org/I124246371 |
| locations[2].source.host_organization_name | York St John University |
| locations[2].source.host_organization_lineage | https://openalex.org/I124246371 |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | acceptedVersion |
| locations[2].raw_type | PeerReviewed |
| locations[2].license_id | |
| locations[2].is_accepted | True |
| locations[2].is_published | False |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | https://orcid.org/0000-0002-7487-7898 |
| locations[3].id | pmh:oai:kar.kent.ac.uk:99856 |
| locations[3].is_oa | False |
| locations[3].source.id | https://openalex.org/S4377196264 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | Kent Academic Repository (University of Kent) |
| locations[3].source.host_organization | https://openalex.org/I20581793 |
| locations[3].source.host_organization_name | University of Kent |
| locations[3].source.host_organization_lineage | https://openalex.org/I20581793 |
| locations[3].license | |
| locations[3].pdf_url | |
| locations[3].version | acceptedVersion |
| locations[3].raw_type | PeerReviewed |
| locations[3].license_id | |
| locations[3].is_accepted | True |
| locations[3].is_published | False |
| locations[3].raw_source_name | |
| locations[3].landing_page_url | https://doi.org/10.1098/rsos.210586>) |
| locations[4].id | pmh:oai:digitalcommons.kennesaw.edu:facpubs-8495 |
| locations[4].is_oa | False |
| locations[4].source | |
| locations[4].license | |
| locations[4].pdf_url | |
| locations[4].version | submittedVersion |
| locations[4].raw_type | text |
| locations[4].license_id | |
| locations[4].is_accepted | False |
| locations[4].is_published | False |
| locations[4].raw_source_name | Faculty and Research Publications |
| locations[4].landing_page_url | https://digitalcommons.kennesaw.edu/facpubs/7319 |
| locations[5].id | pmh:uvt:oai:tilburguniversity.edu:publications/32e8363b-41a8-4b67-b696-aafd27ece8cf |
| locations[5].is_oa | True |
| locations[5].source.id | https://openalex.org/S4306401843 |
| locations[5].source.issn | |
| locations[5].source.type | repository |
| locations[5].source.is_oa | False |
| locations[5].source.issn_l | |
| locations[5].source.is_core | False |
| locations[5].source.is_in_doaj | False |
| locations[5].source.display_name | Data Archiving and Networked Services (DANS) |
| locations[5].source.host_organization | https://openalex.org/I1322597698 |
| locations[5].source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| locations[5].source.host_organization_lineage | https://openalex.org/I1322597698 |
| locations[5].license | cc-by |
| locations[5].pdf_url | |
| locations[5].version | submittedVersion |
| locations[5].raw_type | info:eu-repo/semantics/article |
| locations[5].license_id | https://openalex.org/licenses/cc-by |
| locations[5].is_accepted | False |
| locations[5].is_published | False |
| locations[5].raw_source_name | Royal Society Open Science, 10(2):210586. ROYAL SOC |
| locations[5].landing_page_url | https://research.tilburguniversity.edu/en/publications/32e8363b-41a8-4b67-b696-aafd27ece8cf |
| locations[6].id | pmh:rug:oai:pure.rug.nl:publications/5c994805-2e87-45dc-92f7-36b6b320a0e8 |
| locations[6].is_oa | True |
| locations[6].source.id | https://openalex.org/S4306401843 |
| locations[6].source.issn | |
| locations[6].source.type | repository |
| locations[6].source.is_oa | False |
| locations[6].source.issn_l | |
| locations[6].source.is_core | False |
| locations[6].source.is_in_doaj | False |
| locations[6].source.display_name | Data Archiving and Networked Services (DANS) |
| locations[6].source.host_organization | https://openalex.org/I1322597698 |
| locations[6].source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| locations[6].source.host_organization_lineage | https://openalex.org/I1322597698 |
| locations[6].license | other-oa |
| locations[6].pdf_url | |
| locations[6].version | submittedVersion |
| locations[6].raw_type | info:eu-repo/semantics/article |
| locations[6].license_id | https://openalex.org/licenses/other-oa |
| locations[6].is_accepted | False |
| locations[6].is_published | False |
| locations[6].raw_source_name | Royal Society Open Science, 10(2):210586. ROYAL SOC |
| locations[6].landing_page_url | https://research.rug.nl/en/publications/5c994805-2e87-45dc-92f7-36b6b320a0e8 |
| locations[7].id | pmh:oai:pubmedcentral.nih.gov:9890109 |
| locations[7].is_oa | True |
| locations[7].source.id | https://openalex.org/S2764455111 |
| locations[7].source.issn | |
| locations[7].source.type | repository |
| locations[7].source.is_oa | False |
| locations[7].source.issn_l | |
| locations[7].source.is_core | False |
| locations[7].source.is_in_doaj | False |
| locations[7].source.display_name | PubMed Central |
| locations[7].source.host_organization | https://openalex.org/I1299303238 |
| locations[7].source.host_organization_name | National Institutes of Health |
| locations[7].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[7].license | cc-by |
| locations[7].pdf_url | |
| locations[7].version | submittedVersion |
| locations[7].raw_type | Text |
| locations[7].license_id | https://openalex.org/licenses/cc-by |
| locations[7].is_accepted | False |
| locations[7].is_published | False |
| locations[7].raw_source_name | R Soc Open Sci |
| locations[7].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/9890109 |
| locations[8].id | pmh:oai:research.vu.nl:publications/96a1982f-604e-4b38-b5a4-50e3d25d1ce5 |
| locations[8].is_oa | True |
| locations[8].source.id | https://openalex.org/S4306401107 |
| locations[8].source.issn | |
| locations[8].source.type | repository |
| locations[8].source.is_oa | False |
| locations[8].source.issn_l | |
| locations[8].source.is_core | False |
| locations[8].source.is_in_doaj | False |
| locations[8].source.display_name | VU Research Portal |
| locations[8].source.host_organization | https://openalex.org/I865915315 |
| locations[8].source.host_organization_name | Vrije Universiteit Amsterdam |
| locations[8].source.host_organization_lineage | https://openalex.org/I865915315 |
| locations[8].license | other-oa |
| locations[8].pdf_url | |
| locations[8].version | submittedVersion |
| locations[8].raw_type | article |
| locations[8].license_id | https://openalex.org/licenses/other-oa |
| locations[8].is_accepted | False |
| locations[8].is_published | False |
| locations[8].raw_source_name | Pittelkow , M M , Field , S M , Isager , P M , Van't Veer , A E , Anderson , T , Cole , S N , Dominik , T , Giner-Sorolla , R , Gok , S , Heyman , T , Jekel , M , Luke , T J , Mitchell , D B , Peels , R , Pendrous , R , Sarrazin , S , Schauer , J M , Specker , E , Tran , U S , Vranka , M A , Wicherts , J M , Yoshimura , N , Zwaan , R A & Van Ravenzwaaij , D 2023 , ' The process of replication target selection in psychology : what to consider? ' , Royal Society Open Science , vol. 10 , no. 2 , 210586 , pp. 1-31 . https://doi.org/10.1098/rsos.210586 |
| locations[8].landing_page_url | https://hdl.handle.net/1871.1/96a1982f-604e-4b38-b5a4-50e3d25d1ce5 |
| locations[9].id | pmh:oai:scholarlypublications.universiteitleiden.nl:item_3629850 |
| locations[9].is_oa | True |
| locations[9].source.id | https://openalex.org/S2737558550 |
| locations[9].source.issn | 2054-5703 |
| locations[9].source.type | journal |
| locations[9].source.is_oa | True |
| locations[9].source.issn_l | 2054-5703 |
| locations[9].source.is_core | True |
| locations[9].source.is_in_doaj | True |
| locations[9].source.display_name | Royal Society Open Science |
| locations[9].source.host_organization | https://openalex.org/P4310319787 |
| locations[9].source.host_organization_name | Royal Society |
| locations[9].source.host_organization_lineage | https://openalex.org/P4310319787 |
| locations[9].license | cc-by |
| locations[9].pdf_url | |
| locations[9].version | submittedVersion |
| locations[9].raw_type | Article / Letter to editor |
| locations[9].license_id | https://openalex.org/licenses/cc-by |
| locations[9].is_accepted | False |
| locations[9].is_published | False |
| locations[9].raw_source_name | Royal Society Open Science |
| locations[9].landing_page_url | https://hdl.handle.net/1887/3629850 |
| locations[10].id | pmh:oai:tilburguniversity.edu:publications/32e8363b-41a8-4b67-b696-aafd27ece8cf |
| locations[10].is_oa | True |
| locations[10].source.id | https://openalex.org/S4306401490 |
| locations[10].source.issn | |
| locations[10].source.type | repository |
| locations[10].source.is_oa | False |
| locations[10].source.issn_l | |
| locations[10].source.is_core | False |
| locations[10].source.is_in_doaj | False |
| locations[10].source.display_name | Research portal (Tilburg University) |
| locations[10].source.host_organization | https://openalex.org/I193700539 |
| locations[10].source.host_organization_name | Tilburg University |
| locations[10].source.host_organization_lineage | https://openalex.org/I193700539 |
| locations[10].license | cc-by |
| locations[10].pdf_url | |
| locations[10].version | submittedVersion |
| locations[10].raw_type | article |
| locations[10].license_id | https://openalex.org/licenses/cc-by |
| locations[10].is_accepted | False |
| locations[10].is_published | False |
| locations[10].raw_source_name | Pittelkow, M-M, Field, S M, Isager, P M, van't Veer, A E, Anderson, T, Cole, S N, Dominik, T, Giner-Sorolla, R, Gok, S, Heyman, T, Jekel, M, Luke, T J, Mitchell, D B, Peels, R, Pendrous, R, Sarrazin, S, Schauer, J M, Specker, E, Tran, U S, Vranka, M A, Wicherts, J M, Yoshimura, N, Zwaan, R A & van Ravenzwaaij, D 2023, 'The process of replication target selection in psychology : What to consider?', Royal Society Open Science, vol. 10, no. 2, 210586. https://doi.org/10.1098/rsos.210586 |
| locations[10].landing_page_url | http://www.scopus.com/inward/record.url?scp=85147561571&partnerID=8YFLogxK |
| locations[11].id | pmh:oai:pure.atira.dk:publications/92dce1f4-8483-4cd9-85ea-e44efd72d338 |
| locations[11].is_oa | True |
| locations[11].source.id | https://openalex.org/S4306400216 |
| locations[11].source.issn | |
| locations[11].source.type | repository |
| locations[11].source.is_oa | False |
| locations[11].source.issn_l | |
| locations[11].source.is_core | False |
| locations[11].source.is_in_doaj | False |
| locations[11].source.display_name | Research Portal (King's College London) |
| locations[11].source.host_organization | https://openalex.org/I183935753 |
| locations[11].source.host_organization_name | King's College London |
| locations[11].source.host_organization_lineage | https://openalex.org/I183935753 |
| locations[11].license | cc-by |
| locations[11].pdf_url | |
| locations[11].version | submittedVersion |
| locations[11].raw_type | |
| locations[11].license_id | https://openalex.org/licenses/cc-by |
| locations[11].is_accepted | False |
| locations[11].is_published | False |
| locations[11].raw_source_name | |
| locations[11].landing_page_url | https://birmingham.elsevierpure.com/en/publications/92dce1f4-8483-4cd9-85ea-e44efd72d338 |
| locations[12].id | pmh:oai:doaj.org/article:708c8665ae8a40089c2a606a83469d6f |
| locations[12].is_oa | False |
| locations[12].source.id | https://openalex.org/S4306401280 |
| locations[12].source.issn | |
| locations[12].source.type | repository |
| locations[12].source.is_oa | False |
| locations[12].source.issn_l | |
| locations[12].source.is_core | False |
| locations[12].source.is_in_doaj | False |
| locations[12].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[12].source.host_organization | |
| locations[12].source.host_organization_name | |
| locations[12].source.host_organization_lineage | |
| locations[12].license | |
| locations[12].pdf_url | |
| locations[12].version | submittedVersion |
| locations[12].raw_type | article |
| locations[12].license_id | |
| locations[12].is_accepted | False |
| locations[12].is_published | False |
| locations[12].raw_source_name | Royal Society Open Science, Vol 10, Iss 2 (2023) |
| locations[12].landing_page_url | https://doaj.org/article/708c8665ae8a40089c2a606a83469d6f |
| locations[13].id | pmh:vu:oai:research.vu.nl:publications/96a1982f-604e-4b38-b5a4-50e3d25d1ce5 |
| locations[13].is_oa | True |
| locations[13].source.id | https://openalex.org/S4306401843 |
| locations[13].source.issn | |
| locations[13].source.type | repository |
| locations[13].source.is_oa | False |
| locations[13].source.issn_l | |
| locations[13].source.is_core | False |
| locations[13].source.is_in_doaj | False |
| locations[13].source.display_name | Data Archiving and Networked Services (DANS) |
| locations[13].source.host_organization | https://openalex.org/I1322597698 |
| locations[13].source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| locations[13].source.host_organization_lineage | https://openalex.org/I1322597698 |
| locations[13].license | other-oa |
| locations[13].pdf_url | |
| locations[13].version | submittedVersion |
| locations[13].raw_type | info:eu-repo/semantics/article |
| locations[13].license_id | https://openalex.org/licenses/other-oa |
| locations[13].is_accepted | False |
| locations[13].is_published | False |
| locations[13].raw_source_name | Royal Society Open Science, 10(2):210586, 1 - 31. Royal Society, The |
| locations[13].landing_page_url | https://research.vu.nl/en/publications/96a1982f-604e-4b38-b5a4-50e3d25d1ce5 |
| locations[14].id | pmh:eur:oai:pure.eur.nl:publications/c3a5781a-8f60-4743-9f0d-38453ef18cb6 |
| locations[14].is_oa | True |
| locations[14].source.id | https://openalex.org/S4306401843 |
| locations[14].source.issn | |
| locations[14].source.type | repository |
| locations[14].source.is_oa | False |
| locations[14].source.issn_l | |
| locations[14].source.is_core | False |
| locations[14].source.is_in_doaj | False |
| locations[14].source.display_name | Data Archiving and Networked Services (DANS) |
| locations[14].source.host_organization | https://openalex.org/I1322597698 |
| locations[14].source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| locations[14].source.host_organization_lineage | https://openalex.org/I1322597698 |
| locations[14].license | cc-by |
| locations[14].pdf_url | |
| locations[14].version | submittedVersion |
| locations[14].raw_type | info:eu-repo/semantics/article |
| locations[14].license_id | https://openalex.org/licenses/cc-by |
| locations[14].is_accepted | False |
| locations[14].is_published | False |
| locations[14].raw_source_name | Royal Society Open Science, 10(2):210586. The Royal Society |
| locations[14].landing_page_url | https://pure.eur.nl/en/publications/c3a5781a-8f60-4743-9f0d-38453ef18cb6 |
| indexed_in | crossref, doaj, pubmed |
| authorships[0].author.id | https://openalex.org/A5010455278 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-7487-7898 |
| authorships[0].author.display_name | Merle-Marie Pittelkow |
| authorships[0].countries | NL |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I169381384 |
| authorships[0].affiliations[0].raw_affiliation_string | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[0].institutions[0].id | https://openalex.org/I169381384 |
| authorships[0].institutions[0].ror | https://ror.org/012p63287 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I169381384 |
| authorships[0].institutions[0].country_code | NL |
| authorships[0].institutions[0].display_name | University of Groningen |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Merle-Marie Pittelkow |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[1].author.id | https://openalex.org/A5051864146 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-7874-1261 |
| authorships[1].author.display_name | Sarahanne Field |
| authorships[1].countries | NL |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I121797337 |
| authorships[1].affiliations[0].raw_affiliation_string | Centre of Science and Technology Studies, Leiden University, Leiden, the Netherlands |
| authorships[1].institutions[0].id | https://openalex.org/I121797337 |
| authorships[1].institutions[0].ror | https://ror.org/027bh9e22 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I121797337 |
| authorships[1].institutions[0].country_code | NL |
| authorships[1].institutions[0].display_name | Leiden University |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Sarahanne M. Field |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Centre of Science and Technology Studies, Leiden University, Leiden, the Netherlands |
| authorships[2].author.id | https://openalex.org/A5037893321 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-6922-3590 |
| authorships[2].author.display_name | Peder Mortvedt Isager |
| authorships[2].countries | NO |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I184531372 |
| authorships[2].affiliations[0].raw_affiliation_string | Oslo New University College, Oslo, Norway |
| authorships[2].institutions[0].id | https://openalex.org/I184531372 |
| authorships[2].institutions[0].ror | https://ror.org/04q12yn84 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I184531372 |
| authorships[2].institutions[0].country_code | NO |
| authorships[2].institutions[0].display_name | OsloMet – Oslo Metropolitan University |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Peder M. Isager |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Oslo New University College, Oslo, Norway |
| authorships[3].author.id | https://openalex.org/A5021362649 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-2733-1841 |
| authorships[3].author.display_name | Anna van 't Veer |
| authorships[3].countries | NL |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I121797337 |
| authorships[3].affiliations[0].raw_affiliation_string | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[3].institutions[0].id | https://openalex.org/I121797337 |
| authorships[3].institutions[0].ror | https://ror.org/027bh9e22 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I121797337 |
| authorships[3].institutions[0].country_code | NL |
| authorships[3].institutions[0].display_name | Leiden University |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Anna E. van’t Veer |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[4].author.id | https://openalex.org/A5082063863 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-2387-5219 |
| authorships[4].author.display_name | Thomas Anderson |
| authorships[4].countries | CA |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I185261750 |
| authorships[4].affiliations[0].raw_affiliation_string | Department of Psychology, University of Toronto, Toronto, Canada |
| authorships[4].institutions[0].id | https://openalex.org/I185261750 |
| authorships[4].institutions[0].ror | https://ror.org/03dbr7087 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I185261750 |
| authorships[4].institutions[0].country_code | CA |
| authorships[4].institutions[0].display_name | University of Toronto |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Thomas Anderson |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | Department of Psychology, University of Toronto, Toronto, Canada |
| authorships[5].author.id | https://openalex.org/A5008395920 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-8176-283X |
| authorships[5].author.display_name | Scott Cole |
| authorships[5].countries | GB |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I124246371 |
| authorships[5].affiliations[0].raw_affiliation_string | School of Education, Language and Psychology, York St John University, York, UK |
| authorships[5].institutions[0].id | https://openalex.org/I124246371 |
| authorships[5].institutions[0].ror | https://ror.org/00z5fkj61 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I124246371 |
| authorships[5].institutions[0].country_code | GB |
| authorships[5].institutions[0].display_name | York St John University |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Scott N. Cole |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | School of Education, Language and Psychology, York St John University, York, UK |
| authorships[6].author.id | https://openalex.org/A5006149008 |
| authorships[6].author.orcid | https://orcid.org/0000-0003-3004-8710 |
| authorships[6].author.display_name | Tomáš Dominik |
| authorships[6].countries | US |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I185071736 |
| authorships[6].affiliations[0].raw_affiliation_string | Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA |
| authorships[6].institutions[0].id | https://openalex.org/I185071736 |
| authorships[6].institutions[0].ror | https://ror.org/0452jzg20 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I185071736 |
| authorships[6].institutions[0].country_code | US |
| authorships[6].institutions[0].display_name | Chapman University |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Tomáš Dominik |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA |
| authorships[7].author.id | https://openalex.org/A5003218340 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-6690-8842 |
| authorships[7].author.display_name | Roger Giner‐Sorolla |
| authorships[7].countries | GB |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I20581793 |
| authorships[7].affiliations[0].raw_affiliation_string | School of Psychology, University of Kent, Canterbury, UK |
| authorships[7].institutions[0].id | https://openalex.org/I20581793 |
| authorships[7].institutions[0].ror | https://ror.org/00xkeyj56 |
| authorships[7].institutions[0].type | education |
| authorships[7].institutions[0].lineage | https://openalex.org/I20581793 |
| authorships[7].institutions[0].country_code | GB |
| authorships[7].institutions[0].display_name | University of Kent |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Roger Giner-Sorolla |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | School of Psychology, University of Kent, Canterbury, UK |
| authorships[8].author.id | https://openalex.org/A5087575677 |
| authorships[8].author.orcid | |
| authorships[8].author.display_name | Sebahat Gok |
| authorships[8].countries | US |
| authorships[8].affiliations[0].institution_ids | https://openalex.org/I4210119109 |
| authorships[8].affiliations[0].raw_affiliation_string | Program in Cognitive Science, Department of Instructional Systems Technology, Indiana University, Bloomington, IN, USA |
| authorships[8].institutions[0].id | https://openalex.org/I4210119109 |
| authorships[8].institutions[0].ror | https://ror.org/02k40bc56 |
| authorships[8].institutions[0].type | education |
| authorships[8].institutions[0].lineage | https://openalex.org/I4210119109, https://openalex.org/I592451 |
| authorships[8].institutions[0].country_code | US |
| authorships[8].institutions[0].display_name | Indiana University Bloomington |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Sebahat Gok |
| authorships[8].is_corresponding | False |
| authorships[8].raw_affiliation_strings | Program in Cognitive Science, Department of Instructional Systems Technology, Indiana University, Bloomington, IN, USA |
| authorships[9].author.id | https://openalex.org/A5083706307 |
| authorships[9].author.orcid | https://orcid.org/0000-0003-0565-441X |
| authorships[9].author.display_name | Tom Heyman |
| authorships[9].countries | NL |
| authorships[9].affiliations[0].institution_ids | https://openalex.org/I121797337 |
| authorships[9].affiliations[0].raw_affiliation_string | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[9].institutions[0].id | https://openalex.org/I121797337 |
| authorships[9].institutions[0].ror | https://ror.org/027bh9e22 |
| authorships[9].institutions[0].type | education |
| authorships[9].institutions[0].lineage | https://openalex.org/I121797337 |
| authorships[9].institutions[0].country_code | NL |
| authorships[9].institutions[0].display_name | Leiden University |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Tom Heyman |
| authorships[9].is_corresponding | False |
| authorships[9].raw_affiliation_strings | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[10].author.id | https://openalex.org/A5057043932 |
| authorships[10].author.orcid | https://orcid.org/0000-0002-9146-0306 |
| authorships[10].author.display_name | Marc Jekel |
| authorships[10].countries | DE |
| authorships[10].affiliations[0].institution_ids | https://openalex.org/I180923762 |
| authorships[10].affiliations[0].raw_affiliation_string | Social Psychology, University of Cologne, Cologne, Germany |
| authorships[10].institutions[0].id | https://openalex.org/I180923762 |
| authorships[10].institutions[0].ror | https://ror.org/00rcxh774 |
| authorships[10].institutions[0].type | education |
| authorships[10].institutions[0].lineage | https://openalex.org/I180923762 |
| authorships[10].institutions[0].country_code | DE |
| authorships[10].institutions[0].display_name | University of Cologne |
| authorships[10].author_position | middle |
| authorships[10].raw_author_name | Marc Jekel |
| authorships[10].is_corresponding | False |
| authorships[10].raw_affiliation_strings | Social Psychology, University of Cologne, Cologne, Germany |
| authorships[11].author.id | https://openalex.org/A5031213595 |
| authorships[11].author.orcid | https://orcid.org/0000-0002-5513-6605 |
| authorships[11].author.display_name | Timothy J. Luke |
| authorships[11].countries | SE |
| authorships[11].affiliations[0].institution_ids | https://openalex.org/I881427289 |
| authorships[11].affiliations[0].raw_affiliation_string | Department of Psychology, University of Gothenburg, Gothenburg, Sweden |
| authorships[11].institutions[0].id | https://openalex.org/I881427289 |
| authorships[11].institutions[0].ror | https://ror.org/01tm6cn81 |
| authorships[11].institutions[0].type | education |
| authorships[11].institutions[0].lineage | https://openalex.org/I881427289 |
| authorships[11].institutions[0].country_code | SE |
| authorships[11].institutions[0].display_name | University of Gothenburg |
| authorships[11].author_position | middle |
| authorships[11].raw_author_name | Timothy J. Luke |
| authorships[11].is_corresponding | False |
| authorships[11].raw_affiliation_strings | Department of Psychology, University of Gothenburg, Gothenburg, Sweden |
| authorships[12].author.id | https://openalex.org/A5002396997 |
| authorships[12].author.orcid | https://orcid.org/0009-0008-8580-9162 |
| authorships[12].author.display_name | David B. Mitchell |
| authorships[12].countries | US |
| authorships[12].affiliations[0].institution_ids | https://openalex.org/I172980758 |
| authorships[12].affiliations[0].raw_affiliation_string | WellStar College of Health and Human Services, Kennesaw State University, Kennesaw, GA, USA |
| authorships[12].institutions[0].id | https://openalex.org/I172980758 |
| authorships[12].institutions[0].ror | https://ror.org/00jeqjx33 |
| authorships[12].institutions[0].type | education |
| authorships[12].institutions[0].lineage | https://openalex.org/I172980758 |
| authorships[12].institutions[0].country_code | US |
| authorships[12].institutions[0].display_name | Kennesaw State University |
| authorships[12].author_position | middle |
| authorships[12].raw_author_name | David B. Mitchell |
| authorships[12].is_corresponding | False |
| authorships[12].raw_affiliation_strings | WellStar College of Health and Human Services, Kennesaw State University, Kennesaw, GA, USA |
| authorships[13].author.id | https://openalex.org/A5070520743 |
| authorships[13].author.orcid | https://orcid.org/0000-0001-8107-5992 |
| authorships[13].author.display_name | Rik Peels |
| authorships[13].countries | NL |
| authorships[13].affiliations[0].institution_ids | https://openalex.org/I865915315 |
| authorships[13].affiliations[0].raw_affiliation_string | Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands |
| authorships[13].institutions[0].id | https://openalex.org/I865915315 |
| authorships[13].institutions[0].ror | https://ror.org/008xxew50 |
| authorships[13].institutions[0].type | education |
| authorships[13].institutions[0].lineage | https://openalex.org/I865915315 |
| authorships[13].institutions[0].country_code | NL |
| authorships[13].institutions[0].display_name | Vrije Universiteit Amsterdam |
| authorships[13].author_position | middle |
| authorships[13].raw_author_name | Rik Peels |
| authorships[13].is_corresponding | False |
| authorships[13].raw_affiliation_strings | Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands |
| authorships[14].author.id | https://openalex.org/A5013230989 |
| authorships[14].author.orcid | https://orcid.org/0000-0002-9085-9876 |
| authorships[14].author.display_name | Rosina Pendrous |
| authorships[14].countries | GB |
| authorships[14].affiliations[0].institution_ids | https://openalex.org/I137265193 |
| authorships[14].affiliations[0].raw_affiliation_string | Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK |
| authorships[14].affiliations[1].institution_ids | https://openalex.org/I79619799 |
| authorships[14].affiliations[1].raw_affiliation_string | Institute of Applied Health Research, University of Birmingham, Birmingham, UK |
| authorships[14].institutions[0].id | https://openalex.org/I79619799 |
| authorships[14].institutions[0].ror | https://ror.org/03angcq70 |
| authorships[14].institutions[0].type | education |
| authorships[14].institutions[0].lineage | https://openalex.org/I79619799 |
| authorships[14].institutions[0].country_code | GB |
| authorships[14].institutions[0].display_name | University of Birmingham |
| authorships[14].institutions[1].id | https://openalex.org/I137265193 |
| authorships[14].institutions[1].ror | https://ror.org/01drpwb22 |
| authorships[14].institutions[1].type | education |
| authorships[14].institutions[1].lineage | https://openalex.org/I137265193 |
| authorships[14].institutions[1].country_code | GB |
| authorships[14].institutions[1].display_name | University of Chester |
| authorships[14].author_position | middle |
| authorships[14].raw_author_name | Rosina Pendrous |
| authorships[14].is_corresponding | False |
| authorships[14].raw_affiliation_strings | Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK, Institute of Applied Health Research, University of Birmingham, Birmingham, UK |
| authorships[15].author.id | https://openalex.org/A5024736081 |
| authorships[15].author.orcid | https://orcid.org/0000-0003-0644-5273 |
| authorships[15].author.display_name | Samuel Sarrazin |
| authorships[15].affiliations[0].raw_affiliation_string | Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France |
| authorships[15].author_position | middle |
| authorships[15].raw_author_name | Samuel Sarrazin |
| authorships[15].is_corresponding | False |
| authorships[15].raw_affiliation_strings | Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France |
| authorships[16].author.id | https://openalex.org/A5072087196 |
| authorships[16].author.orcid | https://orcid.org/0000-0002-9041-7082 |
| authorships[16].author.display_name | Jacob M. Schauer |
| authorships[16].countries | US |
| authorships[16].affiliations[0].institution_ids | https://openalex.org/I111979921 |
| authorships[16].affiliations[0].raw_affiliation_string | Department of Preventive Medicine - Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA |
| authorships[16].institutions[0].id | https://openalex.org/I111979921 |
| authorships[16].institutions[0].ror | https://ror.org/000e0be47 |
| authorships[16].institutions[0].type | education |
| authorships[16].institutions[0].lineage | https://openalex.org/I111979921 |
| authorships[16].institutions[0].country_code | US |
| authorships[16].institutions[0].display_name | Northwestern University |
| authorships[16].author_position | middle |
| authorships[16].raw_author_name | Jacob M. Schauer |
| authorships[16].is_corresponding | False |
| authorships[16].raw_affiliation_strings | Department of Preventive Medicine - Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA |
| authorships[17].author.id | https://openalex.org/A5078402621 |
| authorships[17].author.orcid | https://orcid.org/0000-0003-0836-045X |
| authorships[17].author.display_name | Eva Specker |
| authorships[17].countries | AT |
| authorships[17].affiliations[0].institution_ids | https://openalex.org/I129774422 |
| authorships[17].affiliations[0].raw_affiliation_string | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[17].institutions[0].id | https://openalex.org/I129774422 |
| authorships[17].institutions[0].ror | https://ror.org/03prydq77 |
| authorships[17].institutions[0].type | education |
| authorships[17].institutions[0].lineage | https://openalex.org/I129774422 |
| authorships[17].institutions[0].country_code | AT |
| authorships[17].institutions[0].display_name | University of Vienna |
| authorships[17].author_position | middle |
| authorships[17].raw_author_name | Eva Specker |
| authorships[17].is_corresponding | False |
| authorships[17].raw_affiliation_strings | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[18].author.id | https://openalex.org/A5054292917 |
| authorships[18].author.orcid | https://orcid.org/0000-0002-6589-3167 |
| authorships[18].author.display_name | Ulrich S. Tran |
| authorships[18].countries | AT |
| authorships[18].affiliations[0].institution_ids | https://openalex.org/I129774422 |
| authorships[18].affiliations[0].raw_affiliation_string | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[18].institutions[0].id | https://openalex.org/I129774422 |
| authorships[18].institutions[0].ror | https://ror.org/03prydq77 |
| authorships[18].institutions[0].type | education |
| authorships[18].institutions[0].lineage | https://openalex.org/I129774422 |
| authorships[18].institutions[0].country_code | AT |
| authorships[18].institutions[0].display_name | University of Vienna |
| authorships[18].author_position | middle |
| authorships[18].raw_author_name | Ulrich S. Tran |
| authorships[18].is_corresponding | False |
| authorships[18].raw_affiliation_strings | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[19].author.id | https://openalex.org/A5006571051 |
| authorships[19].author.orcid | https://orcid.org/0000-0003-3413-9062 |
| authorships[19].author.display_name | Marek Vranka |
| authorships[19].countries | CZ |
| authorships[19].affiliations[0].institution_ids | https://openalex.org/I21250087 |
| authorships[19].affiliations[0].raw_affiliation_string | Faculty of Social Sciences, Charles University, Prague, Czech Republic |
| authorships[19].institutions[0].id | https://openalex.org/I21250087 |
| authorships[19].institutions[0].ror | https://ror.org/024d6js02 |
| authorships[19].institutions[0].type | education |
| authorships[19].institutions[0].lineage | https://openalex.org/I21250087 |
| authorships[19].institutions[0].country_code | CZ |
| authorships[19].institutions[0].display_name | Charles University |
| authorships[19].author_position | middle |
| authorships[19].raw_author_name | Marek A. Vranka |
| authorships[19].is_corresponding | False |
| authorships[19].raw_affiliation_strings | Faculty of Social Sciences, Charles University, Prague, Czech Republic |
| authorships[20].author.id | https://openalex.org/A5029698090 |
| authorships[20].author.orcid | https://orcid.org/0000-0003-2415-2933 |
| authorships[20].author.display_name | Jelte M. Wicherts |
| authorships[20].countries | NL |
| authorships[20].affiliations[0].institution_ids | https://openalex.org/I193700539 |
| authorships[20].affiliations[0].raw_affiliation_string | Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands |
| authorships[20].institutions[0].id | https://openalex.org/I193700539 |
| authorships[20].institutions[0].ror | https://ror.org/04b8v1s79 |
| authorships[20].institutions[0].type | education |
| authorships[20].institutions[0].lineage | https://openalex.org/I193700539 |
| authorships[20].institutions[0].country_code | NL |
| authorships[20].institutions[0].display_name | Tilburg University |
| authorships[20].author_position | middle |
| authorships[20].raw_author_name | Jelte M. Wicherts |
| authorships[20].is_corresponding | False |
| authorships[20].raw_affiliation_strings | Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands |
| authorships[21].author.id | https://openalex.org/A5057352068 |
| authorships[21].author.orcid | https://orcid.org/0000-0002-2656-4432 |
| authorships[21].author.display_name | Naoto Yoshimura |
| authorships[21].countries | JP, NL |
| authorships[21].affiliations[0].institution_ids | https://openalex.org/I135768898 |
| authorships[21].affiliations[0].raw_affiliation_string | Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan |
| authorships[21].affiliations[1].institution_ids | https://openalex.org/I205924995, https://openalex.org/I913958620 |
| authorships[21].affiliations[1].raw_affiliation_string | Research Fellow of the Japan Society for the Promotion of Science, Erasmus University Rotterdam, Rotterdam, The Netherlands |
| authorships[21].institutions[0].id | https://openalex.org/I205924995 |
| authorships[21].institutions[0].ror | https://ror.org/00hhkn466 |
| authorships[21].institutions[0].type | nonprofit |
| authorships[21].institutions[0].lineage | https://openalex.org/I1319490839, https://openalex.org/I205924995 |
| authorships[21].institutions[0].country_code | JP |
| authorships[21].institutions[0].display_name | Japan Society for the Promotion of Science |
| authorships[21].institutions[1].id | https://openalex.org/I135768898 |
| authorships[21].institutions[1].ror | https://ror.org/0197nmd03 |
| authorships[21].institutions[1].type | education |
| authorships[21].institutions[1].lineage | https://openalex.org/I135768898, https://openalex.org/I4390039241 |
| authorships[21].institutions[1].country_code | JP |
| authorships[21].institutions[1].display_name | Ritsumeikan University |
| authorships[21].institutions[2].id | https://openalex.org/I913958620 |
| authorships[21].institutions[2].ror | https://ror.org/057w15z03 |
| authorships[21].institutions[2].type | education |
| authorships[21].institutions[2].lineage | https://openalex.org/I913958620 |
| authorships[21].institutions[2].country_code | NL |
| authorships[21].institutions[2].display_name | Erasmus University Rotterdam |
| authorships[21].author_position | middle |
| authorships[21].raw_author_name | Naoto Yoshimura |
| authorships[21].is_corresponding | False |
| authorships[21].raw_affiliation_strings | Research Fellow of the Japan Society for the Promotion of Science, Erasmus University Rotterdam, Rotterdam, The Netherlands, Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan |
| authorships[22].author.id | https://openalex.org/A5020351194 |
| authorships[22].author.orcid | https://orcid.org/0000-0001-9967-7879 |
| authorships[22].author.display_name | Rolf A. Zwaan |
| authorships[22].countries | NL |
| authorships[22].affiliations[0].institution_ids | https://openalex.org/I913958620 |
| authorships[22].affiliations[0].raw_affiliation_string | Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, The Netherlands |
| authorships[22].institutions[0].id | https://openalex.org/I913958620 |
| authorships[22].institutions[0].ror | https://ror.org/057w15z03 |
| authorships[22].institutions[0].type | education |
| authorships[22].institutions[0].lineage | https://openalex.org/I913958620 |
| authorships[22].institutions[0].country_code | NL |
| authorships[22].institutions[0].display_name | Erasmus University Rotterdam |
| authorships[22].author_position | middle |
| authorships[22].raw_author_name | Rolf A. Zwaan |
| authorships[22].is_corresponding | False |
| authorships[22].raw_affiliation_strings | Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, The Netherlands |
| authorships[23].author.id | https://openalex.org/A5023033299 |
| authorships[23].author.orcid | https://orcid.org/0000-0002-5030-4091 |
| authorships[23].author.display_name | Don van Ravenzwaaij |
| authorships[23].countries | NL |
| authorships[23].affiliations[0].institution_ids | https://openalex.org/I169381384 |
| authorships[23].affiliations[0].raw_affiliation_string | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[23].institutions[0].id | https://openalex.org/I169381384 |
| authorships[23].institutions[0].ror | https://ror.org/012p63287 |
| authorships[23].institutions[0].type | education |
| authorships[23].institutions[0].lineage | https://openalex.org/I169381384 |
| authorships[23].institutions[0].country_code | NL |
| authorships[23].institutions[0].display_name | University of Groningen |
| authorships[23].author_position | last |
| authorships[23].raw_author_name | Don van Ravenzwaaij |
| authorships[23].is_corresponding | False |
| authorships[23].raw_affiliation_strings | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.1098/rsos.210586 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | The process of replication target selection in psychology: what to consider? |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T12443 |
| primary_topic.field.id | https://openalex.org/fields/33 |
| primary_topic.field.display_name | Social Sciences |
| primary_topic.score | 0.9919999837875366 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3312 |
| primary_topic.subfield.display_name | Sociology and Political Science |
| primary_topic.display_name | Delphi Technique in Research |
| related_works | https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2551362907, https://openalex.org/W3209857970, https://openalex.org/W2898002554, https://openalex.org/W2375369884, https://openalex.org/W2183038266, https://openalex.org/W2014949682, https://openalex.org/W3004435371, https://openalex.org/W2883429768 |
| cited_by_count | 23 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 14 |
| counts_by_year[1].year | 2024 |
| counts_by_year[1].cited_by_count | 5 |
| counts_by_year[2].year | 2023 |
| counts_by_year[2].cited_by_count | 4 |
| locations_count | 15 |
| best_oa_location.id | doi:10.1098/rsos.210586 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S2737558550 |
| best_oa_location.source.issn | 2054-5703 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 2054-5703 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | Royal Society Open Science |
| best_oa_location.source.host_organization | https://openalex.org/P4310319787 |
| best_oa_location.source.host_organization_name | Royal Society |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319787 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Royal Society Open Science |
| best_oa_location.landing_page_url | https://doi.org/10.1098/rsos.210586 |
| primary_location.id | doi:10.1098/rsos.210586 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S2737558550 |
| primary_location.source.issn | 2054-5703 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 2054-5703 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | Royal Society Open Science |
| primary_location.source.host_organization | https://openalex.org/P4310319787 |
| primary_location.source.host_organization_name | Royal Society |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319787 |
| primary_location.license | cc-by |
| primary_location.pdf_url | |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Royal Society Open Science |
| primary_location.landing_page_url | https://doi.org/10.1098/rsos.210586 |
| publication_date | 2023-02-01 |
| publication_year | 2023 |
| referenced_works | https://openalex.org/W1993266153, https://openalex.org/W2182118126, https://openalex.org/W2501293978, https://openalex.org/W2144981148, https://openalex.org/W2123263696, https://openalex.org/W2161498332, https://openalex.org/W2111267928, https://openalex.org/W1987673761, https://openalex.org/W1897139626, https://openalex.org/W2149444381, https://openalex.org/W2142148275, https://openalex.org/W2633878725, https://openalex.org/W4225662597, https://openalex.org/W2411125809, https://openalex.org/W2904084635, https://openalex.org/W3105279880, https://openalex.org/W2884430142, https://openalex.org/W2883633984, https://openalex.org/W2883372851, https://openalex.org/W3137603542, https://openalex.org/W4294733219, https://openalex.org/W2328814245, https://openalex.org/W2029912930, https://openalex.org/W2777631817, https://openalex.org/W2306563412, https://openalex.org/W3162470712, https://openalex.org/W2481144107, https://openalex.org/W2117162752, https://openalex.org/W3124580540, https://openalex.org/W2776961836, https://openalex.org/W1575893985, https://openalex.org/W2594755663, https://openalex.org/W3011113154, https://openalex.org/W3167586170, https://openalex.org/W2989672233, https://openalex.org/W1979290264, https://openalex.org/W4200406687, https://openalex.org/W6633427812, https://openalex.org/W2232317411, https://openalex.org/W1771332781, https://openalex.org/W2143280167, https://openalex.org/W2111751736, https://openalex.org/W2904125792, https://openalex.org/W2782446622, https://openalex.org/W2883452967, https://openalex.org/W2064161267, https://openalex.org/W3163463583, https://openalex.org/W3097374298, https://openalex.org/W4286499406, https://openalex.org/W2021458971, https://openalex.org/W2767099881, https://openalex.org/W4249760847, https://openalex.org/W2735878894, https://openalex.org/W3045149268, https://openalex.org/W6959001878, https://openalex.org/W4318828009, https://openalex.org/W3139553455, https://openalex.org/W4315749638, https://openalex.org/W1556808170 |
| referenced_works_count | 59 |
| abstract_inverted_index.a | 16, 30, 59, 70, 80, 88, 96, 103, 110, 122, 147, 173 |
| abstract_inverted_index.At | 49 |
| abstract_inverted_index.In | 74 |
| abstract_inverted_index.We | 101 |
| abstract_inverted_index.at | 29 |
| abstract_inverted_index.be | 43, 180 |
| abstract_inverted_index.in | 99 |
| abstract_inverted_index.is | 28, 62 |
| abstract_inverted_index.of | 2, 12, 19, 24, 90, 113, 139, 149, 161 |
| abstract_inverted_index.on | 53 |
| abstract_inverted_index.to | 6, 9, 55, 64, 86, 127, 146, 169 |
| abstract_inverted_index.we | 78, 108, 116, 131, 164 |
| abstract_inverted_index.The | 176 |
| abstract_inverted_index.and | 46, 69, 141 |
| abstract_inverted_index.can | 179 |
| abstract_inverted_index.few | 71 |
| abstract_inverted_index.for | 92, 182, 187, 190 |
| abstract_inverted_index.the | 7, 22, 51, 83, 133, 136, 143, 159, 185 |
| abstract_inverted_index.who | 119 |
| abstract_inverted_index.Over | 158 |
| abstract_inverted_index.into | 135 |
| abstract_inverted_index.list | 89, 112, 138, 145 |
| abstract_inverted_index.sent | 142 |
| abstract_inverted_index.this | 75 |
| abstract_inverted_index.used | 181 |
| abstract_inverted_index.what | 54, 168 |
| abstract_inverted_index.when | 57, 94, 171 |
| abstract_inverted_index.with | 33, 125 |
| abstract_inverted_index.Given | 36 |
| abstract_inverted_index.about | 152 |
| abstract_inverted_index.group | 148 |
| abstract_inverted_index.study | 81 |
| abstract_inverted_index.their | 128 |
| abstract_inverted_index.Delphi | 105 |
| abstract_inverted_index.First, | 107 |
| abstract_inverted_index.Third, | 130 |
| abstract_inverted_index.course | 160 |
| abstract_inverted_index.create | 87 |
| abstract_inverted_index.effort | 8 |
| abstract_inverted_index.number | 23 |
| abstract_inverted_index.second | 17 |
| abstract_inverted_index.should | 42 |
| abstract_inverted_index.target | 40, 61, 98, 124, 156 |
| abstract_inverted_index.Report, | 77 |
| abstract_inverted_index.Second, | 115 |
| abstract_inverted_index.arises: | 21 |
| abstract_inverted_index.limited | 37, 63 |
| abstract_inverted_index.present | 50 |
| abstract_inverted_index.regards | 126 |
| abstract_inverted_index.restore | 10 |
| abstract_inverted_index.results | 134 |
| abstract_inverted_index.rounds, | 163 |
| abstract_inverted_index.serious | 31 |
| abstract_inverted_index.several | 162 |
| abstract_inverted_index.studies | 4, 189 |
| abstract_inverted_index.target. | 175 |
| abstract_inverted_index.targets | 27 |
| abstract_inverted_index.updated | 144 |
| abstract_inverted_index.However, | 15 |
| abstract_inverted_index.concerns | 153 |
| abstract_inverted_index.consider | 56, 170 |
| abstract_inverted_index.employed | 102 |
| abstract_inverted_index.mismatch | 32 |
| abstract_inverted_index.modified | 104 |
| abstract_inverted_index.problems | 20 |
| abstract_inverted_index.proposed | 79 |
| abstract_inverted_index.selected | 121 |
| abstract_inverted_index.surveyed | 117 |
| abstract_inverted_index.Increased | 0 |
| abstract_inverted_index.approach. | 106 |
| abstract_inverted_index.available | 34 |
| abstract_inverted_index.checklist | 178 |
| abstract_inverted_index.community | 85 |
| abstract_inverted_index.consensus | 166 |
| abstract_inverted_index.empirical | 13 |
| abstract_inverted_index.execution | 1 |
| abstract_inverted_index.involving | 82 |
| abstract_inverted_index.potential | 25 |
| abstract_inverted_index.rationale | 186 |
| abstract_inverted_index.regarding | 154, 167 |
| abstract_inverted_index.research. | 14 |
| abstract_inverted_index.resulting | 177 |
| abstract_inverted_index.selecting | 58, 95, 172, 188 |
| abstract_inverted_index.selection | 41 |
| abstract_inverted_index.Registered | 76 |
| abstract_inverted_index.discussion | 52 |
| abstract_inverted_index.formalized | 72 |
| abstract_inverted_index.generation | 18 |
| abstract_inverted_index.previously | 120 |
| abstract_inverted_index.resources, | 38 |
| abstract_inverted_index.resources. | 35 |
| abstract_inverted_index.scientific | 84 |
| abstract_inverted_index.selection. | 157 |
| abstract_inverted_index.systematic | 45 |
| abstract_inverted_index.constructed | 109 |
| abstract_inverted_index.contributes | 5 |
| abstract_inverted_index.credibility | 11 |
| abstract_inverted_index.discussion, | 66 |
| abstract_inverted_index.established | 165 |
| abstract_inverted_index.individuals | 150 |
| abstract_inverted_index.preliminary | 111, 137 |
| abstract_inverted_index.psychology. | 100 |
| abstract_inverted_index.replication | 3, 26, 39, 60, 97, 123, 155, 174 |
| abstract_inverted_index.theoretical | 65 |
| abstract_inverted_index.consultation | 93 |
| abstract_inverted_index.incorporated | 132 |
| abstract_inverted_index.replication. | 191 |
| abstract_inverted_index.suggestions. | 73 |
| abstract_inverted_index.communicated. | 48 |
| abstract_inverted_index.communicating | 184 |
| abstract_inverted_index.knowledgeable | 151 |
| abstract_inverted_index.psychologists | 118 |
| abstract_inverted_index.self-reported | 67 |
| abstract_inverted_index.transparently | 47, 183 |
| abstract_inverted_index.considerations | 91, 140 |
| abstract_inverted_index.justifications | 68 |
| abstract_inverted_index.considerations. | 114, 129 |
| abstract_inverted_index.well-justified, | 44 |
| cited_by_percentile_year.max | 100 |
| cited_by_percentile_year.min | 97 |
| corresponding_author_ids | https://openalex.org/A5010455278 |
| countries_distinct_count | 10 |
| institutions_distinct_count | 24 |
| corresponding_institution_ids | https://openalex.org/I169381384 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/17 |
| sustainable_development_goals[0].score | 0.46000000834465027 |
| sustainable_development_goals[0].display_name | Partnerships for the goals |
| citation_normalized_percentile.value | 0.98888729 |
| citation_normalized_percentile.is_in_top_1_percent | True |
| citation_normalized_percentile.is_in_top_10_percent | True |