The Process of Replication Target Selection in Psychology: What to Consider? Article Swipe
Merle-Marie Pittelkow
,
Sarahanne Field
,
Peder Mortvedt Isager
,
Anna van 't Veer
,
Thomas Anderson
,
Scott Cole
,
Tomáš Dominik
,
Roger Giner‐Sorolla
,
Sebahat Gök
,
Tom Heyman
,
Marc Jekel
,
Timothy J. Luke
,
David J. Mitchell
,
Rik Peels
,
Rosina Pendrous
,
Samuel Sarrazin
,
Jacob M. Schauer
,
Eva Specker
,
Ulrich S. Tran
,
Marek Vranka
,
Jelte M. Wicherts
,
Naoto Yoshimura
,
Rolf Antonius Zwaan
,
Don van Ravenzwaaij
·
YOU?
·
· 2022
· Open Access
·
· DOI: https://doi.org/10.31234/osf.io/4pw63
YOU?
·
· 2022
· Open Access
·
· DOI: https://doi.org/10.31234/osf.io/4pw63
Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic, and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications, and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- https://doi.org/10.31234/osf.io/4pw63
- https://psyarxiv.com/4pw63/download
- OA Status
- gold
- Cited By
- 1
- References
- 67
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4307836413
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4307836413Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.31234/osf.io/4pw63Digital Object Identifier
- Title
-
The Process of Replication Target Selection in Psychology: What to Consider?Work title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2022Year of publication
- Publication date
-
2022-10-31Full publication date if available
- Authors
-
Merle-Marie Pittelkow, Sarahanne Field, Peder Mortvedt Isager, Anna van 't Veer, Thomas Anderson, Scott Cole, Tomáš Dominik, Roger Giner‐Sorolla, Sebahat Gök, Tom Heyman, Marc Jekel, Timothy J. Luke, David J. Mitchell, Rik Peels, Rosina Pendrous, Samuel Sarrazin, Jacob M. Schauer, Eva Specker, Ulrich S. Tran, Marek Vranka, Jelte M. Wicherts, Naoto Yoshimura, Rolf Antonius Zwaan, Don van RavenzwaaijList of authors in order
- Landing page
-
https://doi.org/10.31234/osf.io/4pw63Publisher landing page
- PDF URL
-
https://psyarxiv.com/4pw63/downloadDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://psyarxiv.com/4pw63/downloadDirect OA link when available
- Concepts
-
Replication (statistics), Selection (genetic algorithm), Computer science, Credibility, Process (computing), Delphi, Psychology, Artificial intelligence, Political science, Biology, Law, Operating system, VirologyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2023: 1Per-year citation counts (last 5 years)
- References (count)
-
67Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4307836413 |
|---|---|
| doi | https://doi.org/10.31234/osf.io/4pw63 |
| ids.doi | https://doi.org/10.31234/osf.io/4pw63 |
| ids.openalex | https://openalex.org/W4307836413 |
| fwci | 0.4831543 |
| type | preprint |
| title | The Process of Replication Target Selection in Psychology: What to Consider? |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12443 |
| topics[0].field.id | https://openalex.org/fields/33 |
| topics[0].field.display_name | Social Sciences |
| topics[0].score | 0.984499990940094 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3312 |
| topics[0].subfield.display_name | Sociology and Political Science |
| topics[0].display_name | Delphi Technique in Research |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C12590798 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9089902639389038 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q3933199 |
| concepts[0].display_name | Replication (statistics) |
| concepts[1].id | https://openalex.org/C81917197 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6873384118080139 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q628760 |
| concepts[1].display_name | Selection (genetic algorithm) |
| concepts[2].id | https://openalex.org/C41008148 |
| concepts[2].level | 0 |
| concepts[2].score | 0.5848406553268433 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[2].display_name | Computer science |
| concepts[3].id | https://openalex.org/C2780224610 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5816665291786194 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q1530061 |
| concepts[3].display_name | Credibility |
| concepts[4].id | https://openalex.org/C98045186 |
| concepts[4].level | 2 |
| concepts[4].score | 0.4683496356010437 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q205663 |
| concepts[4].display_name | Process (computing) |
| concepts[5].id | https://openalex.org/C2779495148 |
| concepts[5].level | 2 |
| concepts[5].score | 0.4549528956413269 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q487378 |
| concepts[5].display_name | Delphi |
| concepts[6].id | https://openalex.org/C15744967 |
| concepts[6].level | 0 |
| concepts[6].score | 0.40530461072921753 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[6].display_name | Psychology |
| concepts[7].id | https://openalex.org/C154945302 |
| concepts[7].level | 1 |
| concepts[7].score | 0.18015000224113464 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[7].display_name | Artificial intelligence |
| concepts[8].id | https://openalex.org/C17744445 |
| concepts[8].level | 0 |
| concepts[8].score | 0.1522432267665863 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q36442 |
| concepts[8].display_name | Political science |
| concepts[9].id | https://openalex.org/C86803240 |
| concepts[9].level | 0 |
| concepts[9].score | 0.14162933826446533 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q420 |
| concepts[9].display_name | Biology |
| concepts[10].id | https://openalex.org/C199539241 |
| concepts[10].level | 1 |
| concepts[10].score | 0.07216975092887878 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q7748 |
| concepts[10].display_name | Law |
| concepts[11].id | https://openalex.org/C111919701 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q9135 |
| concepts[11].display_name | Operating system |
| concepts[12].id | https://openalex.org/C159047783 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q7215 |
| concepts[12].display_name | Virology |
| keywords[0].id | https://openalex.org/keywords/replication |
| keywords[0].score | 0.9089902639389038 |
| keywords[0].display_name | Replication (statistics) |
| keywords[1].id | https://openalex.org/keywords/selection |
| keywords[1].score | 0.6873384118080139 |
| keywords[1].display_name | Selection (genetic algorithm) |
| keywords[2].id | https://openalex.org/keywords/computer-science |
| keywords[2].score | 0.5848406553268433 |
| keywords[2].display_name | Computer science |
| keywords[3].id | https://openalex.org/keywords/credibility |
| keywords[3].score | 0.5816665291786194 |
| keywords[3].display_name | Credibility |
| keywords[4].id | https://openalex.org/keywords/process |
| keywords[4].score | 0.4683496356010437 |
| keywords[4].display_name | Process (computing) |
| keywords[5].id | https://openalex.org/keywords/delphi |
| keywords[5].score | 0.4549528956413269 |
| keywords[5].display_name | Delphi |
| keywords[6].id | https://openalex.org/keywords/psychology |
| keywords[6].score | 0.40530461072921753 |
| keywords[6].display_name | Psychology |
| keywords[7].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[7].score | 0.18015000224113464 |
| keywords[7].display_name | Artificial intelligence |
| keywords[8].id | https://openalex.org/keywords/political-science |
| keywords[8].score | 0.1522432267665863 |
| keywords[8].display_name | Political science |
| keywords[9].id | https://openalex.org/keywords/biology |
| keywords[9].score | 0.14162933826446533 |
| keywords[9].display_name | Biology |
| keywords[10].id | https://openalex.org/keywords/law |
| keywords[10].score | 0.07216975092887878 |
| keywords[10].display_name | Law |
| language | en |
| locations[0].id | doi:10.31234/osf.io/4pw63 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://psyarxiv.com/4pw63/download |
| locations[0].version | acceptedVersion |
| locations[0].raw_type | posted-content |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.31234/osf.io/4pw63 |
| locations[1].id | pmh:oai:pure.eur.nl:publications/c3a5781a-8f60-4743-9f0d-38453ef18cb6 |
| locations[1].is_oa | False |
| locations[1].source | |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | |
| locations[2].id | pmh:oai:share.osf.io:E014F-D55-CDA |
| locations[2].is_oa | False |
| locations[2].source.id | https://openalex.org/S4306400047 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | Arabixiv (OSF Preprints) |
| locations[2].source.host_organization | https://openalex.org/I2799848540 |
| locations[2].source.host_organization_name | Center for Open Science |
| locations[2].source.host_organization_lineage | https://openalex.org/I2799848540 |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | preprint |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | http://doi.org/10.31234/OSF.IO/4PW63 |
| locations[3].id | pmh:oai:share.osf.io:5d2d84fb-3685-4593-b224-59a118a6275c |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S4306400047 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | Arabixiv (OSF Preprints) |
| locations[3].source.host_organization | https://openalex.org/I2799848540 |
| locations[3].source.host_organization_name | Center for Open Science |
| locations[3].source.host_organization_lineage | https://openalex.org/I2799848540 |
| locations[3].license | cc-by |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | Preprint |
| locations[3].license_id | https://openalex.org/licenses/cc-by |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | |
| locations[3].landing_page_url | https://osf.io/4pw63 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5010455278 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-7487-7898 |
| authorships[0].author.display_name | Merle-Marie Pittelkow |
| authorships[0].countries | NL |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I169381384 |
| authorships[0].affiliations[0].raw_affiliation_string | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[0].institutions[0].id | https://openalex.org/I169381384 |
| authorships[0].institutions[0].ror | https://ror.org/012p63287 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I169381384 |
| authorships[0].institutions[0].country_code | NL |
| authorships[0].institutions[0].display_name | University of Groningen |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Merle-Marie Pittelkow |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[1].author.id | https://openalex.org/A5051864146 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-7874-1261 |
| authorships[1].author.display_name | Sarahanne Field |
| authorships[1].countries | NL |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I121797337 |
| authorships[1].affiliations[0].raw_affiliation_string | Centre for Science and Technology Studies, Leiden University, Leiden, the Netherlands |
| authorships[1].institutions[0].id | https://openalex.org/I121797337 |
| authorships[1].institutions[0].ror | https://ror.org/027bh9e22 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I121797337 |
| authorships[1].institutions[0].country_code | NL |
| authorships[1].institutions[0].display_name | Leiden University |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Sarahanne Miranda Field |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Centre for Science and Technology Studies, Leiden University, Leiden, the Netherlands |
| authorships[2].author.id | https://openalex.org/A5037893321 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-6922-3590 |
| authorships[2].author.display_name | Peder Mortvedt Isager |
| authorships[2].countries | NO |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I184531372 |
| authorships[2].affiliations[0].raw_affiliation_string | Oslo New University College, Oslo, Norway |
| authorships[2].institutions[0].id | https://openalex.org/I184531372 |
| authorships[2].institutions[0].ror | https://ror.org/04q12yn84 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I184531372 |
| authorships[2].institutions[0].country_code | NO |
| authorships[2].institutions[0].display_name | OsloMet – Oslo Metropolitan University |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Peder Mortvedt Isager |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Oslo New University College, Oslo, Norway |
| authorships[3].author.id | https://openalex.org/A5021362649 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-2733-1841 |
| authorships[3].author.display_name | Anna van 't Veer |
| authorships[3].countries | NL |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I121797337 |
| authorships[3].affiliations[0].raw_affiliation_string | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[3].affiliations[1].institution_ids | https://openalex.org/I121797337 |
| authorships[3].affiliations[1].raw_affiliation_string | Leiden Institute for Brain and Cognition, Leiden University, Leiden, the Netherlands |
| authorships[3].institutions[0].id | https://openalex.org/I121797337 |
| authorships[3].institutions[0].ror | https://ror.org/027bh9e22 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I121797337 |
| authorships[3].institutions[0].country_code | NL |
| authorships[3].institutions[0].display_name | Leiden University |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Anna Elisabeth van 't Veer |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Leiden Institute for Brain and Cognition, Leiden University, Leiden, the Netherlands, Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[4].author.id | https://openalex.org/A5082063863 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-2387-5219 |
| authorships[4].author.display_name | Thomas Anderson |
| authorships[4].countries | CA |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I185261750 |
| authorships[4].affiliations[0].raw_affiliation_string | Department of Psychology, University of Toronto, Toronto, Canada |
| authorships[4].institutions[0].id | https://openalex.org/I185261750 |
| authorships[4].institutions[0].ror | https://ror.org/03dbr7087 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I185261750 |
| authorships[4].institutions[0].country_code | CA |
| authorships[4].institutions[0].display_name | University of Toronto |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Thomas Anderson |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | Department of Psychology, University of Toronto, Toronto, Canada |
| authorships[5].author.id | https://openalex.org/A5064074930 |
| authorships[5].author.orcid | |
| authorships[5].author.display_name | Scott Cole |
| authorships[5].countries | GB |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I124246371 |
| authorships[5].affiliations[0].raw_affiliation_string | School of Education, Language & Psychology, York St John University, York, UK |
| authorships[5].institutions[0].id | https://openalex.org/I124246371 |
| authorships[5].institutions[0].ror | https://ror.org/00z5fkj61 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I124246371 |
| authorships[5].institutions[0].country_code | GB |
| authorships[5].institutions[0].display_name | York St John University |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Scott Cole |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | School of Education, Language & Psychology, York St John University, York, UK |
| authorships[6].author.id | https://openalex.org/A5006149008 |
| authorships[6].author.orcid | https://orcid.org/0000-0003-3004-8710 |
| authorships[6].author.display_name | Tomáš Dominik |
| authorships[6].countries | US |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I185071736 |
| authorships[6].affiliations[0].raw_affiliation_string | Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, USA |
| authorships[6].institutions[0].id | https://openalex.org/I185071736 |
| authorships[6].institutions[0].ror | https://ror.org/0452jzg20 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I185071736 |
| authorships[6].institutions[0].country_code | US |
| authorships[6].institutions[0].display_name | Chapman University |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Tomáš Dominik |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, USA |
| authorships[7].author.id | https://openalex.org/A5003218340 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-6690-8842 |
| authorships[7].author.display_name | Roger Giner‐Sorolla |
| authorships[7].countries | GB |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I20581793 |
| authorships[7].affiliations[0].raw_affiliation_string | School of Psychology, University of Kent, Canterbury, UK |
| authorships[7].institutions[0].id | https://openalex.org/I20581793 |
| authorships[7].institutions[0].ror | https://ror.org/00xkeyj56 |
| authorships[7].institutions[0].type | education |
| authorships[7].institutions[0].lineage | https://openalex.org/I20581793 |
| authorships[7].institutions[0].country_code | GB |
| authorships[7].institutions[0].display_name | University of Kent |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Roger Giner-Sorolla |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | School of Psychology, University of Kent, Canterbury, UK |
| authorships[8].author.id | https://openalex.org/A5024729930 |
| authorships[8].author.orcid | https://orcid.org/0000-0001-5057-4668 |
| authorships[8].author.display_name | Sebahat Gök |
| authorships[8].countries | US |
| authorships[8].affiliations[0].institution_ids | https://openalex.org/I4210119109 |
| authorships[8].affiliations[0].raw_affiliation_string | Program in Cognitive Science & Department of Instructional SystemsTechnology, Indiana University, Bloomington, USA |
| authorships[8].institutions[0].id | https://openalex.org/I4210119109 |
| authorships[8].institutions[0].ror | https://ror.org/02k40bc56 |
| authorships[8].institutions[0].type | education |
| authorships[8].institutions[0].lineage | https://openalex.org/I4210119109, https://openalex.org/I592451 |
| authorships[8].institutions[0].country_code | US |
| authorships[8].institutions[0].display_name | Indiana University Bloomington |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Sebahat Gök |
| authorships[8].is_corresponding | False |
| authorships[8].raw_affiliation_strings | Program in Cognitive Science & Department of Instructional SystemsTechnology, Indiana University, Bloomington, USA |
| authorships[9].author.id | https://openalex.org/A5083706307 |
| authorships[9].author.orcid | https://orcid.org/0000-0003-0565-441X |
| authorships[9].author.display_name | Tom Heyman |
| authorships[9].countries | NL |
| authorships[9].affiliations[0].institution_ids | https://openalex.org/I121797337 |
| authorships[9].affiliations[0].raw_affiliation_string | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[9].institutions[0].id | https://openalex.org/I121797337 |
| authorships[9].institutions[0].ror | https://ror.org/027bh9e22 |
| authorships[9].institutions[0].type | education |
| authorships[9].institutions[0].lineage | https://openalex.org/I121797337 |
| authorships[9].institutions[0].country_code | NL |
| authorships[9].institutions[0].display_name | Leiden University |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Tom Heyman |
| authorships[9].is_corresponding | False |
| authorships[9].raw_affiliation_strings | Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands |
| authorships[10].author.id | https://openalex.org/A5057043932 |
| authorships[10].author.orcid | https://orcid.org/0000-0002-9146-0306 |
| authorships[10].author.display_name | Marc Jekel |
| authorships[10].countries | DE |
| authorships[10].affiliations[0].institution_ids | https://openalex.org/I180923762 |
| authorships[10].affiliations[0].raw_affiliation_string | Social Psychology, University of Cologne, Cologne, Germany |
| authorships[10].institutions[0].id | https://openalex.org/I180923762 |
| authorships[10].institutions[0].ror | https://ror.org/00rcxh774 |
| authorships[10].institutions[0].type | education |
| authorships[10].institutions[0].lineage | https://openalex.org/I180923762 |
| authorships[10].institutions[0].country_code | DE |
| authorships[10].institutions[0].display_name | University of Cologne |
| authorships[10].author_position | middle |
| authorships[10].raw_author_name | Marc Jekel |
| authorships[10].is_corresponding | False |
| authorships[10].raw_affiliation_strings | Social Psychology, University of Cologne, Cologne, Germany |
| authorships[11].author.id | https://openalex.org/A5031213595 |
| authorships[11].author.orcid | https://orcid.org/0000-0002-5513-6605 |
| authorships[11].author.display_name | Timothy J. Luke |
| authorships[11].countries | SE |
| authorships[11].affiliations[0].institution_ids | https://openalex.org/I881427289 |
| authorships[11].affiliations[0].raw_affiliation_string | Department of Psychology, University of Gothenburg, Gothenburg, Sweden |
| authorships[11].institutions[0].id | https://openalex.org/I881427289 |
| authorships[11].institutions[0].ror | https://ror.org/01tm6cn81 |
| authorships[11].institutions[0].type | education |
| authorships[11].institutions[0].lineage | https://openalex.org/I881427289 |
| authorships[11].institutions[0].country_code | SE |
| authorships[11].institutions[0].display_name | University of Gothenburg |
| authorships[11].author_position | middle |
| authorships[11].raw_author_name | Timothy John Luke |
| authorships[11].is_corresponding | False |
| authorships[11].raw_affiliation_strings | Department of Psychology, University of Gothenburg, Gothenburg, Sweden |
| authorships[12].author.id | https://openalex.org/A5069062270 |
| authorships[12].author.orcid | https://orcid.org/0000-0002-6008-2672 |
| authorships[12].author.display_name | David J. Mitchell |
| authorships[12].countries | US |
| authorships[12].affiliations[0].institution_ids | https://openalex.org/I172980758 |
| authorships[12].affiliations[0].raw_affiliation_string | WellStar College of Health and Human Services , Kennesaw State University, Kennesaw, USA |
| authorships[12].institutions[0].id | https://openalex.org/I172980758 |
| authorships[12].institutions[0].ror | https://ror.org/00jeqjx33 |
| authorships[12].institutions[0].type | education |
| authorships[12].institutions[0].lineage | https://openalex.org/I172980758 |
| authorships[12].institutions[0].country_code | US |
| authorships[12].institutions[0].display_name | Kennesaw State University |
| authorships[12].author_position | middle |
| authorships[12].raw_author_name | David Joseph Mitchell |
| authorships[12].is_corresponding | False |
| authorships[12].raw_affiliation_strings | WellStar College of Health and Human Services , Kennesaw State University, Kennesaw, USA |
| authorships[13].author.id | https://openalex.org/A5070520743 |
| authorships[13].author.orcid | https://orcid.org/0000-0001-8107-5992 |
| authorships[13].author.display_name | Rik Peels |
| authorships[13].countries | NL |
| authorships[13].affiliations[0].institution_ids | https://openalex.org/I865915315 |
| authorships[13].affiliations[0].raw_affiliation_string | Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands |
| authorships[13].institutions[0].id | https://openalex.org/I865915315 |
| authorships[13].institutions[0].ror | https://ror.org/008xxew50 |
| authorships[13].institutions[0].type | education |
| authorships[13].institutions[0].lineage | https://openalex.org/I865915315 |
| authorships[13].institutions[0].country_code | NL |
| authorships[13].institutions[0].display_name | Vrije Universiteit Amsterdam |
| authorships[13].author_position | middle |
| authorships[13].raw_author_name | Rik Peels |
| authorships[13].is_corresponding | False |
| authorships[13].raw_affiliation_strings | Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands |
| authorships[14].author.id | https://openalex.org/A5013230989 |
| authorships[14].author.orcid | https://orcid.org/0000-0002-9085-9876 |
| authorships[14].author.display_name | Rosina Pendrous |
| authorships[14].countries | GB |
| authorships[14].affiliations[0].institution_ids | https://openalex.org/I79619799 |
| authorships[14].affiliations[0].raw_affiliation_string | Institute of Applied Health Research, University of Birmingham, Birmingham, UK |
| authorships[14].affiliations[1].institution_ids | https://openalex.org/I137265193 |
| authorships[14].affiliations[1].raw_affiliation_string | Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK |
| authorships[14].institutions[0].id | https://openalex.org/I79619799 |
| authorships[14].institutions[0].ror | https://ror.org/03angcq70 |
| authorships[14].institutions[0].type | education |
| authorships[14].institutions[0].lineage | https://openalex.org/I79619799 |
| authorships[14].institutions[0].country_code | GB |
| authorships[14].institutions[0].display_name | University of Birmingham |
| authorships[14].institutions[1].id | https://openalex.org/I137265193 |
| authorships[14].institutions[1].ror | https://ror.org/01drpwb22 |
| authorships[14].institutions[1].type | education |
| authorships[14].institutions[1].lineage | https://openalex.org/I137265193 |
| authorships[14].institutions[1].country_code | GB |
| authorships[14].institutions[1].display_name | University of Chester |
| authorships[14].author_position | middle |
| authorships[14].raw_author_name | Rosina Pendrous |
| authorships[14].is_corresponding | False |
| authorships[14].raw_affiliation_strings | Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK, Institute of Applied Health Research, University of Birmingham, Birmingham, UK |
| authorships[15].author.id | https://openalex.org/A5024736081 |
| authorships[15].author.orcid | https://orcid.org/0000-0003-0644-5273 |
| authorships[15].author.display_name | Samuel Sarrazin |
| authorships[15].affiliations[0].raw_affiliation_string | Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France |
| authorships[15].author_position | middle |
| authorships[15].raw_author_name | Samuel Sarrazin |
| authorships[15].is_corresponding | False |
| authorships[15].raw_affiliation_strings | Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France |
| authorships[16].author.id | https://openalex.org/A5072087196 |
| authorships[16].author.orcid | https://orcid.org/0000-0002-9041-7082 |
| authorships[16].author.display_name | Jacob M. Schauer |
| authorships[16].countries | US |
| authorships[16].affiliations[0].institution_ids | https://openalex.org/I111979921 |
| authorships[16].affiliations[0].raw_affiliation_string | Department of Preventive Medicine -Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, USA |
| authorships[16].institutions[0].id | https://openalex.org/I111979921 |
| authorships[16].institutions[0].ror | https://ror.org/000e0be47 |
| authorships[16].institutions[0].type | education |
| authorships[16].institutions[0].lineage | https://openalex.org/I111979921 |
| authorships[16].institutions[0].country_code | US |
| authorships[16].institutions[0].display_name | Northwestern University |
| authorships[16].author_position | middle |
| authorships[16].raw_author_name | Jacob M. Schauer |
| authorships[16].is_corresponding | False |
| authorships[16].raw_affiliation_strings | Department of Preventive Medicine -Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, USA |
| authorships[17].author.id | https://openalex.org/A5078402621 |
| authorships[17].author.orcid | https://orcid.org/0000-0003-0836-045X |
| authorships[17].author.display_name | Eva Specker |
| authorships[17].countries | AT |
| authorships[17].affiliations[0].institution_ids | https://openalex.org/I129774422 |
| authorships[17].affiliations[0].raw_affiliation_string | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[17].institutions[0].id | https://openalex.org/I129774422 |
| authorships[17].institutions[0].ror | https://ror.org/03prydq77 |
| authorships[17].institutions[0].type | education |
| authorships[17].institutions[0].lineage | https://openalex.org/I129774422 |
| authorships[17].institutions[0].country_code | AT |
| authorships[17].institutions[0].display_name | University of Vienna |
| authorships[17].author_position | middle |
| authorships[17].raw_author_name | Eva Specker |
| authorships[17].is_corresponding | False |
| authorships[17].raw_affiliation_strings | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[18].author.id | https://openalex.org/A5054292917 |
| authorships[18].author.orcid | https://orcid.org/0000-0002-6589-3167 |
| authorships[18].author.display_name | Ulrich S. Tran |
| authorships[18].countries | AT |
| authorships[18].affiliations[0].institution_ids | https://openalex.org/I129774422 |
| authorships[18].affiliations[0].raw_affiliation_string | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[18].institutions[0].id | https://openalex.org/I129774422 |
| authorships[18].institutions[0].ror | https://ror.org/03prydq77 |
| authorships[18].institutions[0].type | education |
| authorships[18].institutions[0].lineage | https://openalex.org/I129774422 |
| authorships[18].institutions[0].country_code | AT |
| authorships[18].institutions[0].display_name | University of Vienna |
| authorships[18].author_position | middle |
| authorships[18].raw_author_name | Ulrich S. Tran |
| authorships[18].is_corresponding | False |
| authorships[18].raw_affiliation_strings | Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria |
| authorships[19].author.id | https://openalex.org/A5006571051 |
| authorships[19].author.orcid | https://orcid.org/0000-0003-3413-9062 |
| authorships[19].author.display_name | Marek Vranka |
| authorships[19].countries | CZ |
| authorships[19].affiliations[0].institution_ids | https://openalex.org/I21250087 |
| authorships[19].affiliations[0].raw_affiliation_string | Faculty of Social Sciences, Charles University, Prague, Czech Republic |
| authorships[19].institutions[0].id | https://openalex.org/I21250087 |
| authorships[19].institutions[0].ror | https://ror.org/024d6js02 |
| authorships[19].institutions[0].type | education |
| authorships[19].institutions[0].lineage | https://openalex.org/I21250087 |
| authorships[19].institutions[0].country_code | CZ |
| authorships[19].institutions[0].display_name | Charles University |
| authorships[19].author_position | middle |
| authorships[19].raw_author_name | Marek Albert Vranka |
| authorships[19].is_corresponding | False |
| authorships[19].raw_affiliation_strings | Faculty of Social Sciences, Charles University, Prague, Czech Republic |
| authorships[20].author.id | https://openalex.org/A5029698090 |
| authorships[20].author.orcid | https://orcid.org/0000-0003-2415-2933 |
| authorships[20].author.display_name | Jelte M. Wicherts |
| authorships[20].countries | NL |
| authorships[20].affiliations[0].institution_ids | https://openalex.org/I193700539 |
| authorships[20].affiliations[0].raw_affiliation_string | Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands |
| authorships[20].institutions[0].id | https://openalex.org/I193700539 |
| authorships[20].institutions[0].ror | https://ror.org/04b8v1s79 |
| authorships[20].institutions[0].type | education |
| authorships[20].institutions[0].lineage | https://openalex.org/I193700539 |
| authorships[20].institutions[0].country_code | NL |
| authorships[20].institutions[0].display_name | Tilburg University |
| authorships[20].author_position | middle |
| authorships[20].raw_author_name | Jelte M. Wicherts |
| authorships[20].is_corresponding | False |
| authorships[20].raw_affiliation_strings | Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands |
| authorships[21].author.id | https://openalex.org/A5057352068 |
| authorships[21].author.orcid | https://orcid.org/0000-0002-2656-4432 |
| authorships[21].author.display_name | Naoto Yoshimura |
| authorships[21].countries | JP |
| authorships[21].affiliations[0].institution_ids | https://openalex.org/I135768898 |
| authorships[21].affiliations[0].raw_affiliation_string | Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan |
| authorships[21].affiliations[1].institution_ids | https://openalex.org/I205924995 |
| authorships[21].affiliations[1].raw_affiliation_string | Research Fellow of the Japan Society for the Promotion of Science |
| authorships[21].institutions[0].id | https://openalex.org/I205924995 |
| authorships[21].institutions[0].ror | https://ror.org/00hhkn466 |
| authorships[21].institutions[0].type | nonprofit |
| authorships[21].institutions[0].lineage | https://openalex.org/I1319490839, https://openalex.org/I205924995 |
| authorships[21].institutions[0].country_code | JP |
| authorships[21].institutions[0].display_name | Japan Society for the Promotion of Science |
| authorships[21].institutions[1].id | https://openalex.org/I135768898 |
| authorships[21].institutions[1].ror | https://ror.org/0197nmd03 |
| authorships[21].institutions[1].type | education |
| authorships[21].institutions[1].lineage | https://openalex.org/I135768898, https://openalex.org/I4390039241 |
| authorships[21].institutions[1].country_code | JP |
| authorships[21].institutions[1].display_name | Ritsumeikan University |
| authorships[21].author_position | middle |
| authorships[21].raw_author_name | Naoto Yoshimura |
| authorships[21].is_corresponding | False |
| authorships[21].raw_affiliation_strings | Research Fellow of the Japan Society for the Promotion of Science, Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan |
| authorships[22].author.id | https://openalex.org/A5066644641 |
| authorships[22].author.orcid | |
| authorships[22].author.display_name | Rolf Antonius Zwaan |
| authorships[22].countries | NL |
| authorships[22].affiliations[0].institution_ids | https://openalex.org/I913958620 |
| authorships[22].affiliations[0].raw_affiliation_string | Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, the Netherlands |
| authorships[22].affiliations[1].institution_ids | https://openalex.org/I169381384 |
| authorships[22].affiliations[1].raw_affiliation_string | Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[22].institutions[0].id | https://openalex.org/I913958620 |
| authorships[22].institutions[0].ror | https://ror.org/057w15z03 |
| authorships[22].institutions[0].type | education |
| authorships[22].institutions[0].lineage | https://openalex.org/I913958620 |
| authorships[22].institutions[0].country_code | NL |
| authorships[22].institutions[0].display_name | Erasmus University Rotterdam |
| authorships[22].institutions[1].id | https://openalex.org/I169381384 |
| authorships[22].institutions[1].ror | https://ror.org/012p63287 |
| authorships[22].institutions[1].type | education |
| authorships[22].institutions[1].lineage | https://openalex.org/I169381384 |
| authorships[22].institutions[1].country_code | NL |
| authorships[22].institutions[1].display_name | University of Groningen |
| authorships[22].author_position | middle |
| authorships[22].raw_author_name | Rolf Antonius Zwaan |
| authorships[22].is_corresponding | False |
| authorships[22].raw_affiliation_strings | Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, the Netherlands, Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands |
| authorships[23].author.id | https://openalex.org/A5023033299 |
| authorships[23].author.orcid | https://orcid.org/0000-0002-5030-4091 |
| authorships[23].author.display_name | Don van Ravenzwaaij |
| authorships[23].author_position | last |
| authorships[23].raw_author_name | Don van Ravenzwaaij |
| authorships[23].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://psyarxiv.com/4pw63/download |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | The Process of Replication Target Selection in Psychology: What to Consider? |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-12-01T00:03:43.161839 |
| primary_topic.id | https://openalex.org/T12443 |
| primary_topic.field.id | https://openalex.org/fields/33 |
| primary_topic.field.display_name | Social Sciences |
| primary_topic.score | 0.984499990940094 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3312 |
| primary_topic.subfield.display_name | Sociology and Political Science |
| primary_topic.display_name | Delphi Technique in Research |
| related_works | https://openalex.org/W2388687352, https://openalex.org/W2370187191, https://openalex.org/W2369854048, https://openalex.org/W2374291020, https://openalex.org/W2355907197, https://openalex.org/W3171042291, https://openalex.org/W2390961115, https://openalex.org/W2388138913, https://openalex.org/W1990162851, https://openalex.org/W2385288613 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2023 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 4 |
| best_oa_location.id | doi:10.31234/osf.io/4pw63 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://psyarxiv.com/4pw63/download |
| best_oa_location.version | acceptedVersion |
| best_oa_location.raw_type | posted-content |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.31234/osf.io/4pw63 |
| primary_location.id | doi:10.31234/osf.io/4pw63 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://psyarxiv.com/4pw63/download |
| primary_location.version | acceptedVersion |
| primary_location.raw_type | posted-content |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.31234/osf.io/4pw63 |
| publication_date | 2022-10-31 |
| publication_year | 2022 |
| referenced_works | https://openalex.org/W2588121495, https://openalex.org/W1741461210, https://openalex.org/W6678205884, https://openalex.org/W6682244767, https://openalex.org/W2633878725, https://openalex.org/W2098331648, https://openalex.org/W2883633984, https://openalex.org/W2328814245, https://openalex.org/W4254285380, https://openalex.org/W2117162752, https://openalex.org/W1575893985, https://openalex.org/W2594755663, https://openalex.org/W2776961836, https://openalex.org/W6770457789, https://openalex.org/W2232317411, https://openalex.org/W4327515641, https://openalex.org/W2904125792, https://openalex.org/W2883452967, https://openalex.org/W2187303492, https://openalex.org/W3136147170, https://openalex.org/W6746184565, https://openalex.org/W4249760847, https://openalex.org/W6740634674, https://openalex.org/W2123263696, https://openalex.org/W2501293978, https://openalex.org/W2064161267, https://openalex.org/W2111267928, https://openalex.org/W1771332781, https://openalex.org/W3005555715, https://openalex.org/W4247802456, https://openalex.org/W4249108554, https://openalex.org/W2143280167, https://openalex.org/W4315749638, https://openalex.org/W3163463583, https://openalex.org/W4230041923, https://openalex.org/W1897139626, https://openalex.org/W2111751736, https://openalex.org/W2149444381, https://openalex.org/W4205158352, https://openalex.org/W3011113154, https://openalex.org/W2989672233, https://openalex.org/W3139553455, https://openalex.org/W3162470712, https://openalex.org/W4210998142, https://openalex.org/W4225662597, https://openalex.org/W2029912930, https://openalex.org/W3209288515, https://openalex.org/W4286499406, https://openalex.org/W4246611182, https://openalex.org/W2306563412, https://openalex.org/W4243069498, https://openalex.org/W1979290264, https://openalex.org/W4200406687, https://openalex.org/W4255913300, https://openalex.org/W4302810778, https://openalex.org/W4247453832, https://openalex.org/W3167586170, https://openalex.org/W2144981148, https://openalex.org/W4252978115, https://openalex.org/W4206471454, https://openalex.org/W4246748336, https://openalex.org/W2481144107, https://openalex.org/W2143139699, https://openalex.org/W4253204916, https://openalex.org/W2883372851, https://openalex.org/W1556808170, https://openalex.org/W2142148275 |
| referenced_works_count | 67 |
| abstract_inverted_index.a | 16, 30, 59, 70, 80, 88, 96, 103, 110, 122, 147, 173 |
| abstract_inverted_index.At | 49 |
| abstract_inverted_index.In | 74 |
| abstract_inverted_index.We | 101 |
| abstract_inverted_index.at | 29 |
| abstract_inverted_index.be | 43 |
| abstract_inverted_index.in | 99 |
| abstract_inverted_index.is | 28, 62 |
| abstract_inverted_index.of | 2, 12, 19, 24, 90, 113, 139, 149, 161 |
| abstract_inverted_index.on | 53 |
| abstract_inverted_index.to | 6, 9, 55, 64, 86, 127, 146, 169 |
| abstract_inverted_index.we | 78, 108, 116, 131, 164 |
| abstract_inverted_index.and | 46, 69, 141 |
| abstract_inverted_index.few | 71 |
| abstract_inverted_index.for | 92 |
| abstract_inverted_index.the | 7, 22, 51, 83, 133, 136, 143, 159 |
| abstract_inverted_index.who | 119 |
| abstract_inverted_index.Over | 158 |
| abstract_inverted_index.into | 135 |
| abstract_inverted_index.list | 89, 112, 138, 145 |
| abstract_inverted_index.sent | 142 |
| abstract_inverted_index.this | 75 |
| abstract_inverted_index.what | 54, 168 |
| abstract_inverted_index.when | 57, 94, 171 |
| abstract_inverted_index.with | 33, 125 |
| abstract_inverted_index.Given | 36 |
| abstract_inverted_index.about | 152 |
| abstract_inverted_index.group | 148 |
| abstract_inverted_index.study | 81 |
| abstract_inverted_index.their | 128 |
| abstract_inverted_index.Delphi | 105 |
| abstract_inverted_index.First, | 107 |
| abstract_inverted_index.Third, | 130 |
| abstract_inverted_index.course | 160 |
| abstract_inverted_index.create | 87 |
| abstract_inverted_index.effort | 8 |
| abstract_inverted_index.number | 23 |
| abstract_inverted_index.second | 17 |
| abstract_inverted_index.should | 42 |
| abstract_inverted_index.target | 40, 61, 98, 124, 156 |
| abstract_inverted_index.Report, | 77 |
| abstract_inverted_index.Second, | 115 |
| abstract_inverted_index.arises: | 21 |
| abstract_inverted_index.limited | 37, 63 |
| abstract_inverted_index.present | 50 |
| abstract_inverted_index.regards | 126 |
| abstract_inverted_index.restore | 10 |
| abstract_inverted_index.results | 134 |
| abstract_inverted_index.rounds, | 163 |
| abstract_inverted_index.serious | 31 |
| abstract_inverted_index.several | 162 |
| abstract_inverted_index.studies | 4 |
| abstract_inverted_index.target. | 175 |
| abstract_inverted_index.targets | 27 |
| abstract_inverted_index.updated | 144 |
| abstract_inverted_index.However, | 15 |
| abstract_inverted_index.concerns | 153 |
| abstract_inverted_index.consider | 56, 170 |
| abstract_inverted_index.employed | 102 |
| abstract_inverted_index.mismatch | 32 |
| abstract_inverted_index.modified | 104 |
| abstract_inverted_index.problems | 20 |
| abstract_inverted_index.proposed | 79 |
| abstract_inverted_index.selected | 121 |
| abstract_inverted_index.surveyed | 117 |
| abstract_inverted_index.Increased | 0 |
| abstract_inverted_index.approach. | 106 |
| abstract_inverted_index.available | 34 |
| abstract_inverted_index.community | 85 |
| abstract_inverted_index.consensus | 166 |
| abstract_inverted_index.empirical | 13 |
| abstract_inverted_index.execution | 1 |
| abstract_inverted_index.involving | 82 |
| abstract_inverted_index.potential | 25 |
| abstract_inverted_index.regarding | 154, 167 |
| abstract_inverted_index.research. | 14 |
| abstract_inverted_index.selecting | 58, 95, 172 |
| abstract_inverted_index.selection | 41 |
| abstract_inverted_index.Registered | 76 |
| abstract_inverted_index.discussion | 52 |
| abstract_inverted_index.formalized | 72 |
| abstract_inverted_index.generation | 18 |
| abstract_inverted_index.previously | 120 |
| abstract_inverted_index.resources, | 38 |
| abstract_inverted_index.resources. | 35 |
| abstract_inverted_index.scientific | 84 |
| abstract_inverted_index.selection. | 157 |
| abstract_inverted_index.constructed | 109 |
| abstract_inverted_index.contributes | 5 |
| abstract_inverted_index.credibility | 11 |
| abstract_inverted_index.discussion, | 66 |
| abstract_inverted_index.established | 165 |
| abstract_inverted_index.individuals | 150 |
| abstract_inverted_index.preliminary | 111, 137 |
| abstract_inverted_index.psychology. | 100 |
| abstract_inverted_index.replication | 3, 26, 39, 60, 97, 123, 155, 174 |
| abstract_inverted_index.systematic, | 45 |
| abstract_inverted_index.theoretical | 65 |
| abstract_inverted_index.consultation | 93 |
| abstract_inverted_index.incorporated | 132 |
| abstract_inverted_index.suggestions. | 73 |
| abstract_inverted_index.communicated. | 48 |
| abstract_inverted_index.knowledgeable | 151 |
| abstract_inverted_index.psychologists | 118 |
| abstract_inverted_index.self-reported | 67 |
| abstract_inverted_index.transparently | 47 |
| abstract_inverted_index.considerations | 91, 140 |
| abstract_inverted_index.considerations. | 114, 129 |
| abstract_inverted_index.justifications, | 68 |
| abstract_inverted_index.well-justified, | 44 |
| cited_by_percentile_year.max | 94 |
| cited_by_percentile_year.min | 89 |
| corresponding_author_ids | https://openalex.org/A5010455278 |
| countries_distinct_count | 10 |
| institutions_distinct_count | 24 |
| corresponding_institution_ids | https://openalex.org/I169381384 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/17 |
| sustainable_development_goals[0].score | 0.4699999988079071 |
| sustainable_development_goals[0].display_name | Partnerships for the goals |
| citation_normalized_percentile.value | 0.71205834 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |