Estimating the replicability of psychology experiments after an initial failure to replicate Article Swipe
Veronica Boyce
,
Ben Prystawski
,
Adani Bennett Abutto
,
Emily M. Chen
,
Ziwen Chen
,
Howard Chiu
,
Irmak Ergin
,
Anmol Gupta
,
Chuqi Hu
,
Bendix Kemmann
,
Nastasia Klevak
,
Verity Y. Q. Lua
,
Mateus M. Mazzaferro
,
Khaing Mon
,
Daniel Ogunbamowo
,
Alexander Castanho Pereira
,
Jordan Troutman
,
Sarah Tung
,
Raphael Uricher
,
Michael C. Frank
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.31234/osf.io/an3yb
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.31234/osf.io/an3yb
When a replication fails, scientists have to decide whether to make a second attempt or move on.Psychology researchers who attempt to replicate studies often face this decision, given the empiricalrate of replication success in psychology, which is lower than desired. Here, we report 17 re-replicationsof experiments for which an original replication had failed. In 5/17 of these “rescue” projects (29%),the “rescue” study mostly or fully replicated the original results, albeit with a smaller effect size;in the other 12, the second replication was also judged to have failed. We speculate that successfulrescue projects were due to larger sample sizes or methodological changes such as attention checks. Inthe absence of obvious weaknesses in a failed replication study’s sample or procedure, however, it maybe most efficient to stop pursuing an effect after a single failed replication.
Related Topics
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- https://doi.org/10.31234/osf.io/an3yb
- https://osf.io/an3yb/download
- OA Status
- gold
- Cited By
- 1
- References
- 34
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4396571992
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4396571992Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.31234/osf.io/an3ybDigital Object Identifier
- Title
-
Estimating the replicability of psychology experiments after an initial failure to replicateWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-05-02Full publication date if available
- Authors
-
Veronica Boyce, Ben Prystawski, Adani Bennett Abutto, Emily M. Chen, Ziwen Chen, Howard Chiu, Irmak Ergin, Anmol Gupta, Chuqi Hu, Bendix Kemmann, Nastasia Klevak, Verity Y. Q. Lua, Mateus M. Mazzaferro, Khaing Mon, Daniel Ogunbamowo, Alexander Castanho Pereira, Jordan Troutman, Sarah Tung, Raphael Uricher, Michael C. FrankList of authors in order
- Landing page
-
https://doi.org/10.31234/osf.io/an3ybPublisher landing page
- PDF URL
-
https://osf.io/an3yb/downloadDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://osf.io/an3yb/downloadDirect OA link when available
- Concepts
-
Replicate, Psychology, Econometrics, Economics, Statistics, MathematicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 1Per-year citation counts (last 5 years)
- References (count)
-
34Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4396571992 |
|---|---|
| doi | https://doi.org/10.31234/osf.io/an3yb |
| ids.doi | https://doi.org/10.31234/osf.io/an3yb |
| ids.openalex | https://openalex.org/W4396571992 |
| fwci | 1.09643758 |
| type | preprint |
| title | Estimating the replicability of psychology experiments after an initial failure to replicate |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T13283 |
| topics[0].field.id | https://openalex.org/fields/32 |
| topics[0].field.display_name | Psychology |
| topics[0].score | 0.8816999793052673 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3205 |
| topics[0].subfield.display_name | Experimental and Cognitive Psychology |
| topics[0].display_name | Mental Health Research Topics |
| topics[1].id | https://openalex.org/T10826 |
| topics[1].field.id | https://openalex.org/fields/32 |
| topics[1].field.display_name | Psychology |
| topics[1].score | 0.8626000285148621 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/3204 |
| topics[1].subfield.display_name | Developmental and Educational Psychology |
| topics[1].display_name | Behavioral and Psychological Studies |
| topics[2].id | https://openalex.org/T11577 |
| topics[2].field.id | https://openalex.org/fields/32 |
| topics[2].field.display_name | Psychology |
| topics[2].score | 0.7434999942779541 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/3205 |
| topics[2].subfield.display_name | Experimental and Cognitive Psychology |
| topics[2].display_name | Cognitive Abilities and Testing |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2781162219 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9541257619857788 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q26250693 |
| concepts[0].display_name | Replicate |
| concepts[1].id | https://openalex.org/C15744967 |
| concepts[1].level | 0 |
| concepts[1].score | 0.6145561933517456 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[1].display_name | Psychology |
| concepts[2].id | https://openalex.org/C149782125 |
| concepts[2].level | 1 |
| concepts[2].score | 0.38907063007354736 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q160039 |
| concepts[2].display_name | Econometrics |
| concepts[3].id | https://openalex.org/C162324750 |
| concepts[3].level | 0 |
| concepts[3].score | 0.16272443532943726 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q8134 |
| concepts[3].display_name | Economics |
| concepts[4].id | https://openalex.org/C105795698 |
| concepts[4].level | 1 |
| concepts[4].score | 0.15623420476913452 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[4].display_name | Statistics |
| concepts[5].id | https://openalex.org/C33923547 |
| concepts[5].level | 0 |
| concepts[5].score | 0.09856614470481873 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[5].display_name | Mathematics |
| keywords[0].id | https://openalex.org/keywords/replicate |
| keywords[0].score | 0.9541257619857788 |
| keywords[0].display_name | Replicate |
| keywords[1].id | https://openalex.org/keywords/psychology |
| keywords[1].score | 0.6145561933517456 |
| keywords[1].display_name | Psychology |
| keywords[2].id | https://openalex.org/keywords/econometrics |
| keywords[2].score | 0.38907063007354736 |
| keywords[2].display_name | Econometrics |
| keywords[3].id | https://openalex.org/keywords/economics |
| keywords[3].score | 0.16272443532943726 |
| keywords[3].display_name | Economics |
| keywords[4].id | https://openalex.org/keywords/statistics |
| keywords[4].score | 0.15623420476913452 |
| keywords[4].display_name | Statistics |
| keywords[5].id | https://openalex.org/keywords/mathematics |
| keywords[5].score | 0.09856614470481873 |
| keywords[5].display_name | Mathematics |
| language | en |
| locations[0].id | doi:10.31234/osf.io/an3yb |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://osf.io/an3yb/download |
| locations[0].version | acceptedVersion |
| locations[0].raw_type | posted-content |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.31234/osf.io/an3yb |
| locations[1].id | pmh:oai:share.osf.io:7da7b15e-bf82-4162-b2c0-4f038beb772b |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400047 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | Arabixiv (OSF Preprints) |
| locations[1].source.host_organization | https://openalex.org/I2799848540 |
| locations[1].source.host_organization_name | Center for Open Science |
| locations[1].source.host_organization_lineage | https://openalex.org/I2799848540 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | Preprint |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://osf.io/an3yb |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5076462736 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-8890-2775 |
| authorships[0].author.display_name | Veronica Boyce |
| authorships[0].countries | US |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I63966007 |
| authorships[0].affiliations[0].raw_affiliation_string | Massachusetts Institute of Technology |
| authorships[0].affiliations[1].institution_ids | https://openalex.org/I97018004 |
| authorships[0].affiliations[1].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[0].institutions[0].id | https://openalex.org/I63966007 |
| authorships[0].institutions[0].ror | https://ror.org/042nb2s44 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I63966007 |
| authorships[0].institutions[0].country_code | US |
| authorships[0].institutions[0].display_name | Massachusetts Institute of Technology |
| authorships[0].institutions[1].id | https://openalex.org/I97018004 |
| authorships[0].institutions[1].ror | https://ror.org/00f54p054 |
| authorships[0].institutions[1].type | education |
| authorships[0].institutions[1].lineage | https://openalex.org/I97018004 |
| authorships[0].institutions[1].country_code | US |
| authorships[0].institutions[1].display_name | Stanford University |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Veronica Boyce |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Department of Psychology, Stanford University, Massachusetts Institute of Technology |
| authorships[1].author.id | https://openalex.org/A5050100691 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Ben Prystawski |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[1].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[1].institutions[0].id | https://openalex.org/I97018004 |
| authorships[1].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | Stanford University |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Ben Prystawski |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[2].author.id | https://openalex.org/A5096042473 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Adani Bennett Abutto |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[2].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[2].institutions[0].id | https://openalex.org/I97018004 |
| authorships[2].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | Stanford University |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Adani Bennett Abutto |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[3].author.id | https://openalex.org/A5064737347 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-8825-6534 |
| authorships[3].author.display_name | Emily M. Chen |
| authorships[3].countries | US |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I63966007 |
| authorships[3].affiliations[0].raw_affiliation_string | Massachusetts Institute of Technology |
| authorships[3].affiliations[1].institution_ids | https://openalex.org/I97018004 |
| authorships[3].affiliations[1].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[3].institutions[0].id | https://openalex.org/I63966007 |
| authorships[3].institutions[0].ror | https://ror.org/042nb2s44 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I63966007 |
| authorships[3].institutions[0].country_code | US |
| authorships[3].institutions[0].display_name | Massachusetts Institute of Technology |
| authorships[3].institutions[1].id | https://openalex.org/I97018004 |
| authorships[3].institutions[1].ror | https://ror.org/00f54p054 |
| authorships[3].institutions[1].type | education |
| authorships[3].institutions[1].lineage | https://openalex.org/I97018004 |
| authorships[3].institutions[1].country_code | US |
| authorships[3].institutions[1].display_name | Stanford University |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Emily M Chen |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Department of Psychology, Stanford University, Massachusetts Institute of Technology |
| authorships[4].author.id | https://openalex.org/A5101956039 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-7563-5922 |
| authorships[4].author.display_name | Ziwen Chen |
| authorships[4].countries | US |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[4].affiliations[0].raw_affiliation_string | Graduate School of Business, Stanford University |
| authorships[4].institutions[0].id | https://openalex.org/I97018004 |
| authorships[4].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[4].institutions[0].country_code | US |
| authorships[4].institutions[0].display_name | Stanford University |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Ziwen Chen |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | Graduate School of Business, Stanford University |
| authorships[5].author.id | https://openalex.org/A5028321293 |
| authorships[5].author.orcid | https://orcid.org/0000-0002-0398-7619 |
| authorships[5].author.display_name | Howard Chiu |
| authorships[5].countries | US |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[5].affiliations[0].raw_affiliation_string | Graduate School of Education, Stanford University |
| authorships[5].institutions[0].id | https://openalex.org/I97018004 |
| authorships[5].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[5].institutions[0].country_code | US |
| authorships[5].institutions[0].display_name | Stanford University |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Howard Chiu |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | Graduate School of Education, Stanford University |
| authorships[6].author.id | https://openalex.org/A5096129551 |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | Irmak Ergin |
| authorships[6].countries | US |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[6].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[6].institutions[0].id | https://openalex.org/I97018004 |
| authorships[6].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[6].institutions[0].country_code | US |
| authorships[6].institutions[0].display_name | Stanford University |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Irmak Ergin |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[7].author.id | https://openalex.org/A5101609402 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-5711-8582 |
| authorships[7].author.display_name | Anmol Gupta |
| authorships[7].countries | US |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[7].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[7].institutions[0].id | https://openalex.org/I97018004 |
| authorships[7].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[7].institutions[0].type | education |
| authorships[7].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[7].institutions[0].country_code | US |
| authorships[7].institutions[0].display_name | Stanford University |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Anmol Gupta |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[8].author.id | https://openalex.org/A5102658466 |
| authorships[8].author.orcid | |
| authorships[8].author.display_name | Chuqi Hu |
| authorships[8].countries | US |
| authorships[8].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[8].affiliations[0].raw_affiliation_string | Symbolic Systems Program, Stanford University |
| authorships[8].institutions[0].id | https://openalex.org/I97018004 |
| authorships[8].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[8].institutions[0].type | education |
| authorships[8].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[8].institutions[0].country_code | US |
| authorships[8].institutions[0].display_name | Stanford University |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Chuqi Hu |
| authorships[8].is_corresponding | False |
| authorships[8].raw_affiliation_strings | Symbolic Systems Program, Stanford University |
| authorships[9].author.id | https://openalex.org/A5096291951 |
| authorships[9].author.orcid | |
| authorships[9].author.display_name | Bendix Kemmann |
| authorships[9].countries | US |
| authorships[9].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[9].affiliations[0].raw_affiliation_string | Department of Philosophy, Stanford University |
| authorships[9].institutions[0].id | https://openalex.org/I97018004 |
| authorships[9].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[9].institutions[0].type | education |
| authorships[9].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[9].institutions[0].country_code | US |
| authorships[9].institutions[0].display_name | Stanford University |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Bendix Kemmann |
| authorships[9].is_corresponding | False |
| authorships[9].raw_affiliation_strings | Department of Philosophy, Stanford University |
| authorships[10].author.id | https://openalex.org/A5096169602 |
| authorships[10].author.orcid | |
| authorships[10].author.display_name | Nastasia Klevak |
| authorships[10].countries | US |
| authorships[10].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[10].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[10].institutions[0].id | https://openalex.org/I97018004 |
| authorships[10].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[10].institutions[0].type | education |
| authorships[10].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[10].institutions[0].country_code | US |
| authorships[10].institutions[0].display_name | Stanford University |
| authorships[10].author_position | middle |
| authorships[10].raw_author_name | Nastasia Klevak |
| authorships[10].is_corresponding | False |
| authorships[10].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[11].author.id | https://openalex.org/A5041203548 |
| authorships[11].author.orcid | https://orcid.org/0000-0002-1000-3438 |
| authorships[11].author.display_name | Verity Y. Q. Lua |
| authorships[11].countries | US |
| authorships[11].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[11].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[11].institutions[0].id | https://openalex.org/I97018004 |
| authorships[11].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[11].institutions[0].type | education |
| authorships[11].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[11].institutions[0].country_code | US |
| authorships[11].institutions[0].display_name | Stanford University |
| authorships[11].author_position | middle |
| authorships[11].raw_author_name | Verity Y. Q. Lua |
| authorships[11].is_corresponding | False |
| authorships[11].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[12].author.id | https://openalex.org/A5096258658 |
| authorships[12].author.orcid | https://orcid.org/0009-0005-5316-4353 |
| authorships[12].author.display_name | Mateus M. Mazzaferro |
| authorships[12].countries | US |
| authorships[12].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[12].affiliations[0].raw_affiliation_string | Graduate School of Education, Stanford University |
| authorships[12].institutions[0].id | https://openalex.org/I97018004 |
| authorships[12].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[12].institutions[0].type | education |
| authorships[12].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[12].institutions[0].country_code | US |
| authorships[12].institutions[0].display_name | Stanford University |
| authorships[12].author_position | middle |
| authorships[12].raw_author_name | Mateus Mazzaferro |
| authorships[12].is_corresponding | False |
| authorships[12].raw_affiliation_strings | Graduate School of Education, Stanford University |
| authorships[13].author.id | https://openalex.org/A5096326368 |
| authorships[13].author.orcid | |
| authorships[13].author.display_name | Khaing Mon |
| authorships[13].countries | US |
| authorships[13].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[13].affiliations[0].raw_affiliation_string | Symbolic Systems Program, Stanford University |
| authorships[13].institutions[0].id | https://openalex.org/I97018004 |
| authorships[13].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[13].institutions[0].type | education |
| authorships[13].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[13].institutions[0].country_code | US |
| authorships[13].institutions[0].display_name | Stanford University |
| authorships[13].author_position | middle |
| authorships[13].raw_author_name | Khaing Mon |
| authorships[13].is_corresponding | False |
| authorships[13].raw_affiliation_strings | Symbolic Systems Program, Stanford University |
| authorships[14].author.id | https://openalex.org/A5096129550 |
| authorships[14].author.orcid | |
| authorships[14].author.display_name | Daniel Ogunbamowo |
| authorships[14].countries | US |
| authorships[14].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[14].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[14].institutions[0].id | https://openalex.org/I97018004 |
| authorships[14].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[14].institutions[0].type | education |
| authorships[14].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[14].institutions[0].country_code | US |
| authorships[14].institutions[0].display_name | Stanford University |
| authorships[14].author_position | middle |
| authorships[14].raw_author_name | Daniel Ogunbamowo |
| authorships[14].is_corresponding | False |
| authorships[14].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[15].author.id | https://openalex.org/A5004549705 |
| authorships[15].author.orcid | |
| authorships[15].author.display_name | Alexander Castanho Pereira |
| authorships[15].countries | US |
| authorships[15].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[15].affiliations[0].raw_affiliation_string | Department of Philosophy, Stanford University |
| authorships[15].affiliations[1].institution_ids | https://openalex.org/I97018004 |
| authorships[15].affiliations[1].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[15].institutions[0].id | https://openalex.org/I97018004 |
| authorships[15].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[15].institutions[0].type | education |
| authorships[15].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[15].institutions[0].country_code | US |
| authorships[15].institutions[0].display_name | Stanford University |
| authorships[15].author_position | middle |
| authorships[15].raw_author_name | Alexander Pereira |
| authorships[15].is_corresponding | False |
| authorships[15].raw_affiliation_strings | Department of Philosophy, Stanford University, Department of Psychology, Stanford University |
| authorships[16].author.id | https://openalex.org/A5096362830 |
| authorships[16].author.orcid | |
| authorships[16].author.display_name | Jordan Troutman |
| authorships[16].countries | US |
| authorships[16].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[16].affiliations[0].raw_affiliation_string | Department of Computer Science, Stanford University |
| authorships[16].institutions[0].id | https://openalex.org/I97018004 |
| authorships[16].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[16].institutions[0].type | education |
| authorships[16].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[16].institutions[0].country_code | US |
| authorships[16].institutions[0].display_name | Stanford University |
| authorships[16].author_position | middle |
| authorships[16].raw_author_name | Jordan Troutman |
| authorships[16].is_corresponding | False |
| authorships[16].raw_affiliation_strings | Department of Computer Science, Stanford University |
| authorships[17].author.id | https://openalex.org/A5111321457 |
| authorships[17].author.orcid | |
| authorships[17].author.display_name | Sarah Tung |
| authorships[17].countries | US |
| authorships[17].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[17].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[17].institutions[0].id | https://openalex.org/I97018004 |
| authorships[17].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[17].institutions[0].type | education |
| authorships[17].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[17].institutions[0].country_code | US |
| authorships[17].institutions[0].display_name | Stanford University |
| authorships[17].author_position | middle |
| authorships[17].raw_author_name | Sarah Tung |
| authorships[17].is_corresponding | False |
| authorships[17].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[18].author.id | https://openalex.org/A5096066711 |
| authorships[18].author.orcid | |
| authorships[18].author.display_name | Raphael Uricher |
| authorships[18].countries | US |
| authorships[18].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[18].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[18].institutions[0].id | https://openalex.org/I97018004 |
| authorships[18].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[18].institutions[0].type | education |
| authorships[18].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[18].institutions[0].country_code | US |
| authorships[18].institutions[0].display_name | Stanford University |
| authorships[18].author_position | middle |
| authorships[18].raw_author_name | Raphael Uricher |
| authorships[18].is_corresponding | False |
| authorships[18].raw_affiliation_strings | Department of Psychology, Stanford University |
| authorships[19].author.id | https://openalex.org/A5103234894 |
| authorships[19].author.orcid | https://orcid.org/0000-0002-7551-4378 |
| authorships[19].author.display_name | Michael C. Frank |
| authorships[19].countries | US |
| authorships[19].affiliations[0].institution_ids | https://openalex.org/I97018004 |
| authorships[19].affiliations[0].raw_affiliation_string | Department of Psychology, Stanford University |
| authorships[19].institutions[0].id | https://openalex.org/I97018004 |
| authorships[19].institutions[0].ror | https://ror.org/00f54p054 |
| authorships[19].institutions[0].type | education |
| authorships[19].institutions[0].lineage | https://openalex.org/I97018004 |
| authorships[19].institutions[0].country_code | US |
| authorships[19].institutions[0].display_name | Stanford University |
| authorships[19].author_position | last |
| authorships[19].raw_author_name | Michael C. Frank |
| authorships[19].is_corresponding | False |
| authorships[19].raw_affiliation_strings | Department of Psychology, Stanford University |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://osf.io/an3yb/download |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-05-03T00:00:00 |
| display_name | Estimating the replicability of psychology experiments after an initial failure to replicate |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T13283 |
| primary_topic.field.id | https://openalex.org/fields/32 |
| primary_topic.field.display_name | Psychology |
| primary_topic.score | 0.8816999793052673 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3205 |
| primary_topic.subfield.display_name | Experimental and Cognitive Psychology |
| primary_topic.display_name | Mental Health Research Topics |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2748952813, https://openalex.org/W4254851101, https://openalex.org/W3171007296, https://openalex.org/W22115721, https://openalex.org/W2211931904, https://openalex.org/W2321234655, https://openalex.org/W2065444835, https://openalex.org/W4394550905, https://openalex.org/W2470062578 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 2 |
| best_oa_location.id | doi:10.31234/osf.io/an3yb |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://osf.io/an3yb/download |
| best_oa_location.version | acceptedVersion |
| best_oa_location.raw_type | posted-content |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.31234/osf.io/an3yb |
| primary_location.id | doi:10.31234/osf.io/an3yb |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://osf.io/an3yb/download |
| primary_location.version | acceptedVersion |
| primary_location.raw_type | posted-content |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.31234/osf.io/an3yb |
| publication_date | 2024-05-02 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W2936257342, https://openalex.org/W2053991525, https://openalex.org/W2290831829, https://openalex.org/W2520456228, https://openalex.org/W2486097122, https://openalex.org/W1979608778, https://openalex.org/W2151509224, https://openalex.org/W2782727840, https://openalex.org/W4388479433, https://openalex.org/W2469053887, https://openalex.org/W2610216373, https://openalex.org/W2522511350, https://openalex.org/W2776961836, https://openalex.org/W2886512263, https://openalex.org/W1981366067, https://openalex.org/W2233304404, https://openalex.org/W2254914745, https://openalex.org/W2128654855, https://openalex.org/W2163520994, https://openalex.org/W2302521008, https://openalex.org/W2285620507, https://openalex.org/W2344970719, https://openalex.org/W1941783251, https://openalex.org/W2738073151, https://openalex.org/W4247802456, https://openalex.org/W2988803285, https://openalex.org/W4307285166, https://openalex.org/W2776998249, https://openalex.org/W4200492661, https://openalex.org/W2292391400, https://openalex.org/W2041662102, https://openalex.org/W2797413227, https://openalex.org/W4221073978, https://openalex.org/W2080335873 |
| referenced_works_count | 34 |
| abstract_inverted_index.a | 1, 11, 71, 111, 129 |
| abstract_inverted_index.17 | 43 |
| abstract_inverted_index.In | 53 |
| abstract_inverted_index.We | 87 |
| abstract_inverted_index.an | 48, 126 |
| abstract_inverted_index.as | 102 |
| abstract_inverted_index.in | 33, 110 |
| abstract_inverted_index.is | 36 |
| abstract_inverted_index.it | 119 |
| abstract_inverted_index.of | 30, 55, 107 |
| abstract_inverted_index.or | 14, 63, 98, 116 |
| abstract_inverted_index.to | 6, 9, 20, 84, 94, 123 |
| abstract_inverted_index.we | 41 |
| abstract_inverted_index.12, | 77 |
| abstract_inverted_index.due | 93 |
| abstract_inverted_index.for | 46 |
| abstract_inverted_index.had | 51 |
| abstract_inverted_index.the | 28, 66, 75, 78 |
| abstract_inverted_index.was | 81 |
| abstract_inverted_index.who | 18 |
| abstract_inverted_index.5/17 | 54 |
| abstract_inverted_index.When | 0 |
| abstract_inverted_index.also | 82 |
| abstract_inverted_index.face | 24 |
| abstract_inverted_index.have | 5, 85 |
| abstract_inverted_index.make | 10 |
| abstract_inverted_index.most | 121 |
| abstract_inverted_index.move | 15 |
| abstract_inverted_index.stop | 124 |
| abstract_inverted_index.such | 101 |
| abstract_inverted_index.than | 38 |
| abstract_inverted_index.that | 89 |
| abstract_inverted_index.this | 25 |
| abstract_inverted_index.were | 92 |
| abstract_inverted_index.with | 70 |
| abstract_inverted_index.Here, | 40 |
| abstract_inverted_index.Inthe | 105 |
| abstract_inverted_index.after | 128 |
| abstract_inverted_index.fully | 64 |
| abstract_inverted_index.given | 27 |
| abstract_inverted_index.lower | 37 |
| abstract_inverted_index.maybe | 120 |
| abstract_inverted_index.often | 23 |
| abstract_inverted_index.other | 76 |
| abstract_inverted_index.sizes | 97 |
| abstract_inverted_index.study | 61 |
| abstract_inverted_index.these | 56 |
| abstract_inverted_index.which | 35, 47 |
| abstract_inverted_index.albeit | 69 |
| abstract_inverted_index.decide | 7 |
| abstract_inverted_index.effect | 73, 127 |
| abstract_inverted_index.failed | 112, 131 |
| abstract_inverted_index.fails, | 3 |
| abstract_inverted_index.judged | 83 |
| abstract_inverted_index.larger | 95 |
| abstract_inverted_index.mostly | 62 |
| abstract_inverted_index.report | 42 |
| abstract_inverted_index.sample | 96, 115 |
| abstract_inverted_index.second | 12, 79 |
| abstract_inverted_index.single | 130 |
| abstract_inverted_index.absence | 106 |
| abstract_inverted_index.attempt | 13, 19 |
| abstract_inverted_index.changes | 100 |
| abstract_inverted_index.checks. | 104 |
| abstract_inverted_index.failed. | 52, 86 |
| abstract_inverted_index.obvious | 108 |
| abstract_inverted_index.size;in | 74 |
| abstract_inverted_index.smaller | 72 |
| abstract_inverted_index.studies | 22 |
| abstract_inverted_index.success | 32 |
| abstract_inverted_index.whether | 8 |
| abstract_inverted_index.desired. | 39 |
| abstract_inverted_index.however, | 118 |
| abstract_inverted_index.original | 49, 67 |
| abstract_inverted_index.projects | 58, 91 |
| abstract_inverted_index.pursuing | 125 |
| abstract_inverted_index.results, | 68 |
| abstract_inverted_index.(29%),the | 59 |
| abstract_inverted_index.attention | 103 |
| abstract_inverted_index.decision, | 26 |
| abstract_inverted_index.efficient | 122 |
| abstract_inverted_index.replicate | 21 |
| abstract_inverted_index.speculate | 88 |
| abstract_inverted_index.study’s | 114 |
| abstract_inverted_index.procedure, | 117 |
| abstract_inverted_index.replicated | 65 |
| abstract_inverted_index.scientists | 4 |
| abstract_inverted_index.weaknesses | 109 |
| abstract_inverted_index.experiments | 45 |
| abstract_inverted_index.psychology, | 34 |
| abstract_inverted_index.replication | 2, 31, 50, 80, 113 |
| abstract_inverted_index.researchers | 17 |
| abstract_inverted_index.replication. | 132 |
| abstract_inverted_index.“rescue” | 57, 60 |
| abstract_inverted_index.empiricalrate | 29 |
| abstract_inverted_index.on.Psychology | 16 |
| abstract_inverted_index.methodological | 99 |
| abstract_inverted_index.successfulrescue | 90 |
| abstract_inverted_index.re-replicationsof | 44 |
| cited_by_percentile_year.max | 94 |
| cited_by_percentile_year.min | 90 |
| corresponding_author_ids | https://openalex.org/A5076462736 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 20 |
| corresponding_institution_ids | https://openalex.org/I63966007, https://openalex.org/I97018004 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/16 |
| sustainable_development_goals[0].score | 0.41999998688697815 |
| sustainable_development_goals[0].display_name | Peace, Justice and strong institutions |
| citation_normalized_percentile.value | 0.68905726 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |