Reproducibility: A Primer on Semantics and Implications for Research Article Swipe
Edo D. Pellizzari
,
Kathleen N Lohr
,
Alan Blatecky
,
Darryl Creel
·
YOU?
·
· 2017
· Open Access
·
· DOI: https://doi.org/10.3768/rtipress.2017.bk.0020.1708
YOU?
·
· 2017
· Open Access
·
· DOI: https://doi.org/10.3768/rtipress.2017.bk.0020.1708
Science is allegedly in the midst of a reproducibility crisis, but questions of reproducibility and related principles date back nearly 80 years. Numerous controversies have arisen, especially since 2010, in a wide array of disciplines that stem from the failure to reproduce studies or their findings:biology, biomedical and preclinical research, business and organizational studies, computational sciences, drug discovery, economics, education, epidemiology and statistics, genetics, immunology, policy research, political science, psychology, and sociology. This monograph defines terms and constructs related to reproducible research, weighs key considerations and challenges in reproducing or replicating studies, and discusses transparency in publications that can support reproducible research goals. It attempts to clarify reproducible research, with its attendant (and confusing or even conflicting) lexicon and aims to provide useful background, definitions, and practical guidance for all readers. Among its conclusions: First, researchers must become better educated about these issues, particularly the differences between the concepts and terms. The main benefit is being able to communicate clearly within their own fields and, more importantly, across multiple disciplines. In addition, scientists need to embrace these concepts as part of their responsibilities as good stewards of research funding and as providers of credible information for policy decision making across many areas of public concern. Finally, although focusing on transparency and documentation is essential, ultimately the goal is achieving the most rigorous, high-quality science possible given limitations on time, funding, or other resources.
Related Topics
Concepts
Metadata
- Type
- book
- Language
- en
- Landing Page
- https://doi.org/10.3768/rtipress.2017.bk.0020.1708
- https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdf
- OA Status
- gold
- Cited By
- 9
- References
- 108
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W2750971703
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2750971703Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.3768/rtipress.2017.bk.0020.1708Digital Object Identifier
- Title
-
Reproducibility: A Primer on Semantics and Implications for ResearchWork title
- Type
-
bookOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2017Year of publication
- Publication date
-
2017-09-05Full publication date if available
- Authors
-
Edo D. Pellizzari, Kathleen N Lohr, Alan Blatecky, Darryl CreelList of authors in order
- Landing page
-
https://doi.org/10.3768/rtipress.2017.bk.0020.1708Publisher landing page
- PDF URL
-
https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdfDirect OA link when available
- Concepts
-
Transparency (behavior), Engineering ethics, Documentation, Political science, Management science, Politics, Data science, Computer science, Engineering, Law, Programming languageTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
9Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 1, 2022: 1, 2021: 2, 2020: 4, 2018: 1Per-year citation counts (last 5 years)
- References (count)
-
108Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2750971703 |
|---|---|
| doi | https://doi.org/10.3768/rtipress.2017.bk.0020.1708 |
| ids.doi | https://doi.org/10.3768/rtipress.2017.bk.0020.1708 |
| ids.mag | 2750971703 |
| ids.openalex | https://openalex.org/W2750971703 |
| fwci | 1.30845131 |
| type | book |
| title | Reproducibility: A Primer on Semantics and Implications for Research |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11986 |
| topics[0].field.id | https://openalex.org/fields/18 |
| topics[0].field.display_name | Decision Sciences |
| topics[0].score | 0.9846000075340271 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1802 |
| topics[0].subfield.display_name | Information Systems and Management |
| topics[0].display_name | Scientific Computing and Data Management |
| topics[1].id | https://openalex.org/T10206 |
| topics[1].field.id | https://openalex.org/fields/18 |
| topics[1].field.display_name | Decision Sciences |
| topics[1].score | 0.9742000102996826 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1804 |
| topics[1].subfield.display_name | Statistics, Probability and Uncertainty |
| topics[1].display_name | Meta-analysis and systematic reviews |
| topics[2].id | https://openalex.org/T13398 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9453999996185303 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Data Analysis with R |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2780233690 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7536416053771973 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q535347 |
| concepts[0].display_name | Transparency (behavior) |
| concepts[1].id | https://openalex.org/C55587333 |
| concepts[1].level | 1 |
| concepts[1].score | 0.5044828653335571 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q1133029 |
| concepts[1].display_name | Engineering ethics |
| concepts[2].id | https://openalex.org/C56666940 |
| concepts[2].level | 2 |
| concepts[2].score | 0.46490371227264404 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q788790 |
| concepts[2].display_name | Documentation |
| concepts[3].id | https://openalex.org/C17744445 |
| concepts[3].level | 0 |
| concepts[3].score | 0.43458011746406555 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q36442 |
| concepts[3].display_name | Political science |
| concepts[4].id | https://openalex.org/C539667460 |
| concepts[4].level | 1 |
| concepts[4].score | 0.43015342950820923 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q2414942 |
| concepts[4].display_name | Management science |
| concepts[5].id | https://openalex.org/C94625758 |
| concepts[5].level | 2 |
| concepts[5].score | 0.4239095449447632 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q7163 |
| concepts[5].display_name | Politics |
| concepts[6].id | https://openalex.org/C2522767166 |
| concepts[6].level | 1 |
| concepts[6].score | 0.36431318521499634 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[6].display_name | Data science |
| concepts[7].id | https://openalex.org/C41008148 |
| concepts[7].level | 0 |
| concepts[7].score | 0.2855079472064972 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[7].display_name | Computer science |
| concepts[8].id | https://openalex.org/C127413603 |
| concepts[8].level | 0 |
| concepts[8].score | 0.1114005446434021 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[8].display_name | Engineering |
| concepts[9].id | https://openalex.org/C199539241 |
| concepts[9].level | 1 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q7748 |
| concepts[9].display_name | Law |
| concepts[10].id | https://openalex.org/C199360897 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[10].display_name | Programming language |
| keywords[0].id | https://openalex.org/keywords/transparency |
| keywords[0].score | 0.7536416053771973 |
| keywords[0].display_name | Transparency (behavior) |
| keywords[1].id | https://openalex.org/keywords/engineering-ethics |
| keywords[1].score | 0.5044828653335571 |
| keywords[1].display_name | Engineering ethics |
| keywords[2].id | https://openalex.org/keywords/documentation |
| keywords[2].score | 0.46490371227264404 |
| keywords[2].display_name | Documentation |
| keywords[3].id | https://openalex.org/keywords/political-science |
| keywords[3].score | 0.43458011746406555 |
| keywords[3].display_name | Political science |
| keywords[4].id | https://openalex.org/keywords/management-science |
| keywords[4].score | 0.43015342950820923 |
| keywords[4].display_name | Management science |
| keywords[5].id | https://openalex.org/keywords/politics |
| keywords[5].score | 0.4239095449447632 |
| keywords[5].display_name | Politics |
| keywords[6].id | https://openalex.org/keywords/data-science |
| keywords[6].score | 0.36431318521499634 |
| keywords[6].display_name | Data science |
| keywords[7].id | https://openalex.org/keywords/computer-science |
| keywords[7].score | 0.2855079472064972 |
| keywords[7].display_name | Computer science |
| keywords[8].id | https://openalex.org/keywords/engineering |
| keywords[8].score | 0.1114005446434021 |
| keywords[8].display_name | Engineering |
| language | en |
| locations[0].id | doi:10.3768/rtipress.2017.bk.0020.1708 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by-nc-nd |
| locations[0].pdf_url | https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | monograph |
| locations[0].license_id | https://openalex.org/licenses/cc-by-nc-nd |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | https://doi.org/10.3768/rtipress.2017.bk.0020.1708 |
| locations[1].id | pmh:oai:doab-books:33042 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400539 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | Directory of Open access Books (OAPEN Foundation) |
| locations[1].source.host_organization | |
| locations[1].source.host_organization_name | |
| locations[1].license | cc-by-nc-nd |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | book |
| locations[1].license_id | https://openalex.org/licenses/cc-by-nc-nd |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://www.rti.org/rti-press-publication/reproducibility-primer |
| locations[2].id | doi:10.17615/sj57-4325 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S7407051488 |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | UNC Libraries |
| locations[2].source.host_organization | |
| locations[2].source.host_organization_name | |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | |
| locations[2].raw_type | book |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | https://doi.org/10.17615/sj57-4325 |
| indexed_in | crossref, datacite |
| authorships[0].author.id | https://openalex.org/A5000369709 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Edo D. Pellizzari |
| authorships[0].countries | US |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I180297670 |
| authorships[0].affiliations[0].raw_affiliation_string | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[0].institutions[0].id | https://openalex.org/I180297670 |
| authorships[0].institutions[0].ror | https://ror.org/052tfza37 |
| authorships[0].institutions[0].type | nonprofit |
| authorships[0].institutions[0].lineage | https://openalex.org/I180297670 |
| authorships[0].institutions[0].country_code | US |
| authorships[0].institutions[0].display_name | RTI International |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Edo Pellizzari |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[1].author.id | https://openalex.org/A5085955825 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-3825-0713 |
| authorships[1].author.display_name | Kathleen N Lohr |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I180297670 |
| authorships[1].affiliations[0].raw_affiliation_string | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[1].institutions[0].id | https://openalex.org/I180297670 |
| authorships[1].institutions[0].ror | https://ror.org/052tfza37 |
| authorships[1].institutions[0].type | nonprofit |
| authorships[1].institutions[0].lineage | https://openalex.org/I180297670 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | RTI International |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Kathleen Lohr |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[2].author.id | https://openalex.org/A5045741003 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-1849-3774 |
| authorships[2].author.display_name | Alan Blatecky |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I180297670 |
| authorships[2].affiliations[0].raw_affiliation_string | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[2].institutions[0].id | https://openalex.org/I180297670 |
| authorships[2].institutions[0].ror | https://ror.org/052tfza37 |
| authorships[2].institutions[0].type | nonprofit |
| authorships[2].institutions[0].lineage | https://openalex.org/I180297670 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | RTI International |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Alan Blatecky |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[3].author.id | https://openalex.org/A5084248039 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Darryl Creel |
| authorships[3].countries | US |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I180297670 |
| authorships[3].affiliations[0].raw_affiliation_string | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| authorships[3].institutions[0].id | https://openalex.org/I180297670 |
| authorships[3].institutions[0].ror | https://ror.org/052tfza37 |
| authorships[3].institutions[0].type | nonprofit |
| authorships[3].institutions[0].lineage | https://openalex.org/I180297670 |
| authorships[3].institutions[0].country_code | US |
| authorships[3].institutions[0].display_name | RTI International |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Darryl Creel |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | RTI International 3040 East Cornwallis Road, PO Box 12194 Research Triangle Park, NC 27709-2194, USA |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdf |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Reproducibility: A Primer on Semantics and Implications for Research |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T11986 |
| primary_topic.field.id | https://openalex.org/fields/18 |
| primary_topic.field.display_name | Decision Sciences |
| primary_topic.score | 0.9846000075340271 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1802 |
| primary_topic.subfield.display_name | Information Systems and Management |
| primary_topic.display_name | Scientific Computing and Data Management |
| related_works | https://openalex.org/W2618286804, https://openalex.org/W3131163342, https://openalex.org/W2166271660, https://openalex.org/W2142369114, https://openalex.org/W2002770077, https://openalex.org/W2361728394, https://openalex.org/W2352631095, https://openalex.org/W2408577762, https://openalex.org/W2092256833, https://openalex.org/W3038222916 |
| cited_by_count | 9 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 1 |
| counts_by_year[1].year | 2022 |
| counts_by_year[1].cited_by_count | 1 |
| counts_by_year[2].year | 2021 |
| counts_by_year[2].cited_by_count | 2 |
| counts_by_year[3].year | 2020 |
| counts_by_year[3].cited_by_count | 4 |
| counts_by_year[4].year | 2018 |
| counts_by_year[4].cited_by_count | 1 |
| locations_count | 3 |
| best_oa_location.id | doi:10.3768/rtipress.2017.bk.0020.1708 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by-nc-nd |
| best_oa_location.pdf_url | https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | monograph |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by-nc-nd |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://doi.org/10.3768/rtipress.2017.bk.0020.1708 |
| primary_location.id | doi:10.3768/rtipress.2017.bk.0020.1708 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by-nc-nd |
| primary_location.pdf_url | https://www.rti.org/rti-press-publication/reproducibility-primer/fulltext.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | monograph |
| primary_location.license_id | https://openalex.org/licenses/cc-by-nc-nd |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | https://doi.org/10.3768/rtipress.2017.bk.0020.1708 |
| publication_date | 2017-09-05 |
| publication_year | 2017 |
| referenced_works | https://openalex.org/W2406493898, https://openalex.org/W3203931103, https://openalex.org/W4255382556, https://openalex.org/W2334991758, https://openalex.org/W2048060485, https://openalex.org/W1987777080, https://openalex.org/W2567992845, https://openalex.org/W2070992738, https://openalex.org/W2034449656, https://openalex.org/W2020161508, https://openalex.org/W1971206457, https://openalex.org/W1968366903, https://openalex.org/W2078571717, https://openalex.org/W2142491263, https://openalex.org/W2011793809, https://openalex.org/W2292391400, https://openalex.org/W2195775529, https://openalex.org/W2100780408, https://openalex.org/W2123333788, https://openalex.org/W2139319950, https://openalex.org/W2100949062, https://openalex.org/W2061292778, https://openalex.org/W2169512394, https://openalex.org/W2408017125, https://openalex.org/W2042125492, https://openalex.org/W1998641738, https://openalex.org/W4252803189, https://openalex.org/W2097263448, https://openalex.org/W1972502755, https://openalex.org/W2098312075, https://openalex.org/W3121221983, https://openalex.org/W2029099961, https://openalex.org/W2016788960, https://openalex.org/W2036037852, https://openalex.org/W2128401058, https://openalex.org/W2110536255, https://openalex.org/W2126539575, https://openalex.org/W1985063788, https://openalex.org/W3124580540, https://openalex.org/W2165176433, https://openalex.org/W1897139626, https://openalex.org/W2562810876, https://openalex.org/W2571093196, https://openalex.org/W1971512638, https://openalex.org/W2745146355, https://openalex.org/W2327962997, https://openalex.org/W2290831829, https://openalex.org/W2570760970, https://openalex.org/W2553128156, https://openalex.org/W2030620341, https://openalex.org/W1825120118, https://openalex.org/W2053814546, https://openalex.org/W2043180730, https://openalex.org/W2022406334, https://openalex.org/W4240020921, https://openalex.org/W2211143780, https://openalex.org/W2114060717, https://openalex.org/W2163515066, https://openalex.org/W4233265285, https://openalex.org/W2041179993, https://openalex.org/W1555651959, https://openalex.org/W2441371978, https://openalex.org/W2003816086, https://openalex.org/W4300497458, https://openalex.org/W1622128722, https://openalex.org/W2414283705, https://openalex.org/W4211181167, https://openalex.org/W1603966524, https://openalex.org/W2124035485, https://openalex.org/W4250639036, https://openalex.org/W1990728761, https://openalex.org/W2327671470, https://openalex.org/W2082995815, https://openalex.org/W2323830355, https://openalex.org/W1526025733, https://openalex.org/W2161374186, https://openalex.org/W2169205464, https://openalex.org/W2126645252, https://openalex.org/W4386986577, https://openalex.org/W2137516955, https://openalex.org/W4296816736, https://openalex.org/W2571766406, https://openalex.org/W1979423827, https://openalex.org/W2468996569, https://openalex.org/W2576440140, https://openalex.org/W2090293326, https://openalex.org/W2090132603, https://openalex.org/W2064223985, https://openalex.org/W2061211489, https://openalex.org/W2044757014, https://openalex.org/W2046391772, https://openalex.org/W2136482257, https://openalex.org/W2156098321, https://openalex.org/W1561082337, https://openalex.org/W2042418169, https://openalex.org/W1921823546, https://openalex.org/W1575538149, https://openalex.org/W3022903699, https://openalex.org/W2049069390, https://openalex.org/W1730782591, https://openalex.org/W149807329, https://openalex.org/W2981712958, https://openalex.org/W2183919022, https://openalex.org/W2047646151, https://openalex.org/W3127702745, https://openalex.org/W2092467722, https://openalex.org/W2130126144, https://openalex.org/W2741716658 |
| referenced_works_count | 108 |
| abstract_inverted_index.a | 7, 30 |
| abstract_inverted_index.80 | 20 |
| abstract_inverted_index.In | 170 |
| abstract_inverted_index.It | 103 |
| abstract_inverted_index.as | 178, 183, 190 |
| abstract_inverted_index.in | 3, 29, 87, 95 |
| abstract_inverted_index.is | 1, 154, 212, 217 |
| abstract_inverted_index.of | 6, 12, 33, 180, 186, 192, 202 |
| abstract_inverted_index.on | 208, 227 |
| abstract_inverted_index.or | 43, 89, 114, 230 |
| abstract_inverted_index.to | 40, 79, 105, 120, 157, 174 |
| abstract_inverted_index.The | 151 |
| abstract_inverted_index.all | 129 |
| abstract_inverted_index.and | 14, 47, 51, 61, 70, 76, 85, 92, 118, 125, 149, 189, 210 |
| abstract_inverted_index.but | 10 |
| abstract_inverted_index.can | 98 |
| abstract_inverted_index.for | 128, 195 |
| abstract_inverted_index.its | 110, 132 |
| abstract_inverted_index.key | 83 |
| abstract_inverted_index.own | 162 |
| abstract_inverted_index.the | 4, 38, 144, 147, 215, 219 |
| abstract_inverted_index.(and | 112 |
| abstract_inverted_index.This | 72 |
| abstract_inverted_index.able | 156 |
| abstract_inverted_index.aims | 119 |
| abstract_inverted_index.and, | 164 |
| abstract_inverted_index.back | 18 |
| abstract_inverted_index.date | 17 |
| abstract_inverted_index.drug | 56 |
| abstract_inverted_index.even | 115 |
| abstract_inverted_index.from | 37 |
| abstract_inverted_index.goal | 216 |
| abstract_inverted_index.good | 184 |
| abstract_inverted_index.have | 24 |
| abstract_inverted_index.main | 152 |
| abstract_inverted_index.many | 200 |
| abstract_inverted_index.more | 165 |
| abstract_inverted_index.most | 220 |
| abstract_inverted_index.must | 136 |
| abstract_inverted_index.need | 173 |
| abstract_inverted_index.part | 179 |
| abstract_inverted_index.stem | 36 |
| abstract_inverted_index.that | 35, 97 |
| abstract_inverted_index.wide | 31 |
| abstract_inverted_index.with | 109 |
| abstract_inverted_index.2010, | 28 |
| abstract_inverted_index.Among | 131 |
| abstract_inverted_index.about | 140 |
| abstract_inverted_index.areas | 201 |
| abstract_inverted_index.array | 32 |
| abstract_inverted_index.being | 155 |
| abstract_inverted_index.given | 225 |
| abstract_inverted_index.midst | 5 |
| abstract_inverted_index.other | 231 |
| abstract_inverted_index.since | 27 |
| abstract_inverted_index.terms | 75 |
| abstract_inverted_index.their | 44, 161, 181 |
| abstract_inverted_index.these | 141, 176 |
| abstract_inverted_index.time, | 228 |
| abstract_inverted_index.First, | 134 |
| abstract_inverted_index.across | 167, 199 |
| abstract_inverted_index.become | 137 |
| abstract_inverted_index.better | 138 |
| abstract_inverted_index.fields | 163 |
| abstract_inverted_index.goals. | 102 |
| abstract_inverted_index.making | 198 |
| abstract_inverted_index.nearly | 19 |
| abstract_inverted_index.policy | 65, 196 |
| abstract_inverted_index.public | 203 |
| abstract_inverted_index.terms. | 150 |
| abstract_inverted_index.useful | 122 |
| abstract_inverted_index.weighs | 82 |
| abstract_inverted_index.within | 160 |
| abstract_inverted_index.years. | 21 |
| abstract_inverted_index.Science | 0 |
| abstract_inverted_index.arisen, | 25 |
| abstract_inverted_index.benefit | 153 |
| abstract_inverted_index.between | 146 |
| abstract_inverted_index.clarify | 106 |
| abstract_inverted_index.clearly | 159 |
| abstract_inverted_index.crisis, | 9 |
| abstract_inverted_index.defines | 74 |
| abstract_inverted_index.embrace | 175 |
| abstract_inverted_index.failure | 39 |
| abstract_inverted_index.funding | 188 |
| abstract_inverted_index.issues, | 142 |
| abstract_inverted_index.lexicon | 117 |
| abstract_inverted_index.provide | 121 |
| abstract_inverted_index.related | 15, 78 |
| abstract_inverted_index.science | 223 |
| abstract_inverted_index.studies | 42 |
| abstract_inverted_index.support | 99 |
| abstract_inverted_index.Finally, | 205 |
| abstract_inverted_index.Numerous | 22 |
| abstract_inverted_index.although | 206 |
| abstract_inverted_index.attempts | 104 |
| abstract_inverted_index.business | 50 |
| abstract_inverted_index.concepts | 148, 177 |
| abstract_inverted_index.concern. | 204 |
| abstract_inverted_index.credible | 193 |
| abstract_inverted_index.decision | 197 |
| abstract_inverted_index.educated | 139 |
| abstract_inverted_index.focusing | 207 |
| abstract_inverted_index.funding, | 229 |
| abstract_inverted_index.guidance | 127 |
| abstract_inverted_index.multiple | 168 |
| abstract_inverted_index.possible | 224 |
| abstract_inverted_index.readers. | 130 |
| abstract_inverted_index.research | 101, 187 |
| abstract_inverted_index.science, | 68 |
| abstract_inverted_index.stewards | 185 |
| abstract_inverted_index.studies, | 53, 91 |
| abstract_inverted_index.achieving | 218 |
| abstract_inverted_index.addition, | 171 |
| abstract_inverted_index.allegedly | 2 |
| abstract_inverted_index.attendant | 111 |
| abstract_inverted_index.confusing | 113 |
| abstract_inverted_index.discusses | 93 |
| abstract_inverted_index.genetics, | 63 |
| abstract_inverted_index.monograph | 73 |
| abstract_inverted_index.political | 67 |
| abstract_inverted_index.practical | 126 |
| abstract_inverted_index.providers | 191 |
| abstract_inverted_index.questions | 11 |
| abstract_inverted_index.reproduce | 41 |
| abstract_inverted_index.research, | 49, 66, 81, 108 |
| abstract_inverted_index.rigorous, | 221 |
| abstract_inverted_index.sciences, | 55 |
| abstract_inverted_index.biomedical | 46 |
| abstract_inverted_index.challenges | 86 |
| abstract_inverted_index.constructs | 77 |
| abstract_inverted_index.discovery, | 57 |
| abstract_inverted_index.economics, | 58 |
| abstract_inverted_index.education, | 59 |
| abstract_inverted_index.especially | 26 |
| abstract_inverted_index.essential, | 213 |
| abstract_inverted_index.principles | 16 |
| abstract_inverted_index.resources. | 232 |
| abstract_inverted_index.scientists | 172 |
| abstract_inverted_index.sociology. | 71 |
| abstract_inverted_index.ultimately | 214 |
| abstract_inverted_index.background, | 123 |
| abstract_inverted_index.communicate | 158 |
| abstract_inverted_index.differences | 145 |
| abstract_inverted_index.disciplines | 34 |
| abstract_inverted_index.immunology, | 64 |
| abstract_inverted_index.information | 194 |
| abstract_inverted_index.limitations | 226 |
| abstract_inverted_index.preclinical | 48 |
| abstract_inverted_index.psychology, | 69 |
| abstract_inverted_index.replicating | 90 |
| abstract_inverted_index.reproducing | 88 |
| abstract_inverted_index.researchers | 135 |
| abstract_inverted_index.statistics, | 62 |
| abstract_inverted_index.conclusions: | 133 |
| abstract_inverted_index.conflicting) | 116 |
| abstract_inverted_index.definitions, | 124 |
| abstract_inverted_index.disciplines. | 169 |
| abstract_inverted_index.epidemiology | 60 |
| abstract_inverted_index.high-quality | 222 |
| abstract_inverted_index.importantly, | 166 |
| abstract_inverted_index.particularly | 143 |
| abstract_inverted_index.publications | 96 |
| abstract_inverted_index.reproducible | 80, 100, 107 |
| abstract_inverted_index.transparency | 94, 209 |
| abstract_inverted_index.computational | 54 |
| abstract_inverted_index.controversies | 23 |
| abstract_inverted_index.documentation | 211 |
| abstract_inverted_index.considerations | 84 |
| abstract_inverted_index.organizational | 52 |
| abstract_inverted_index.reproducibility | 8, 13 |
| abstract_inverted_index.responsibilities | 182 |
| abstract_inverted_index.findings:biology, | 45 |
| cited_by_percentile_year.max | 97 |
| cited_by_percentile_year.min | 89 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 4 |
| citation_normalized_percentile.value | 0.84455128 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |