A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics Article Swipe
Rachel Heyard
,
Samuel Pawel
,
Joris Frese
,
Bernhard Voelkl
,
Hanno Wuerbel
,
Sarah McCann
,
Leonhard Held
,
Kimberley E. Wever
,
Helena Hartmann
,
Louise Townsin
,
Stephanie Zellers
·
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.1098/rsos.242076
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.1098/rsos.242076
Reproducibility is recognized as essential to scientific progress and integrity. Replication studies and large-scale replication projects, aiming to quantify different aspects of reproducibility, have become more common. Since no standardized approach to measuring reproducibility exists, a diverse set of metrics has emerged and a comprehensive overview is needed. We conducted a scoping review to identify large-scale replication projects that used metrics and methodological papers that proposed or discussed metrics. The project list was compiled by the authors. For the methodological papers, we searched Scopus, MedLine, PsycINFO and EconLit. Records were screened in duplicate against pre-defined inclusion criteria. Demographic information on included records and information on reproducibility metrics used, suggested or discussed was extracted. We identified 49 large-scale projects and 97 methodological papers and extracted 50 metrics. The metrics were characterized based on type (formulas and/or statistical models, frameworks, graphical representations, studies and questionnaires, algorithms), input required and appropriate application scenarios. Each metric addresses a distinct question. Our review provides a comprehensive resource in the form of a ‘live’, interactive table for future replication teams and meta-researchers, offering support in how to select the most appropriate metrics that are aligned with research questions and project goals.
Related Topics
Concepts
Replication (statistics)
Computer science
Data science
PsycINFO
Metric (unit)
Scopus
EconLit
Scale (ratio)
Multitude
Set (abstract data type)
Resource (disambiguation)
Information retrieval
MEDLINE
Mathematics
Statistics
Biology
Philosophy
Physics
Programming language
Quantum mechanics
Operations management
Computer network
Economics
Epistemology
Biochemistry
Metadata
- Type
- review
- Language
- en
- Landing Page
- https://doi.org/10.1098/rsos.242076
- OA Status
- gold
- Cited By
- 2
- References
- 161
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4412464884
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4412464884Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1098/rsos.242076Digital Object Identifier
- Title
-
A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metricsWork title
- Type
-
reviewOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-07-01Full publication date if available
- Authors
-
Rachel Heyard, Samuel Pawel, Joris Frese, Bernhard Voelkl, Hanno Wuerbel, Sarah McCann, Leonhard Held, Kimberley E. Wever, Helena Hartmann, Louise Townsin, Stephanie ZellersList of authors in order
- Landing page
-
https://doi.org/10.1098/rsos.242076Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://doi.org/10.1098/rsos.242076Direct OA link when available
- Concepts
-
Replication (statistics), Computer science, Data science, PsycINFO, Metric (unit), Scopus, EconLit, Scale (ratio), Multitude, Set (abstract data type), Resource (disambiguation), Information retrieval, MEDLINE, Mathematics, Statistics, Biology, Philosophy, Physics, Programming language, Quantum mechanics, Operations management, Computer network, Economics, Epistemology, BiochemistryTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
2Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 2Per-year citation counts (last 5 years)
- References (count)
-
161Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4412464884 |
|---|---|
| doi | https://doi.org/10.1098/rsos.242076 |
| ids.doi | https://doi.org/10.1098/rsos.242076 |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/40894102 |
| ids.openalex | https://openalex.org/W4412464884 |
| fwci | 7.65295004 |
| type | review |
| title | A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics |
| biblio.issue | 7 |
| biblio.volume | 12 |
| biblio.last_page | 242076 |
| biblio.first_page | 242076 |
| topics[0].id | https://openalex.org/T10206 |
| topics[0].field.id | https://openalex.org/fields/18 |
| topics[0].field.display_name | Decision Sciences |
| topics[0].score | 0.9987000226974487 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1804 |
| topics[0].subfield.display_name | Statistics, Probability and Uncertainty |
| topics[0].display_name | Meta-analysis and systematic reviews |
| topics[1].id | https://openalex.org/T11986 |
| topics[1].field.id | https://openalex.org/fields/18 |
| topics[1].field.display_name | Decision Sciences |
| topics[1].score | 0.9785000085830688 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1802 |
| topics[1].subfield.display_name | Information Systems and Management |
| topics[1].display_name | Scientific Computing and Data Management |
| topics[2].id | https://openalex.org/T10102 |
| topics[2].field.id | https://openalex.org/fields/18 |
| topics[2].field.display_name | Decision Sciences |
| topics[2].score | 0.972000002861023 |
| topics[2].domain.id | https://openalex.org/domains/2 |
| topics[2].domain.display_name | Social Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1804 |
| topics[2].subfield.display_name | Statistics, Probability and Uncertainty |
| topics[2].display_name | scientometrics and bibliometrics research |
| funders[0].id | https://openalex.org/F4320320879 |
| funders[0].ror | https://ror.org/018mejw64 |
| funders[0].display_name | Deutsche Forschungsgemeinschaft |
| funders[1].id | https://openalex.org/F4320334322 |
| funders[1].ror | |
| funders[1].display_name | HORIZON EUROPE Framework Programme |
| is_xpac | False |
| apc_list.value | 1200 |
| apc_list.currency | GBP |
| apc_list.value_usd | 1471 |
| apc_paid.value | 1200 |
| apc_paid.currency | GBP |
| apc_paid.value_usd | 1471 |
| concepts[0].id | https://openalex.org/C12590798 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6901397109031677 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q3933199 |
| concepts[0].display_name | Replication (statistics) |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.6891268491744995 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C2522767166 |
| concepts[2].level | 1 |
| concepts[2].score | 0.6285476684570312 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[2].display_name | Data science |
| concepts[3].id | https://openalex.org/C2779549880 |
| concepts[3].level | 3 |
| concepts[3].score | 0.5882607698440552 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q5542226 |
| concepts[3].display_name | PsycINFO |
| concepts[4].id | https://openalex.org/C176217482 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5674303770065308 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q860554 |
| concepts[4].display_name | Metric (unit) |
| concepts[5].id | https://openalex.org/C83867959 |
| concepts[5].level | 3 |
| concepts[5].score | 0.5565958619117737 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q371467 |
| concepts[5].display_name | Scopus |
| concepts[6].id | https://openalex.org/C2778980733 |
| concepts[6].level | 3 |
| concepts[6].score | 0.5427922606468201 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q5333315 |
| concepts[6].display_name | EconLit |
| concepts[7].id | https://openalex.org/C2778755073 |
| concepts[7].level | 2 |
| concepts[7].score | 0.5338054299354553 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q10858537 |
| concepts[7].display_name | Scale (ratio) |
| concepts[8].id | https://openalex.org/C2780565519 |
| concepts[8].level | 2 |
| concepts[8].score | 0.5077880024909973 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q1208937 |
| concepts[8].display_name | Multitude |
| concepts[9].id | https://openalex.org/C177264268 |
| concepts[9].level | 2 |
| concepts[9].score | 0.4903841018676758 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q1514741 |
| concepts[9].display_name | Set (abstract data type) |
| concepts[10].id | https://openalex.org/C206345919 |
| concepts[10].level | 2 |
| concepts[10].score | 0.4423525333404541 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q20380951 |
| concepts[10].display_name | Resource (disambiguation) |
| concepts[11].id | https://openalex.org/C23123220 |
| concepts[11].level | 1 |
| concepts[11].score | 0.3556400537490845 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q816826 |
| concepts[11].display_name | Information retrieval |
| concepts[12].id | https://openalex.org/C2779473830 |
| concepts[12].level | 2 |
| concepts[12].score | 0.34570300579071045 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q1540899 |
| concepts[12].display_name | MEDLINE |
| concepts[13].id | https://openalex.org/C33923547 |
| concepts[13].level | 0 |
| concepts[13].score | 0.11892050504684448 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[13].display_name | Mathematics |
| concepts[14].id | https://openalex.org/C105795698 |
| concepts[14].level | 1 |
| concepts[14].score | 0.10970604419708252 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[14].display_name | Statistics |
| concepts[15].id | https://openalex.org/C86803240 |
| concepts[15].level | 0 |
| concepts[15].score | 0.08919957280158997 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q420 |
| concepts[15].display_name | Biology |
| concepts[16].id | https://openalex.org/C138885662 |
| concepts[16].level | 0 |
| concepts[16].score | 0.0 |
| concepts[16].wikidata | https://www.wikidata.org/wiki/Q5891 |
| concepts[16].display_name | Philosophy |
| concepts[17].id | https://openalex.org/C121332964 |
| concepts[17].level | 0 |
| concepts[17].score | 0.0 |
| concepts[17].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[17].display_name | Physics |
| concepts[18].id | https://openalex.org/C199360897 |
| concepts[18].level | 1 |
| concepts[18].score | 0.0 |
| concepts[18].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[18].display_name | Programming language |
| concepts[19].id | https://openalex.org/C62520636 |
| concepts[19].level | 1 |
| concepts[19].score | 0.0 |
| concepts[19].wikidata | https://www.wikidata.org/wiki/Q944 |
| concepts[19].display_name | Quantum mechanics |
| concepts[20].id | https://openalex.org/C21547014 |
| concepts[20].level | 1 |
| concepts[20].score | 0.0 |
| concepts[20].wikidata | https://www.wikidata.org/wiki/Q1423657 |
| concepts[20].display_name | Operations management |
| concepts[21].id | https://openalex.org/C31258907 |
| concepts[21].level | 1 |
| concepts[21].score | 0.0 |
| concepts[21].wikidata | https://www.wikidata.org/wiki/Q1301371 |
| concepts[21].display_name | Computer network |
| concepts[22].id | https://openalex.org/C162324750 |
| concepts[22].level | 0 |
| concepts[22].score | 0.0 |
| concepts[22].wikidata | https://www.wikidata.org/wiki/Q8134 |
| concepts[22].display_name | Economics |
| concepts[23].id | https://openalex.org/C111472728 |
| concepts[23].level | 1 |
| concepts[23].score | 0.0 |
| concepts[23].wikidata | https://www.wikidata.org/wiki/Q9471 |
| concepts[23].display_name | Epistemology |
| concepts[24].id | https://openalex.org/C55493867 |
| concepts[24].level | 1 |
| concepts[24].score | 0.0 |
| concepts[24].wikidata | https://www.wikidata.org/wiki/Q7094 |
| concepts[24].display_name | Biochemistry |
| keywords[0].id | https://openalex.org/keywords/replication |
| keywords[0].score | 0.6901397109031677 |
| keywords[0].display_name | Replication (statistics) |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.6891268491744995 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/data-science |
| keywords[2].score | 0.6285476684570312 |
| keywords[2].display_name | Data science |
| keywords[3].id | https://openalex.org/keywords/psycinfo |
| keywords[3].score | 0.5882607698440552 |
| keywords[3].display_name | PsycINFO |
| keywords[4].id | https://openalex.org/keywords/metric |
| keywords[4].score | 0.5674303770065308 |
| keywords[4].display_name | Metric (unit) |
| keywords[5].id | https://openalex.org/keywords/scopus |
| keywords[5].score | 0.5565958619117737 |
| keywords[5].display_name | Scopus |
| keywords[6].id | https://openalex.org/keywords/econlit |
| keywords[6].score | 0.5427922606468201 |
| keywords[6].display_name | EconLit |
| keywords[7].id | https://openalex.org/keywords/scale |
| keywords[7].score | 0.5338054299354553 |
| keywords[7].display_name | Scale (ratio) |
| keywords[8].id | https://openalex.org/keywords/multitude |
| keywords[8].score | 0.5077880024909973 |
| keywords[8].display_name | Multitude |
| keywords[9].id | https://openalex.org/keywords/set |
| keywords[9].score | 0.4903841018676758 |
| keywords[9].display_name | Set (abstract data type) |
| keywords[10].id | https://openalex.org/keywords/resource |
| keywords[10].score | 0.4423525333404541 |
| keywords[10].display_name | Resource (disambiguation) |
| keywords[11].id | https://openalex.org/keywords/information-retrieval |
| keywords[11].score | 0.3556400537490845 |
| keywords[11].display_name | Information retrieval |
| keywords[12].id | https://openalex.org/keywords/medline |
| keywords[12].score | 0.34570300579071045 |
| keywords[12].display_name | MEDLINE |
| keywords[13].id | https://openalex.org/keywords/mathematics |
| keywords[13].score | 0.11892050504684448 |
| keywords[13].display_name | Mathematics |
| keywords[14].id | https://openalex.org/keywords/statistics |
| keywords[14].score | 0.10970604419708252 |
| keywords[14].display_name | Statistics |
| keywords[15].id | https://openalex.org/keywords/biology |
| keywords[15].score | 0.08919957280158997 |
| keywords[15].display_name | Biology |
| language | en |
| locations[0].id | doi:10.1098/rsos.242076 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S2737558550 |
| locations[0].source.issn | 2054-5703 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 2054-5703 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | Royal Society Open Science |
| locations[0].source.host_organization | https://openalex.org/P4310319787 |
| locations[0].source.host_organization_name | Royal Society |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319787 |
| locations[0].source.host_organization_lineage_names | Royal Society |
| locations[0].license | cc-by |
| locations[0].pdf_url | |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Royal Society Open Science |
| locations[0].landing_page_url | https://doi.org/10.1098/rsos.242076 |
| locations[1].id | pmid:40894102 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Royal Society open science |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/40894102 |
| locations[2].id | pmh:oai:doaj.org/article:8837bd9e86554e9a9c9209d41401c87a |
| locations[2].is_oa | False |
| locations[2].source.id | https://openalex.org/S4306401280 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[2].source.host_organization | |
| locations[2].source.host_organization_name | |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | article |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | Royal Society Open Science, Vol 12, Iss 7 (2025) |
| locations[2].landing_page_url | https://doaj.org/article/8837bd9e86554e9a9c9209d41401c87a |
| locations[3].id | pmh:oai:pubmedcentral.nih.gov:12395386 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S2764455111 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | PubMed Central |
| locations[3].source.host_organization | https://openalex.org/I1299303238 |
| locations[3].source.host_organization_name | National Institutes of Health |
| locations[3].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[3].license | cc-by |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | Text |
| locations[3].license_id | https://openalex.org/licenses/cc-by |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | R Soc Open Sci |
| locations[3].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/12395386 |
| locations[4].id | pmh:oai:repository.ubn.ru.nl:2066/322730 |
| locations[4].is_oa | False |
| locations[4].source.id | https://openalex.org/S4306401067 |
| locations[4].source.issn | |
| locations[4].source.type | repository |
| locations[4].source.is_oa | False |
| locations[4].source.issn_l | |
| locations[4].source.is_core | False |
| locations[4].source.is_in_doaj | False |
| locations[4].source.display_name | Radboud Repository (Radboud University) |
| locations[4].source.host_organization | https://openalex.org/I145872427 |
| locations[4].source.host_organization_name | Radboud University Nijmegen |
| locations[4].source.host_organization_lineage | https://openalex.org/I145872427 |
| locations[4].license | |
| locations[4].pdf_url | |
| locations[4].version | submittedVersion |
| locations[4].raw_type | Article / Letter to editor |
| locations[4].license_id | |
| locations[4].is_accepted | False |
| locations[4].is_published | False |
| locations[4].raw_source_name | |
| locations[4].landing_page_url | https://hdl.handle.net/2066/322730 |
| indexed_in | crossref, doaj, pubmed |
| authorships[0].author.id | https://openalex.org/A5085918982 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-7531-4333 |
| authorships[0].author.display_name | Rachel Heyard |
| authorships[0].countries | CH |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I202697423 |
| authorships[0].affiliations[0].raw_affiliation_string | Center for Reproducible Science, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[0].institutions[0].id | https://openalex.org/I202697423 |
| authorships[0].institutions[0].ror | https://ror.org/02crff812 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I202697423 |
| authorships[0].institutions[0].country_code | CH |
| authorships[0].institutions[0].display_name | University of Zurich |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Rachel Heyard |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Center for Reproducible Science, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[1].author.id | https://openalex.org/A5038190384 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-2779-320X |
| authorships[1].author.display_name | Samuel Pawel |
| authorships[1].countries | CH |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I202697423 |
| authorships[1].affiliations[0].raw_affiliation_string | Department of Biostatistics, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[1].institutions[0].id | https://openalex.org/I202697423 |
| authorships[1].institutions[0].ror | https://ror.org/02crff812 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I202697423 |
| authorships[1].institutions[0].country_code | CH |
| authorships[1].institutions[0].display_name | University of Zurich |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Samuel Pawel |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Department of Biostatistics, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[2].author.id | https://openalex.org/A5032406666 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-5871-997X |
| authorships[2].author.display_name | Joris Frese |
| authorships[2].countries | IT |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I874792244 |
| authorships[2].affiliations[0].raw_affiliation_string | Department of Political and Social Sciences, European University Institute |
| authorships[2].institutions[0].id | https://openalex.org/I874792244 |
| authorships[2].institutions[0].ror | https://ror.org/0031wrj91 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I874792244 |
| authorships[2].institutions[0].country_code | IT |
| authorships[2].institutions[0].display_name | European University Institute |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Joris Frese |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Department of Political and Social Sciences, European University Institute |
| authorships[3].author.id | https://openalex.org/A5035897648 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-5454-2508 |
| authorships[3].author.display_name | Bernhard Voelkl |
| authorships[3].countries | CH |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I118564535 |
| authorships[3].affiliations[0].raw_affiliation_string | University of Bern |
| authorships[3].institutions[0].id | https://openalex.org/I118564535 |
| authorships[3].institutions[0].ror | https://ror.org/02k7v4d05 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I118564535 |
| authorships[3].institutions[0].country_code | CH |
| authorships[3].institutions[0].display_name | University of Bern |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Bernhard Voelkl |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | University of Bern |
| authorships[4].author.id | https://openalex.org/A5027072532 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-2934-3010 |
| authorships[4].author.display_name | Hanno Wuerbel |
| authorships[4].countries | CH |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I118564535 |
| authorships[4].affiliations[0].raw_affiliation_string | University of Bern |
| authorships[4].institutions[0].id | https://openalex.org/I118564535 |
| authorships[4].institutions[0].ror | https://ror.org/02k7v4d05 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I118564535 |
| authorships[4].institutions[0].country_code | CH |
| authorships[4].institutions[0].display_name | University of Bern |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Hanno Würbel |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | University of Bern |
| authorships[5].author.id | https://openalex.org/A5045342203 |
| authorships[5].author.orcid | https://orcid.org/0000-0003-4737-2349 |
| authorships[5].author.display_name | Sarah McCann |
| authorships[5].countries | DE |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I4210139777 |
| authorships[5].affiliations[0].raw_affiliation_string | Berlin Institute of Health at Charité QUEST Center for Responsible Research |
| authorships[5].institutions[0].id | https://openalex.org/I4210139777 |
| authorships[5].institutions[0].ror | https://ror.org/0493xsw21 |
| authorships[5].institutions[0].type | facility |
| authorships[5].institutions[0].lineage | https://openalex.org/I4210139777, https://openalex.org/I7877124 |
| authorships[5].institutions[0].country_code | DE |
| authorships[5].institutions[0].display_name | Berlin Institute of Health at Charité - Universitätsmedizin Berlin |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Sarah McCann |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | Berlin Institute of Health at Charité QUEST Center for Responsible Research |
| authorships[6].author.id | https://openalex.org/A5078043213 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-8686-5325 |
| authorships[6].author.display_name | Leonhard Held |
| authorships[6].countries | CH |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I202697423 |
| authorships[6].affiliations[0].raw_affiliation_string | Center for Reproducible Science, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[6].affiliations[1].institution_ids | https://openalex.org/I202697423 |
| authorships[6].affiliations[1].raw_affiliation_string | Department of Biostatistics, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[6].institutions[0].id | https://openalex.org/I202697423 |
| authorships[6].institutions[0].ror | https://ror.org/02crff812 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I202697423 |
| authorships[6].institutions[0].country_code | CH |
| authorships[6].institutions[0].display_name | University of Zurich |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Leonhard Held |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | Center for Reproducible Science, University of Zurich Institute of Epidemiology Biostatistics and Prevention, Department of Biostatistics, University of Zurich Institute of Epidemiology Biostatistics and Prevention |
| authorships[7].author.id | https://openalex.org/A5064022439 |
| authorships[7].author.orcid | https://orcid.org/0000-0003-3635-3660 |
| authorships[7].author.display_name | Kimberley E. Wever |
| authorships[7].countries | NL, US |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I145872427, https://openalex.org/I2802849423, https://openalex.org/I2802934949 |
| authorships[7].affiliations[0].raw_affiliation_string | Departmentof Anesthesiology, Pain and Palliative Care, Radboud University Medical Center |
| authorships[7].institutions[0].id | https://openalex.org/I2802934949 |
| authorships[7].institutions[0].ror | https://ror.org/05wg1m734 |
| authorships[7].institutions[0].type | healthcare |
| authorships[7].institutions[0].lineage | https://openalex.org/I2802934949 |
| authorships[7].institutions[0].country_code | NL |
| authorships[7].institutions[0].display_name | Radboud University Medical Center |
| authorships[7].institutions[1].id | https://openalex.org/I145872427 |
| authorships[7].institutions[1].ror | https://ror.org/016xsfp80 |
| authorships[7].institutions[1].type | education |
| authorships[7].institutions[1].lineage | https://openalex.org/I145872427 |
| authorships[7].institutions[1].country_code | NL |
| authorships[7].institutions[1].display_name | Radboud University Nijmegen |
| authorships[7].institutions[2].id | https://openalex.org/I2802849423 |
| authorships[7].institutions[2].ror | https://ror.org/036pt7h44 |
| authorships[7].institutions[2].type | healthcare |
| authorships[7].institutions[2].lineage | https://openalex.org/I2802849423 |
| authorships[7].institutions[2].country_code | US |
| authorships[7].institutions[2].display_name | University Medical Center |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Kimberley E. Wever |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | Departmentof Anesthesiology, Pain and Palliative Care, Radboud University Medical Center |
| authorships[8].author.id | https://openalex.org/A5029109834 |
| authorships[8].author.orcid | https://orcid.org/0000-0002-1331-6683 |
| authorships[8].author.display_name | Helena Hartmann |
| authorships[8].affiliations[0].raw_affiliation_string | Department of Neurology and Center for Translational, Neuro- and Behavioral Sciences, University Hospital Essen |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Helena Hartmann |
| authorships[8].is_corresponding | False |
| authorships[8].raw_affiliation_strings | Department of Neurology and Center for Translational, Neuro- and Behavioral Sciences, University Hospital Essen |
| authorships[9].author.id | https://openalex.org/A5032137854 |
| authorships[9].author.orcid | https://orcid.org/0000-0002-2212-1626 |
| authorships[9].author.display_name | Louise Townsin |
| authorships[9].countries | AU |
| authorships[9].affiliations[0].institution_ids | https://openalex.org/I4210142395 |
| authorships[9].affiliations[0].raw_affiliation_string | Research and Innovation Office, Torrens University Australia |
| authorships[9].institutions[0].id | https://openalex.org/I4210142395 |
| authorships[9].institutions[0].ror | https://ror.org/0351xae06 |
| authorships[9].institutions[0].type | education |
| authorships[9].institutions[0].lineage | https://openalex.org/I4210142395 |
| authorships[9].institutions[0].country_code | AU |
| authorships[9].institutions[0].display_name | Torrens University Australia |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Louise Townsin |
| authorships[9].is_corresponding | False |
| authorships[9].raw_affiliation_strings | Research and Innovation Office, Torrens University Australia |
| authorships[10].author.id | https://openalex.org/A5039496797 |
| authorships[10].author.orcid | https://orcid.org/0000-0001-8927-3483 |
| authorships[10].author.display_name | Stephanie Zellers |
| authorships[10].countries | FI |
| authorships[10].affiliations[0].institution_ids | https://openalex.org/I133731052, https://openalex.org/I4210107997, https://openalex.org/I4210133586, https://openalex.org/I4389424196 |
| authorships[10].affiliations[0].raw_affiliation_string | Institute for Molecular Medicine Finland, University of Helsinki |
| authorships[10].institutions[0].id | https://openalex.org/I4389424196 |
| authorships[10].institutions[0].ror | |
| authorships[10].institutions[0].type | |
| authorships[10].institutions[0].lineage | https://openalex.org/I4389424196 |
| authorships[10].institutions[0].country_code | |
| authorships[10].institutions[0].display_name | Deleted Institution |
| authorships[10].institutions[1].id | https://openalex.org/I4210107997 |
| authorships[10].institutions[1].ror | https://ror.org/014rks409 |
| authorships[10].institutions[1].type | education |
| authorships[10].institutions[1].lineage | https://openalex.org/I4210107997 |
| authorships[10].institutions[1].country_code | FI |
| authorships[10].institutions[1].display_name | Finland University |
| authorships[10].institutions[2].id | https://openalex.org/I4210133586 |
| authorships[10].institutions[2].ror | https://ror.org/030sbze61 |
| authorships[10].institutions[2].type | facility |
| authorships[10].institutions[2].lineage | https://openalex.org/I133731052, https://openalex.org/I4210133586 |
| authorships[10].institutions[2].country_code | FI |
| authorships[10].institutions[2].display_name | Institute for Molecular Medicine Finland |
| authorships[10].institutions[3].id | https://openalex.org/I133731052 |
| authorships[10].institutions[3].ror | https://ror.org/040af2s02 |
| authorships[10].institutions[3].type | education |
| authorships[10].institutions[3].lineage | https://openalex.org/I133731052 |
| authorships[10].institutions[3].country_code | FI |
| authorships[10].institutions[3].display_name | University of Helsinki |
| authorships[10].author_position | last |
| authorships[10].raw_author_name | Stephanie Zellers |
| authorships[10].is_corresponding | False |
| authorships[10].raw_affiliation_strings | Institute for Molecular Medicine Finland, University of Helsinki |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://doi.org/10.1098/rsos.242076 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10206 |
| primary_topic.field.id | https://openalex.org/fields/18 |
| primary_topic.field.display_name | Decision Sciences |
| primary_topic.score | 0.9987000226974487 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1804 |
| primary_topic.subfield.display_name | Statistics, Probability and Uncertainty |
| primary_topic.display_name | Meta-analysis and systematic reviews |
| related_works | https://openalex.org/W2417432647, https://openalex.org/W2371114124, https://openalex.org/W2168950483, https://openalex.org/W1975110769, https://openalex.org/W2378535610, https://openalex.org/W4213029470, https://openalex.org/W2798951784, https://openalex.org/W657803122, https://openalex.org/W2088098466, https://openalex.org/W3121744968 |
| cited_by_count | 2 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 2 |
| locations_count | 5 |
| best_oa_location.id | doi:10.1098/rsos.242076 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S2737558550 |
| best_oa_location.source.issn | 2054-5703 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 2054-5703 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | Royal Society Open Science |
| best_oa_location.source.host_organization | https://openalex.org/P4310319787 |
| best_oa_location.source.host_organization_name | Royal Society |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319787 |
| best_oa_location.source.host_organization_lineage_names | Royal Society |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Royal Society Open Science |
| best_oa_location.landing_page_url | https://doi.org/10.1098/rsos.242076 |
| primary_location.id | doi:10.1098/rsos.242076 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S2737558550 |
| primary_location.source.issn | 2054-5703 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 2054-5703 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | Royal Society Open Science |
| primary_location.source.host_organization | https://openalex.org/P4310319787 |
| primary_location.source.host_organization_name | Royal Society |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319787 |
| primary_location.source.host_organization_lineage_names | Royal Society |
| primary_location.license | cc-by |
| primary_location.pdf_url | |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Royal Society Open Science |
| primary_location.landing_page_url | https://doi.org/10.1098/rsos.242076 |
| publication_date | 2025-07-01 |
| publication_year | 2025 |
| referenced_works | https://openalex.org/W2493554054, https://openalex.org/W2414283705, https://openalex.org/W2787858429, https://openalex.org/W6925105714, https://openalex.org/W2944196828, https://openalex.org/W3142490982, https://openalex.org/W2789816182, https://openalex.org/W6931121287, https://openalex.org/W2005474634, https://openalex.org/W4241077770, https://openalex.org/W1783185511, https://openalex.org/W4381469238, https://openalex.org/W1897139626, https://openalex.org/W2292391400, https://openalex.org/W4200247206, https://openalex.org/W3162470712, https://openalex.org/W3088845782, https://openalex.org/W3161588210, https://openalex.org/W2891378911, https://openalex.org/W2797413227, https://openalex.org/W2776961836, https://openalex.org/W3149645252, https://openalex.org/W4396214724, https://openalex.org/W2766894915, https://openalex.org/W2560438049, https://openalex.org/W3123380744, https://openalex.org/W4293802544, https://openalex.org/W1941783251, https://openalex.org/W2901258965, https://openalex.org/W3169848230, https://openalex.org/W3121539305, https://openalex.org/W4388479433, https://openalex.org/W2486097122, https://openalex.org/W2520456228, https://openalex.org/W4366992020, https://openalex.org/W2936257342, https://openalex.org/W2776998249, https://openalex.org/W2499154041, https://openalex.org/W2783872725, https://openalex.org/W4384938832, https://openalex.org/W4390104160, https://openalex.org/W2790735892, https://openalex.org/W2587181900, https://openalex.org/W2985923507, https://openalex.org/W3170447327, https://openalex.org/W4318150379, https://openalex.org/W2903943377, https://openalex.org/W4390929439, https://openalex.org/W3041984699, https://openalex.org/W3136488616, https://openalex.org/W4213198012, https://openalex.org/W3047574483, https://openalex.org/W4396856415, https://openalex.org/W2039275898, https://openalex.org/W2321775828, https://openalex.org/W2155930071, https://openalex.org/W2081861598, https://openalex.org/W3022724943, https://openalex.org/W2543067875, https://openalex.org/W4386508029, https://openalex.org/W3150268191, https://openalex.org/W2807982285, https://openalex.org/W3124580540, https://openalex.org/W3170338789, https://openalex.org/W3027734160, https://openalex.org/W1969800236, https://openalex.org/W2902529531, https://openalex.org/W2979112662, https://openalex.org/W6733998515, https://openalex.org/W2146380848, https://openalex.org/W3135976454, https://openalex.org/W4385330851, https://openalex.org/W2059846051, https://openalex.org/W2891038028, https://openalex.org/W4200094199, https://openalex.org/W2120209818, https://openalex.org/W2081357147, https://openalex.org/W3136751137, https://openalex.org/W2119303750, https://openalex.org/W2886255325, https://openalex.org/W2952889327, https://openalex.org/W3016025207, https://openalex.org/W3146351140, https://openalex.org/W2553179642, https://openalex.org/W4286632955, https://openalex.org/W4309878948, https://openalex.org/W2762364541, https://openalex.org/W2886512263, https://openalex.org/W2524174858, https://openalex.org/W1502876530, https://openalex.org/W2129098555, https://openalex.org/W4225656869, https://openalex.org/W1985741291, https://openalex.org/W2594755663, https://openalex.org/W4307475647, https://openalex.org/W4321102181, https://openalex.org/W4366261939, https://openalex.org/W4391418157, https://openalex.org/W2164957370, https://openalex.org/W4281725022, https://openalex.org/W4294740949, https://openalex.org/W2125435699, https://openalex.org/W4287307274, https://openalex.org/W2064497749, https://openalex.org/W3162111148, https://openalex.org/W4221149787, https://openalex.org/W3027130718, https://openalex.org/W2884318343, https://openalex.org/W1119084953, https://openalex.org/W4221046810, https://openalex.org/W4390268582, https://openalex.org/W2768067512, https://openalex.org/W2916522419, https://openalex.org/W2073157712, https://openalex.org/W4285236184, https://openalex.org/W4310157675, https://openalex.org/W4301737008, https://openalex.org/W2767099881, https://openalex.org/W3205724747, https://openalex.org/W2996974883, https://openalex.org/W4282545449, https://openalex.org/W4381379033, https://openalex.org/W4220692043, https://openalex.org/W2005903872, https://openalex.org/W2968439389, https://openalex.org/W2151509224, https://openalex.org/W4392720653, https://openalex.org/W2604559382, https://openalex.org/W3030972095, https://openalex.org/W3124690569, https://openalex.org/W4294233607, https://openalex.org/W2995917808, https://openalex.org/W3174615791, https://openalex.org/W2755388963, https://openalex.org/W2777631817, https://openalex.org/W2015795623, https://openalex.org/W2105374537, https://openalex.org/W3116019023, https://openalex.org/W4226404322, https://openalex.org/W2133689199, https://openalex.org/W2145409614, https://openalex.org/W2090625011, https://openalex.org/W4282921857, https://openalex.org/W2999771059, https://openalex.org/W2588020571, https://openalex.org/W3049474127, https://openalex.org/W4375840921, https://openalex.org/W4207044951, https://openalex.org/W3023516546, https://openalex.org/W4318577410, https://openalex.org/W3170885199, https://openalex.org/W4286110835, https://openalex.org/W3094030525, https://openalex.org/W4381326140, https://openalex.org/W4401899049, https://openalex.org/W3084046422, https://openalex.org/W4411588470, https://openalex.org/W4312209659, https://openalex.org/W4200492661, https://openalex.org/W2962933468, https://openalex.org/W2592090507 |
| referenced_works_count | 161 |
| abstract_inverted_index.a | 35, 43, 50, 153, 159, 166 |
| abstract_inverted_index.49 | 115 |
| abstract_inverted_index.50 | 124 |
| abstract_inverted_index.97 | 119 |
| abstract_inverted_index.We | 48, 113 |
| abstract_inverted_index.as | 3 |
| abstract_inverted_index.by | 74 |
| abstract_inverted_index.in | 91, 162, 178 |
| abstract_inverted_index.is | 1, 46 |
| abstract_inverted_index.no | 28 |
| abstract_inverted_index.of | 21, 38, 165 |
| abstract_inverted_index.on | 99, 104, 131 |
| abstract_inverted_index.or | 66, 109 |
| abstract_inverted_index.to | 5, 17, 31, 53, 180 |
| abstract_inverted_index.we | 81 |
| abstract_inverted_index.For | 77 |
| abstract_inverted_index.Our | 156 |
| abstract_inverted_index.The | 69, 126 |
| abstract_inverted_index.and | 8, 12, 42, 61, 86, 102, 118, 122, 141, 146, 174, 192 |
| abstract_inverted_index.are | 187 |
| abstract_inverted_index.for | 170 |
| abstract_inverted_index.has | 40 |
| abstract_inverted_index.how | 179 |
| abstract_inverted_index.set | 37 |
| abstract_inverted_index.the | 75, 78, 163, 182 |
| abstract_inverted_index.was | 72, 111 |
| abstract_inverted_index.Each | 150 |
| abstract_inverted_index.form | 164 |
| abstract_inverted_index.have | 23 |
| abstract_inverted_index.list | 71 |
| abstract_inverted_index.more | 25 |
| abstract_inverted_index.most | 183 |
| abstract_inverted_index.that | 58, 64, 186 |
| abstract_inverted_index.type | 132 |
| abstract_inverted_index.used | 59 |
| abstract_inverted_index.were | 89, 128 |
| abstract_inverted_index.with | 189 |
| abstract_inverted_index.Since | 27 |
| abstract_inverted_index.based | 130 |
| abstract_inverted_index.input | 144 |
| abstract_inverted_index.table | 169 |
| abstract_inverted_index.teams | 173 |
| abstract_inverted_index.used, | 107 |
| abstract_inverted_index.aiming | 16 |
| abstract_inverted_index.and/or | 134 |
| abstract_inverted_index.become | 24 |
| abstract_inverted_index.future | 171 |
| abstract_inverted_index.goals. | 194 |
| abstract_inverted_index.metric | 151 |
| abstract_inverted_index.papers | 63, 121 |
| abstract_inverted_index.review | 52, 157 |
| abstract_inverted_index.select | 181 |
| abstract_inverted_index.Records | 88 |
| abstract_inverted_index.Scopus, | 83 |
| abstract_inverted_index.against | 93 |
| abstract_inverted_index.aligned | 188 |
| abstract_inverted_index.aspects | 20 |
| abstract_inverted_index.common. | 26 |
| abstract_inverted_index.diverse | 36 |
| abstract_inverted_index.emerged | 41 |
| abstract_inverted_index.exists, | 34 |
| abstract_inverted_index.metrics | 39, 60, 106, 127, 185 |
| abstract_inverted_index.models, | 136 |
| abstract_inverted_index.needed. | 47 |
| abstract_inverted_index.papers, | 80 |
| abstract_inverted_index.project | 70, 193 |
| abstract_inverted_index.records | 101 |
| abstract_inverted_index.scoping | 51 |
| abstract_inverted_index.studies | 11, 140 |
| abstract_inverted_index.support | 177 |
| abstract_inverted_index.EconLit. | 87 |
| abstract_inverted_index.MedLine, | 84 |
| abstract_inverted_index.PsycINFO | 85 |
| abstract_inverted_index.approach | 30 |
| abstract_inverted_index.authors. | 76 |
| abstract_inverted_index.compiled | 73 |
| abstract_inverted_index.distinct | 154 |
| abstract_inverted_index.identify | 54 |
| abstract_inverted_index.included | 100 |
| abstract_inverted_index.metrics. | 68, 125 |
| abstract_inverted_index.offering | 176 |
| abstract_inverted_index.overview | 45 |
| abstract_inverted_index.progress | 7 |
| abstract_inverted_index.projects | 57, 117 |
| abstract_inverted_index.proposed | 65 |
| abstract_inverted_index.provides | 158 |
| abstract_inverted_index.quantify | 18 |
| abstract_inverted_index.required | 145 |
| abstract_inverted_index.research | 190 |
| abstract_inverted_index.resource | 161 |
| abstract_inverted_index.screened | 90 |
| abstract_inverted_index.searched | 82 |
| abstract_inverted_index.(formulas | 133 |
| abstract_inverted_index.addresses | 152 |
| abstract_inverted_index.conducted | 49 |
| abstract_inverted_index.criteria. | 96 |
| abstract_inverted_index.different | 19 |
| abstract_inverted_index.discussed | 67, 110 |
| abstract_inverted_index.duplicate | 92 |
| abstract_inverted_index.essential | 4 |
| abstract_inverted_index.extracted | 123 |
| abstract_inverted_index.graphical | 138 |
| abstract_inverted_index.inclusion | 95 |
| abstract_inverted_index.measuring | 32 |
| abstract_inverted_index.projects, | 15 |
| abstract_inverted_index.question. | 155 |
| abstract_inverted_index.questions | 191 |
| abstract_inverted_index.suggested | 108 |
| abstract_inverted_index.extracted. | 112 |
| abstract_inverted_index.identified | 114 |
| abstract_inverted_index.integrity. | 9 |
| abstract_inverted_index.recognized | 2 |
| abstract_inverted_index.scenarios. | 149 |
| abstract_inverted_index.scientific | 6 |
| abstract_inverted_index.Demographic | 97 |
| abstract_inverted_index.Replication | 10 |
| abstract_inverted_index.application | 148 |
| abstract_inverted_index.appropriate | 147, 184 |
| abstract_inverted_index.frameworks, | 137 |
| abstract_inverted_index.information | 98, 103 |
| abstract_inverted_index.interactive | 168 |
| abstract_inverted_index.large-scale | 13, 55, 116 |
| abstract_inverted_index.pre-defined | 94 |
| abstract_inverted_index.replication | 14, 56, 172 |
| abstract_inverted_index.statistical | 135 |
| abstract_inverted_index.‘live’, | 167 |
| abstract_inverted_index.algorithms), | 143 |
| abstract_inverted_index.standardized | 29 |
| abstract_inverted_index.characterized | 129 |
| abstract_inverted_index.comprehensive | 44, 160 |
| abstract_inverted_index.methodological | 62, 79, 120 |
| abstract_inverted_index.Reproducibility | 0 |
| abstract_inverted_index.questionnaires, | 142 |
| abstract_inverted_index.reproducibility | 33, 105 |
| abstract_inverted_index.representations, | 139 |
| abstract_inverted_index.reproducibility, | 22 |
| abstract_inverted_index.meta-researchers, | 175 |
| cited_by_percentile_year.max | 97 |
| cited_by_percentile_year.min | 95 |
| countries_distinct_count | 7 |
| institutions_distinct_count | 11 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/10 |
| sustainable_development_goals[0].score | 0.7599999904632568 |
| sustainable_development_goals[0].display_name | Reduced inequalities |
| citation_normalized_percentile.value | 0.9491105 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |