Exploration of reproducibility issues in scientometric research Article Swipe
Theresa Velden
,
Sybille Hinze
,
Andrea Scharnhorst
,
Jesper Wiborg Schneider
,
Ludo Waltman
·
YOU?
·
· 2018
· Open Access
·
YOU?
·
· 2018
· Open Access
·
This is a small-scale explorative study in an effort to assess reproducibility issues specific to scientometrics research. This effort is motivated by the desire to generate empirical data to inform debates about reproducibility in scientometrics. Rather than attempt to reproduce studies, we explore how we might assess ‘in principle’ reproducibility based on a critical review of the content of published papers. While the first part of the study focuses on direct reproducibility - that is the ability to reproduce the specific evidence produced by an original study using the same data, methods, and procedures, the second part is dedicated to conceptual reproducibility - that is the robustness of knowledge claims towards verification by an alternative approach using different data, methods and procedures. The study is exploratory: it investigates only a very limited number of publications and serves us to develop instruments for identifying potential reproducibility issues of published studies: These are a categorization of study types and a taxonomy of threats to reproducibility. We work with a select sample of five publications in scientometrics covering a variation of study types of theoretical, methodological, and empirical nature. Based on observations made during our exploratory review, we conclude with open questions to consider when adressing threats to reproducibility in scientometric research that are intended for discussion at the special track on ‘Reproducibility in Scientometrics’ at STI2018 in Leiden.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5
- https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5
- OA Status
- green
- Cited By
- 1
- Related Works
- 20
- OpenAlex ID
- https://openalex.org/W2912933545
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2912933545Canonical identifier for this work in OpenAlex
- Title
-
Exploration of reproducibility issues in scientometric researchWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2018Year of publication
- Publication date
-
2018-09-11Full publication date if available
- Authors
-
Theresa Velden, Sybille Hinze, Andrea Scharnhorst, Jesper Wiborg Schneider, Ludo WaltmanList of authors in order
- Landing page
-
https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5Publisher landing page
- PDF URL
-
https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5Direct OA link when available
- Concepts
-
Reproducibility, Scientometrics, Categorization, Data science, Computer science, Artificial intelligence, Statistics, Mathematics, Library scienceTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1Per-year citation counts (last 5 years)
- Related works (count)
-
20Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2912933545 |
|---|---|
| doi | |
| ids.mag | 2912933545 |
| ids.openalex | https://openalex.org/W2912933545 |
| fwci | 0.0 |
| type | article |
| title | Exploration of reproducibility issues in scientometric research |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | 624 |
| biblio.first_page | 612 |
| topics[0].id | https://openalex.org/T13283 |
| topics[0].field.id | https://openalex.org/fields/32 |
| topics[0].field.display_name | Psychology |
| topics[0].score | 0.9513000249862671 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/3205 |
| topics[0].subfield.display_name | Experimental and Cognitive Psychology |
| topics[0].display_name | Mental Health Research Topics |
| topics[1].id | https://openalex.org/T14393 |
| topics[1].field.id | https://openalex.org/fields/23 |
| topics[1].field.display_name | Environmental Science |
| topics[1].score | 0.930899977684021 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2307 |
| topics[1].subfield.display_name | Health, Toxicology and Mutagenesis |
| topics[1].display_name | Health, Environment, Cognitive Aging |
| topics[2].id | https://openalex.org/T13398 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9089999794960022 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Data Analysis with R |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C9893847 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8587483167648315 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1425625 |
| concepts[0].display_name | Reproducibility |
| concepts[1].id | https://openalex.org/C525823164 |
| concepts[1].level | 2 |
| concepts[1].score | 0.7868413925170898 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q472342 |
| concepts[1].display_name | Scientometrics |
| concepts[2].id | https://openalex.org/C94124525 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5794852375984192 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q912550 |
| concepts[2].display_name | Categorization |
| concepts[3].id | https://openalex.org/C2522767166 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5232875943183899 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[3].display_name | Data science |
| concepts[4].id | https://openalex.org/C41008148 |
| concepts[4].level | 0 |
| concepts[4].score | 0.45616796612739563 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[4].display_name | Computer science |
| concepts[5].id | https://openalex.org/C154945302 |
| concepts[5].level | 1 |
| concepts[5].score | 0.15361958742141724 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[5].display_name | Artificial intelligence |
| concepts[6].id | https://openalex.org/C105795698 |
| concepts[6].level | 1 |
| concepts[6].score | 0.1428510546684265 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[6].display_name | Statistics |
| concepts[7].id | https://openalex.org/C33923547 |
| concepts[7].level | 0 |
| concepts[7].score | 0.12528741359710693 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[7].display_name | Mathematics |
| concepts[8].id | https://openalex.org/C161191863 |
| concepts[8].level | 1 |
| concepts[8].score | 0.12431281805038452 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q199655 |
| concepts[8].display_name | Library science |
| keywords[0].id | https://openalex.org/keywords/reproducibility |
| keywords[0].score | 0.8587483167648315 |
| keywords[0].display_name | Reproducibility |
| keywords[1].id | https://openalex.org/keywords/scientometrics |
| keywords[1].score | 0.7868413925170898 |
| keywords[1].display_name | Scientometrics |
| keywords[2].id | https://openalex.org/keywords/categorization |
| keywords[2].score | 0.5794852375984192 |
| keywords[2].display_name | Categorization |
| keywords[3].id | https://openalex.org/keywords/data-science |
| keywords[3].score | 0.5232875943183899 |
| keywords[3].display_name | Data science |
| keywords[4].id | https://openalex.org/keywords/computer-science |
| keywords[4].score | 0.45616796612739563 |
| keywords[4].display_name | Computer science |
| keywords[5].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[5].score | 0.15361958742141724 |
| keywords[5].display_name | Artificial intelligence |
| keywords[6].id | https://openalex.org/keywords/statistics |
| keywords[6].score | 0.1428510546684265 |
| keywords[6].display_name | Statistics |
| keywords[7].id | https://openalex.org/keywords/mathematics |
| keywords[7].score | 0.12528741359710693 |
| keywords[7].display_name | Mathematics |
| keywords[8].id | https://openalex.org/keywords/library-science |
| keywords[8].score | 0.12431281805038452 |
| keywords[8].display_name | Library science |
| language | en |
| locations[0].id | pmh:knaw:oai:pure.knaw.nl:publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306401843 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | Data Archiving and Networked Services (DANS) |
| locations[0].source.host_organization | https://openalex.org/I1322597698 |
| locations[0].source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| locations[0].source.host_organization_lineage | https://openalex.org/I1322597698 |
| locations[0].license | other-oa |
| locations[0].pdf_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | info:eu-repo/semantics/other |
| locations[0].license_id | https://openalex.org/licenses/other-oa |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators, 612 - 624 |
| locations[0].landing_page_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| locations[1].id | pmh:oai:scholarlypublications.universiteitleiden.nl:item_2731525 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306530890 |
| locations[1].source.issn | |
| locations[1].source.type | conference |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | STI 2018 Conference Proceedings |
| locations[1].source.host_organization | |
| locations[1].source.host_organization_name | |
| locations[1].license | |
| locations[1].pdf_url | https://hdl.handle.net/1887/65315 |
| locations[1].version | submittedVersion |
| locations[1].raw_type | info:eu-repo/semantics/other |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | STI 2018 Conference Proceedings |
| locations[1].landing_page_url | https://hdl.handle.net/1887/65315 |
| locations[2].id | pmh:uls:oai:scholarlypublications.universiteitleiden.nl:item_2731525 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306401843 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | Data Archiving and Networked Services (DANS) |
| locations[2].source.host_organization | https://openalex.org/I1322597698 |
| locations[2].source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| locations[2].source.host_organization_lineage | https://openalex.org/I1322597698 |
| locations[2].license | other-oa |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | info:eu-repo/semantics/other |
| locations[2].license_id | https://openalex.org/licenses/other-oa |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | STI 2018 Conference Proceedings, 612 - 624 |
| locations[2].landing_page_url | http://hdl.handle.net/1887/2731525 |
| locations[3].id | mag:2912933545 |
| locations[3].is_oa | False |
| locations[3].source | |
| locations[3].license | |
| locations[3].pdf_url | |
| locations[3].version | |
| locations[3].raw_type | |
| locations[3].license_id | |
| locations[3].is_accepted | False |
| locations[3].is_published | |
| locations[3].raw_source_name | |
| locations[3].landing_page_url | https://scholarlypublications.universiteitleiden.nl/access/item%3A2733068/view |
| authorships[0].author.id | https://openalex.org/A5012802996 |
| authorships[0].author.orcid | https://orcid.org/0000-0001-8994-0776 |
| authorships[0].author.display_name | Theresa Velden |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Theresa Velden |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5037605512 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-1729-5680 |
| authorships[1].author.display_name | Sybille Hinze |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Sybille Hinze |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5090733139 |
| authorships[2].author.orcid | https://orcid.org/0000-0001-8879-8798 |
| authorships[2].author.display_name | Andrea Scharnhorst |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | A.M. Scharnhorst |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5087711642 |
| authorships[3].author.orcid | https://orcid.org/0000-0001-5556-0919 |
| authorships[3].author.display_name | Jesper Wiborg Schneider |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Jesper Wiborg Schneider |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5027467000 |
| authorships[4].author.orcid | |
| authorships[4].author.display_name | Ludo Waltman |
| authorships[4].author_position | last |
| authorships[4].raw_author_name | Ludo Waltman |
| authorships[4].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Exploration of reproducibility issues in scientometric research |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T04:12:42.849631 |
| primary_topic.id | https://openalex.org/T13283 |
| primary_topic.field.id | https://openalex.org/fields/32 |
| primary_topic.field.display_name | Psychology |
| primary_topic.score | 0.9513000249862671 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/3205 |
| primary_topic.subfield.display_name | Experimental and Cognitive Psychology |
| primary_topic.display_name | Mental Health Research Topics |
| related_works | https://openalex.org/W2796498042, https://openalex.org/W3154754686, https://openalex.org/W2161011220, https://openalex.org/W2806901780, https://openalex.org/W2801217900, https://openalex.org/W2999771059, https://openalex.org/W2792987835, https://openalex.org/W2777631817, https://openalex.org/W2993243702, https://openalex.org/W2562810876, https://openalex.org/W3020585554, https://openalex.org/W2399913254, https://openalex.org/W3111491034, https://openalex.org/W2903260151, https://openalex.org/W3199525923, https://openalex.org/W2899984894, https://openalex.org/W3125848264, https://openalex.org/W2963570409, https://openalex.org/W2096598237, https://openalex.org/W2296070158 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 4 |
| best_oa_location.id | pmh:knaw:oai:pure.knaw.nl:publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306401843 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | Data Archiving and Networked Services (DANS) |
| best_oa_location.source.host_organization | https://openalex.org/I1322597698 |
| best_oa_location.source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I1322597698 |
| best_oa_location.license | other-oa |
| best_oa_location.pdf_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | info:eu-repo/semantics/other |
| best_oa_location.license_id | https://openalex.org/licenses/other-oa |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators, 612 - 624 |
| best_oa_location.landing_page_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| primary_location.id | pmh:knaw:oai:pure.knaw.nl:publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306401843 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | Data Archiving and Networked Services (DANS) |
| primary_location.source.host_organization | https://openalex.org/I1322597698 |
| primary_location.source.host_organization_name | Royal Netherlands Academy of Arts and Sciences |
| primary_location.source.host_organization_lineage | https://openalex.org/I1322597698 |
| primary_location.license | other-oa |
| primary_location.pdf_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | info:eu-repo/semantics/other |
| primary_location.license_id | https://openalex.org/licenses/other-oa |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | STI 2018 Conference Proceedings Proceedings of the 23rd International Conference on Science and Technology Indicators, 612 - 624 |
| primary_location.landing_page_url | https://pure.knaw.nl/portal/en/publications/9beccf53-8ebc-4610-b0bc-7b266b2c83b5 |
| publication_date | 2018-09-11 |
| publication_year | 2018 |
| referenced_works_count | 0 |
| abstract_inverted_index.- | 72, 102 |
| abstract_inverted_index.a | 2, 52, 129, 151, 157, 166, 175 |
| abstract_inverted_index.We | 163 |
| abstract_inverted_index.an | 7, 84, 113 |
| abstract_inverted_index.at | 214, 222 |
| abstract_inverted_index.by | 21, 83, 112 |
| abstract_inverted_index.in | 6, 33, 172, 206, 220, 224 |
| abstract_inverted_index.is | 1, 19, 74, 97, 104, 124 |
| abstract_inverted_index.it | 126 |
| abstract_inverted_index.of | 55, 58, 65, 107, 133, 146, 153, 159, 169, 177, 180 |
| abstract_inverted_index.on | 51, 69, 187, 218 |
| abstract_inverted_index.to | 9, 14, 24, 28, 38, 77, 99, 138, 161, 199, 204 |
| abstract_inverted_index.us | 137 |
| abstract_inverted_index.we | 41, 44, 194 |
| abstract_inverted_index.The | 122 |
| abstract_inverted_index.and | 92, 120, 135, 156, 183 |
| abstract_inverted_index.are | 150, 210 |
| abstract_inverted_index.for | 141, 212 |
| abstract_inverted_index.how | 43 |
| abstract_inverted_index.our | 191 |
| abstract_inverted_index.the | 22, 56, 62, 66, 75, 79, 88, 94, 105, 215 |
| abstract_inverted_index.This | 0, 17 |
| abstract_inverted_index.data | 27 |
| abstract_inverted_index.five | 170 |
| abstract_inverted_index.made | 189 |
| abstract_inverted_index.only | 128 |
| abstract_inverted_index.open | 197 |
| abstract_inverted_index.part | 64, 96 |
| abstract_inverted_index.same | 89 |
| abstract_inverted_index.than | 36 |
| abstract_inverted_index.that | 73, 103, 209 |
| abstract_inverted_index.very | 130 |
| abstract_inverted_index.when | 201 |
| abstract_inverted_index.with | 165, 196 |
| abstract_inverted_index.work | 164 |
| abstract_inverted_index.Based | 186 |
| abstract_inverted_index.These | 149 |
| abstract_inverted_index.While | 61 |
| abstract_inverted_index.about | 31 |
| abstract_inverted_index.based | 50 |
| abstract_inverted_index.data, | 90, 118 |
| abstract_inverted_index.first | 63 |
| abstract_inverted_index.might | 45 |
| abstract_inverted_index.study | 5, 67, 86, 123, 154, 178 |
| abstract_inverted_index.track | 217 |
| abstract_inverted_index.types | 155, 179 |
| abstract_inverted_index.using | 87, 116 |
| abstract_inverted_index.‘in | 47 |
| abstract_inverted_index.Rather | 35 |
| abstract_inverted_index.assess | 10, 46 |
| abstract_inverted_index.claims | 109 |
| abstract_inverted_index.desire | 23 |
| abstract_inverted_index.direct | 70 |
| abstract_inverted_index.during | 190 |
| abstract_inverted_index.effort | 8, 18 |
| abstract_inverted_index.inform | 29 |
| abstract_inverted_index.issues | 12, 145 |
| abstract_inverted_index.number | 132 |
| abstract_inverted_index.review | 54 |
| abstract_inverted_index.sample | 168 |
| abstract_inverted_index.second | 95 |
| abstract_inverted_index.select | 167 |
| abstract_inverted_index.serves | 136 |
| abstract_inverted_index.Leiden. | 225 |
| abstract_inverted_index.STI2018 | 223 |
| abstract_inverted_index.ability | 76 |
| abstract_inverted_index.attempt | 37 |
| abstract_inverted_index.content | 57 |
| abstract_inverted_index.debates | 30 |
| abstract_inverted_index.develop | 139 |
| abstract_inverted_index.explore | 42 |
| abstract_inverted_index.focuses | 68 |
| abstract_inverted_index.limited | 131 |
| abstract_inverted_index.methods | 119 |
| abstract_inverted_index.nature. | 185 |
| abstract_inverted_index.papers. | 60 |
| abstract_inverted_index.review, | 193 |
| abstract_inverted_index.special | 216 |
| abstract_inverted_index.threats | 160, 203 |
| abstract_inverted_index.towards | 110 |
| abstract_inverted_index.approach | 115 |
| abstract_inverted_index.conclude | 195 |
| abstract_inverted_index.consider | 200 |
| abstract_inverted_index.covering | 174 |
| abstract_inverted_index.critical | 53 |
| abstract_inverted_index.evidence | 81 |
| abstract_inverted_index.generate | 25 |
| abstract_inverted_index.intended | 211 |
| abstract_inverted_index.methods, | 91 |
| abstract_inverted_index.original | 85 |
| abstract_inverted_index.produced | 82 |
| abstract_inverted_index.research | 208 |
| abstract_inverted_index.specific | 13, 80 |
| abstract_inverted_index.studies, | 40 |
| abstract_inverted_index.studies: | 148 |
| abstract_inverted_index.taxonomy | 158 |
| abstract_inverted_index.adressing | 202 |
| abstract_inverted_index.dedicated | 98 |
| abstract_inverted_index.different | 117 |
| abstract_inverted_index.empirical | 26, 184 |
| abstract_inverted_index.knowledge | 108 |
| abstract_inverted_index.motivated | 20 |
| abstract_inverted_index.potential | 143 |
| abstract_inverted_index.published | 59, 147 |
| abstract_inverted_index.questions | 198 |
| abstract_inverted_index.reproduce | 39, 78 |
| abstract_inverted_index.research. | 16 |
| abstract_inverted_index.variation | 176 |
| abstract_inverted_index.conceptual | 100 |
| abstract_inverted_index.discussion | 213 |
| abstract_inverted_index.robustness | 106 |
| abstract_inverted_index.alternative | 114 |
| abstract_inverted_index.explorative | 4 |
| abstract_inverted_index.exploratory | 192 |
| abstract_inverted_index.identifying | 142 |
| abstract_inverted_index.instruments | 140 |
| abstract_inverted_index.procedures, | 93 |
| abstract_inverted_index.procedures. | 121 |
| abstract_inverted_index.small-scale | 3 |
| abstract_inverted_index.exploratory: | 125 |
| abstract_inverted_index.investigates | 127 |
| abstract_inverted_index.observations | 188 |
| abstract_inverted_index.principle’ | 48 |
| abstract_inverted_index.publications | 134, 171 |
| abstract_inverted_index.theoretical, | 181 |
| abstract_inverted_index.verification | 111 |
| abstract_inverted_index.scientometric | 207 |
| abstract_inverted_index.categorization | 152 |
| abstract_inverted_index.scientometrics | 15, 173 |
| abstract_inverted_index.methodological, | 182 |
| abstract_inverted_index.reproducibility | 11, 32, 49, 71, 101, 144, 205 |
| abstract_inverted_index.scientometrics. | 34 |
| abstract_inverted_index.reproducibility. | 162 |
| abstract_inverted_index.Scientometrics’ | 221 |
| abstract_inverted_index.‘Reproducibility | 219 |
| cited_by_percentile_year.max | 95 |
| cited_by_percentile_year.min | 91 |
| countries_distinct_count | 0 |
| institutions_distinct_count | 5 |
| citation_normalized_percentile.value | 0.21597986 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |