A response to critiques of ‘The reproducibility of research and the misinterpretation of p -values’ Article Swipe
I proposed (8, 1, 3) that p values should be supplemented by an estimate of\nthe false positive risk (FPR). FPR was defined as the probability that, if you\nclaim that there is a real effect on the basis of p value from a single\nunbiased experiment, that you will be mistaken and the result has occurred by\nchance. This is a Bayesian quantity and that means that there is an infinitude\nof ways to calculate it. My choice of a way to estimate FPR was, therefore,\narbitrary. I maintain that it is a reasonable way, and has the advantage of\nbeing mathematically simpler than other proposals and easier to understand than\nother methods. This might make it more easily accepted by users. As always, not\nevery statistician agrees. This paper is a response to a critique of my 2017\npaper (1) by Arandjelovic (2)\n
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1098/rsos.190819
- https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819
- OA Status
- gold
- References
- 26
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W2985151483
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2985151483Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1098/rsos.190819Digital Object Identifier
- Title
-
A response to critiques of ‘The reproducibility of research and the misinterpretation of p -values’Work title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2019Year of publication
- Publication date
-
2019-11-01Full publication date if available
- Authors
-
David ColquhounList of authors in order
- Landing page
-
https://doi.org/10.1098/rsos.190819Publisher landing page
- PDF URL
-
https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819Direct OA link when available
- Concepts
-
Reproducibility, Statistics, MathematicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- References (count)
-
26Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2985151483 |
|---|---|
| doi | https://doi.org/10.1098/rsos.190819 |
| ids.doi | https://doi.org/10.1098/rsos.190819 |
| ids.mag | 2985151483 |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/31827832 |
| ids.openalex | https://openalex.org/W2985151483 |
| fwci | 0.0 |
| type | article |
| title | A response to critiques of ‘The reproducibility of research and the misinterpretation of p -values’ |
| biblio.issue | 11 |
| biblio.volume | 6 |
| biblio.last_page | 190819 |
| biblio.first_page | 190819 |
| topics[0].id | https://openalex.org/T10206 |
| topics[0].field.id | https://openalex.org/fields/18 |
| topics[0].field.display_name | Decision Sciences |
| topics[0].score | 0.9957000017166138 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1804 |
| topics[0].subfield.display_name | Statistics, Probability and Uncertainty |
| topics[0].display_name | Meta-analysis and systematic reviews |
| topics[1].id | https://openalex.org/T10804 |
| topics[1].field.id | https://openalex.org/fields/20 |
| topics[1].field.display_name | Economics, Econometrics and Finance |
| topics[1].score | 0.991100013256073 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2002 |
| topics[1].subfield.display_name | Economics and Econometrics |
| topics[1].display_name | Health Systems, Economic Evaluations, Quality of Life |
| topics[2].id | https://openalex.org/T10845 |
| topics[2].field.id | https://openalex.org/fields/26 |
| topics[2].field.display_name | Mathematics |
| topics[2].score | 0.9609000086784363 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2613 |
| topics[2].subfield.display_name | Statistics and Probability |
| topics[2].display_name | Advanced Causal Inference Techniques |
| is_xpac | False |
| apc_list.value | 1200 |
| apc_list.currency | GBP |
| apc_list.value_usd | 1471 |
| apc_paid.value | 1200 |
| apc_paid.currency | GBP |
| apc_paid.value_usd | 1471 |
| concepts[0].id | https://openalex.org/C9893847 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6555517911911011 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1425625 |
| concepts[0].display_name | Reproducibility |
| concepts[1].id | https://openalex.org/C105795698 |
| concepts[1].level | 1 |
| concepts[1].score | 0.37544235587120056 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[1].display_name | Statistics |
| concepts[2].id | https://openalex.org/C33923547 |
| concepts[2].level | 0 |
| concepts[2].score | 0.28158771991729736 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[2].display_name | Mathematics |
| keywords[0].id | https://openalex.org/keywords/reproducibility |
| keywords[0].score | 0.6555517911911011 |
| keywords[0].display_name | Reproducibility |
| keywords[1].id | https://openalex.org/keywords/statistics |
| keywords[1].score | 0.37544235587120056 |
| keywords[1].display_name | Statistics |
| keywords[2].id | https://openalex.org/keywords/mathematics |
| keywords[2].score | 0.28158771991729736 |
| keywords[2].display_name | Mathematics |
| language | en |
| locations[0].id | doi:10.1098/rsos.190819 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S2737558550 |
| locations[0].source.issn | 2054-5703 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 2054-5703 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | Royal Society Open Science |
| locations[0].source.host_organization | https://openalex.org/P4310319787 |
| locations[0].source.host_organization_name | Royal Society |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319787 |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819 |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Royal Society Open Science |
| locations[0].landing_page_url | https://doi.org/10.1098/rsos.190819 |
| locations[1].id | pmid:31827832 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Royal Society open science |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/31827832 |
| locations[2].id | pmh:oai:arXiv.org:1905.08338 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306400194 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | True |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | arXiv (Cornell University) |
| locations[2].source.host_organization | https://openalex.org/I205783295 |
| locations[2].source.host_organization_name | Cornell University |
| locations[2].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[2].license | |
| locations[2].pdf_url | https://arxiv.org/pdf/1905.08338 |
| locations[2].version | submittedVersion |
| locations[2].raw_type | text |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | http://arxiv.org/abs/1905.08338 |
| locations[3].id | pmh:oai:doaj.org/article:501225e35d8a445f8d131cc979b6fdc9 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S4306401280 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[3].source.host_organization | |
| locations[3].source.host_organization_name | |
| locations[3].source.host_organization_lineage | |
| locations[3].license | cc-by-sa |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | article |
| locations[3].license_id | https://openalex.org/licenses/cc-by-sa |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | Royal Society Open Science, Vol 6, Iss 11 (2019) |
| locations[3].landing_page_url | https://doaj.org/article/501225e35d8a445f8d131cc979b6fdc9 |
| locations[4].id | pmh:oai:pubmedcentral.nih.gov:6894568 |
| locations[4].is_oa | True |
| locations[4].source.id | https://openalex.org/S2764455111 |
| locations[4].source.issn | |
| locations[4].source.type | repository |
| locations[4].source.is_oa | False |
| locations[4].source.issn_l | |
| locations[4].source.is_core | False |
| locations[4].source.is_in_doaj | False |
| locations[4].source.display_name | PubMed Central |
| locations[4].source.host_organization | https://openalex.org/I1299303238 |
| locations[4].source.host_organization_name | National Institutes of Health |
| locations[4].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[4].license | cc-by |
| locations[4].pdf_url | |
| locations[4].version | submittedVersion |
| locations[4].raw_type | Text |
| locations[4].license_id | https://openalex.org/licenses/cc-by |
| locations[4].is_accepted | False |
| locations[4].is_published | False |
| locations[4].raw_source_name | R Soc Open Sci |
| locations[4].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/6894568 |
| indexed_in | arxiv, crossref, doaj, pubmed |
| authorships[0].author.id | https://openalex.org/A5031818413 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-4263-017X |
| authorships[0].author.display_name | David Colquhoun |
| authorships[0].countries | GB |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I45129253 |
| authorships[0].affiliations[0].raw_affiliation_string | NPP, UCL, Medical Sciences, UCL, Gower Street, London WC1E 6BT, UK |
| authorships[0].institutions[0].id | https://openalex.org/I45129253 |
| authorships[0].institutions[0].ror | https://ror.org/02jx3x895 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I124357947, https://openalex.org/I45129253 |
| authorships[0].institutions[0].country_code | GB |
| authorships[0].institutions[0].display_name | University College London |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | David Colquhoun |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | NPP, UCL, Medical Sciences, UCL, Gower Street, London WC1E 6BT, UK |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | A response to critiques of ‘The reproducibility of research and the misinterpretation of p -values’ |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10206 |
| primary_topic.field.id | https://openalex.org/fields/18 |
| primary_topic.field.display_name | Decision Sciences |
| primary_topic.score | 0.9957000017166138 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1804 |
| primary_topic.subfield.display_name | Statistics, Probability and Uncertainty |
| primary_topic.display_name | Meta-analysis and systematic reviews |
| related_works | https://openalex.org/W2413717610, https://openalex.org/W1973270181, https://openalex.org/W2417696084, https://openalex.org/W2368782778, https://openalex.org/W2087830269, https://openalex.org/W3106281778, https://openalex.org/W2003643616, https://openalex.org/W638612878, https://openalex.org/W2140154150, https://openalex.org/W77799326 |
| cited_by_count | 0 |
| locations_count | 5 |
| best_oa_location.id | doi:10.1098/rsos.190819 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S2737558550 |
| best_oa_location.source.issn | 2054-5703 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 2054-5703 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | Royal Society Open Science |
| best_oa_location.source.host_organization | https://openalex.org/P4310319787 |
| best_oa_location.source.host_organization_name | Royal Society |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319787 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819 |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Royal Society Open Science |
| best_oa_location.landing_page_url | https://doi.org/10.1098/rsos.190819 |
| primary_location.id | doi:10.1098/rsos.190819 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S2737558550 |
| primary_location.source.issn | 2054-5703 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 2054-5703 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | Royal Society Open Science |
| primary_location.source.host_organization | https://openalex.org/P4310319787 |
| primary_location.source.host_organization_name | Royal Society |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319787 |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.190819 |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Royal Society Open Science |
| primary_location.landing_page_url | https://doi.org/10.1098/rsos.190819 |
| publication_date | 2019-11-01 |
| publication_year | 2019 |
| referenced_works | https://openalex.org/W2040032582, https://openalex.org/W2952752960, https://openalex.org/W2786045312, https://openalex.org/W2945460048, https://openalex.org/W2074941944, https://openalex.org/W2924950986, https://openalex.org/W2030346622, https://openalex.org/W6967418289, https://openalex.org/W4243759473, https://openalex.org/W2060512257, https://openalex.org/W2144981148, https://openalex.org/W2102945991, https://openalex.org/W2164544914, https://openalex.org/W1991926736, https://openalex.org/W2131046448, https://openalex.org/W2153204884, https://openalex.org/W2923323049, https://openalex.org/W1991058132, https://openalex.org/W2618605105, https://openalex.org/W3105571542, https://openalex.org/W3105309374, https://openalex.org/W1993725118, https://openalex.org/W2128585330, https://openalex.org/W2331384579, https://openalex.org/W3103877208, https://openalex.org/W4230891035 |
| referenced_works_count | 26 |
| abstract_inverted_index.I | 0, 82 |
| abstract_inverted_index.a | 31, 41, 57, 75, 87, 123, 126 |
| abstract_inverted_index.p | 6, 38 |
| abstract_inverted_index.1, | 3 |
| abstract_inverted_index.3) | 4 |
| abstract_inverted_index.As | 115 |
| abstract_inverted_index.My | 72 |
| abstract_inverted_index.an | 12, 66 |
| abstract_inverted_index.as | 22 |
| abstract_inverted_index.be | 9, 47 |
| abstract_inverted_index.by | 11, 113, 132 |
| abstract_inverted_index.if | 26 |
| abstract_inverted_index.is | 30, 56, 65, 86, 122 |
| abstract_inverted_index.it | 85, 109 |
| abstract_inverted_index.my | 129 |
| abstract_inverted_index.of | 37, 74, 128 |
| abstract_inverted_index.on | 34 |
| abstract_inverted_index.to | 69, 77, 102, 125 |
| abstract_inverted_index.(1) | 131 |
| abstract_inverted_index.(8, | 2 |
| abstract_inverted_index.FPR | 19, 79 |
| abstract_inverted_index.and | 49, 60, 90, 100 |
| abstract_inverted_index.has | 52, 91 |
| abstract_inverted_index.it. | 71 |
| abstract_inverted_index.the | 23, 35, 50, 92 |
| abstract_inverted_index.was | 20 |
| abstract_inverted_index.way | 76 |
| abstract_inverted_index.you | 45 |
| abstract_inverted_index.This | 55, 106, 120 |
| abstract_inverted_index.from | 40 |
| abstract_inverted_index.make | 108 |
| abstract_inverted_index.more | 110 |
| abstract_inverted_index.real | 32 |
| abstract_inverted_index.risk | 17 |
| abstract_inverted_index.than | 97 |
| abstract_inverted_index.that | 5, 28, 44, 61, 63, 84 |
| abstract_inverted_index.was, | 80 |
| abstract_inverted_index.way, | 89 |
| abstract_inverted_index.ways | 68 |
| abstract_inverted_index.will | 46 |
| abstract_inverted_index.(2)\n | 134 |
| abstract_inverted_index.basis | 36 |
| abstract_inverted_index.false | 15 |
| abstract_inverted_index.means | 62 |
| abstract_inverted_index.might | 107 |
| abstract_inverted_index.other | 98 |
| abstract_inverted_index.paper | 121 |
| abstract_inverted_index.that, | 25 |
| abstract_inverted_index.there | 29, 64 |
| abstract_inverted_index.value | 39 |
| abstract_inverted_index.(FPR). | 18 |
| abstract_inverted_index.choice | 73 |
| abstract_inverted_index.easier | 101 |
| abstract_inverted_index.easily | 111 |
| abstract_inverted_index.effect | 33 |
| abstract_inverted_index.result | 51 |
| abstract_inverted_index.should | 8 |
| abstract_inverted_index.users. | 114 |
| abstract_inverted_index.values | 7 |
| abstract_inverted_index.agrees. | 119 |
| abstract_inverted_index.always, | 116 |
| abstract_inverted_index.defined | 21 |
| abstract_inverted_index.of\nthe | 14 |
| abstract_inverted_index.simpler | 96 |
| abstract_inverted_index.Bayesian | 58 |
| abstract_inverted_index.accepted | 112 |
| abstract_inverted_index.critique | 127 |
| abstract_inverted_index.estimate | 13, 78 |
| abstract_inverted_index.maintain | 83 |
| abstract_inverted_index.methods. | 105 |
| abstract_inverted_index.mistaken | 48 |
| abstract_inverted_index.occurred | 53 |
| abstract_inverted_index.positive | 16 |
| abstract_inverted_index.proposed | 1 |
| abstract_inverted_index.quantity | 59 |
| abstract_inverted_index.response | 124 |
| abstract_inverted_index.advantage | 93 |
| abstract_inverted_index.calculate | 70 |
| abstract_inverted_index.of\nbeing | 94 |
| abstract_inverted_index.proposals | 99 |
| abstract_inverted_index.not\nevery | 117 |
| abstract_inverted_index.reasonable | 88 |
| abstract_inverted_index.understand | 103 |
| abstract_inverted_index.you\nclaim | 27 |
| abstract_inverted_index.2017\npaper | 130 |
| abstract_inverted_index.by\nchance. | 54 |
| abstract_inverted_index.experiment, | 43 |
| abstract_inverted_index.probability | 24 |
| abstract_inverted_index.than\nother | 104 |
| abstract_inverted_index.Arandjelovic | 133 |
| abstract_inverted_index.statistician | 118 |
| abstract_inverted_index.supplemented | 10 |
| abstract_inverted_index.infinitude\nof | 67 |
| abstract_inverted_index.mathematically | 95 |
| abstract_inverted_index.single\nunbiased | 42 |
| abstract_inverted_index.therefore,\narbitrary. | 81 |
| cited_by_percentile_year | |
| corresponding_author_ids | https://openalex.org/A5031818413 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 1 |
| corresponding_institution_ids | https://openalex.org/I45129253 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/5 |
| sustainable_development_goals[0].score | 0.5299999713897705 |
| sustainable_development_goals[0].display_name | Gender equality |
| citation_normalized_percentile.value | 0.14072306 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |