An overview of methods for receiver operating characteristic analysis, with an application to SARS-CoV-2 vaccine-induced humoral responses in solid organ transplant recipients Article Swipe
Nathaniel P. Dowd
,
Bryan Blette
,
James D. Chappell
,
Natasha Halasa
,
Andrew J. Spieker
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2407.21253
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2407.21253
Receiver operating characteristic (ROC) analysis is a tool to evaluate the capacity of a numeric measure to distinguish between groups, often employed in the evaluation of diagnostic tests. Overall classification ability is sometimes crudely summarized by a single numeric measure such as the area under the empirical ROC curve. However, it may also be of interest to estimate the full ROC curve while leveraging assumptions regarding the nature of the data (parametric) or about the ROC curve directly (semiparametric). Although there has been recent interest in methods to conduct comparisons by way of stochastic ordering, nuances surrounding ROC geometry and estimation are not widely known in the broader scientific and statistical community. The overarching goals of this manuscript are to (1) provide an overview of existing frameworks for ROC curve estimation with examples, (2) offer intuition for and considerations regarding methodological trade-offs, and (3) supply sample R code to guide implementation. We utilize simulations to demonstrate the bias-variance trade-off across various methods. As an illustrative example, we analyze data from a recent cohort study in order to compare responses to SARS-CoV-2 vaccination between solid organ transplant recipients and healthy controls.
Related Topics
Concepts
Medicine
Virology
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)
Organ transplantation
Immunology
Coronavirus disease 2019 (COVID-19)
Internal medicine
Transplantation
Infectious disease (medical specialty)
Disease
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2407.21253
- https://arxiv.org/pdf/2407.21253
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4401306499
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4401306499Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2407.21253Digital Object Identifier
- Title
-
An overview of methods for receiver operating characteristic analysis, with an application to SARS-CoV-2 vaccine-induced humoral responses in solid organ transplant recipientsWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-07-31Full publication date if available
- Authors
-
Nathaniel P. Dowd, Bryan Blette, James D. Chappell, Natasha Halasa, Andrew J. SpiekerList of authors in order
- Landing page
-
https://arxiv.org/abs/2407.21253Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2407.21253Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2407.21253Direct OA link when available
- Concepts
-
Medicine, Virology, Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), Organ transplantation, Immunology, Coronavirus disease 2019 (COVID-19), Internal medicine, Transplantation, Infectious disease (medical specialty), DiseaseTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4401306499 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2407.21253 |
| ids.doi | https://doi.org/10.48550/arxiv.2407.21253 |
| ids.openalex | https://openalex.org/W4401306499 |
| fwci | |
| type | preprint |
| title | An overview of methods for receiver operating characteristic analysis, with an application to SARS-CoV-2 vaccine-induced humoral responses in solid organ transplant recipients |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10118 |
| topics[0].field.id | https://openalex.org/fields/27 |
| topics[0].field.display_name | Medicine |
| topics[0].score | 0.9902999997138977 |
| topics[0].domain.id | https://openalex.org/domains/4 |
| topics[0].domain.display_name | Health Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2725 |
| topics[0].subfield.display_name | Infectious Diseases |
| topics[0].display_name | SARS-CoV-2 and COVID-19 Research |
| topics[1].id | https://openalex.org/T11036 |
| topics[1].field.id | https://openalex.org/fields/27 |
| topics[1].field.display_name | Medicine |
| topics[1].score | 0.9121000170707703 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2736 |
| topics[1].subfield.display_name | Pharmacology |
| topics[1].display_name | Antibiotics Pharmacokinetics and Efficacy |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C71924100 |
| concepts[0].level | 0 |
| concepts[0].score | 0.4916093945503235 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[0].display_name | Medicine |
| concepts[1].id | https://openalex.org/C159047783 |
| concepts[1].level | 1 |
| concepts[1].score | 0.48657119274139404 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q7215 |
| concepts[1].display_name | Virology |
| concepts[2].id | https://openalex.org/C3007834351 |
| concepts[2].level | 5 |
| concepts[2].score | 0.4788644015789032 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q82069695 |
| concepts[2].display_name | Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) |
| concepts[3].id | https://openalex.org/C168444539 |
| concepts[3].level | 3 |
| concepts[3].score | 0.46640530228614807 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q105196 |
| concepts[3].display_name | Organ transplantation |
| concepts[4].id | https://openalex.org/C203014093 |
| concepts[4].level | 1 |
| concepts[4].score | 0.44785481691360474 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q101929 |
| concepts[4].display_name | Immunology |
| concepts[5].id | https://openalex.org/C3008058167 |
| concepts[5].level | 4 |
| concepts[5].score | 0.44646313786506653 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q84263196 |
| concepts[5].display_name | Coronavirus disease 2019 (COVID-19) |
| concepts[6].id | https://openalex.org/C126322002 |
| concepts[6].level | 1 |
| concepts[6].score | 0.15637391805648804 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11180 |
| concepts[6].display_name | Internal medicine |
| concepts[7].id | https://openalex.org/C2911091166 |
| concepts[7].level | 2 |
| concepts[7].score | 0.12929844856262207 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q106419912 |
| concepts[7].display_name | Transplantation |
| concepts[8].id | https://openalex.org/C524204448 |
| concepts[8].level | 3 |
| concepts[8].score | 0.08381140232086182 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q788926 |
| concepts[8].display_name | Infectious disease (medical specialty) |
| concepts[9].id | https://openalex.org/C2779134260 |
| concepts[9].level | 2 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q12136 |
| concepts[9].display_name | Disease |
| keywords[0].id | https://openalex.org/keywords/medicine |
| keywords[0].score | 0.4916093945503235 |
| keywords[0].display_name | Medicine |
| keywords[1].id | https://openalex.org/keywords/virology |
| keywords[1].score | 0.48657119274139404 |
| keywords[1].display_name | Virology |
| keywords[2].id | https://openalex.org/keywords/severe-acute-respiratory-syndrome-coronavirus-2 |
| keywords[2].score | 0.4788644015789032 |
| keywords[2].display_name | Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) |
| keywords[3].id | https://openalex.org/keywords/organ-transplantation |
| keywords[3].score | 0.46640530228614807 |
| keywords[3].display_name | Organ transplantation |
| keywords[4].id | https://openalex.org/keywords/immunology |
| keywords[4].score | 0.44785481691360474 |
| keywords[4].display_name | Immunology |
| keywords[5].id | https://openalex.org/keywords/coronavirus-disease-2019 |
| keywords[5].score | 0.44646313786506653 |
| keywords[5].display_name | Coronavirus disease 2019 (COVID-19) |
| keywords[6].id | https://openalex.org/keywords/internal-medicine |
| keywords[6].score | 0.15637391805648804 |
| keywords[6].display_name | Internal medicine |
| keywords[7].id | https://openalex.org/keywords/transplantation |
| keywords[7].score | 0.12929844856262207 |
| keywords[7].display_name | Transplantation |
| keywords[8].id | https://openalex.org/keywords/infectious-disease |
| keywords[8].score | 0.08381140232086182 |
| keywords[8].display_name | Infectious disease (medical specialty) |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2407.21253 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2407.21253 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2407.21253 |
| locations[1].id | doi:10.48550/arxiv.2407.21253 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2407.21253 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5106276229 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Nathaniel P. Dowd |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Dowd, Nathaniel P. |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5113319844 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Bryan Blette |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Blette, Bryan |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5088431604 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-7382-7864 |
| authorships[2].author.display_name | James D. Chappell |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Chappell, James D. |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5026626377 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-6381-1826 |
| authorships[3].author.display_name | Natasha Halasa |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Halasa, Natasha B. |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5000698542 |
| authorships[4].author.orcid | https://orcid.org/0000-0002-0548-8311 |
| authorships[4].author.display_name | Andrew J. Spieker |
| authorships[4].author_position | last |
| authorships[4].raw_author_name | Spieker, Andrew J. |
| authorships[4].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2407.21253 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-08-04T00:00:00 |
| display_name | An overview of methods for receiver operating characteristic analysis, with an application to SARS-CoV-2 vaccine-induced humoral responses in solid organ transplant recipients |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10118 |
| primary_topic.field.id | https://openalex.org/fields/27 |
| primary_topic.field.display_name | Medicine |
| primary_topic.score | 0.9902999997138977 |
| primary_topic.domain.id | https://openalex.org/domains/4 |
| primary_topic.domain.display_name | Health Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2725 |
| primary_topic.subfield.display_name | Infectious Diseases |
| primary_topic.display_name | SARS-CoV-2 and COVID-19 Research |
| related_works | https://openalex.org/W4206669628, https://openalex.org/W4224279380, https://openalex.org/W4205317059, https://openalex.org/W3176864053, https://openalex.org/W4206651655, https://openalex.org/W4206548596, https://openalex.org/W4292098121, https://openalex.org/W4210433452, https://openalex.org/W3036314732, https://openalex.org/W3084808338 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2407.21253 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2407.21253 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2407.21253 |
| primary_location.id | pmh:oai:arXiv.org:2407.21253 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2407.21253 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2407.21253 |
| publication_date | 2024-07-31 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.R | 146 |
| abstract_inverted_index.a | 6, 13, 36, 170 |
| abstract_inverted_index.As | 162 |
| abstract_inverted_index.We | 151 |
| abstract_inverted_index.an | 122, 163 |
| abstract_inverted_index.as | 41 |
| abstract_inverted_index.be | 53 |
| abstract_inverted_index.by | 35, 90 |
| abstract_inverted_index.in | 22, 85, 105, 174 |
| abstract_inverted_index.is | 5, 31 |
| abstract_inverted_index.it | 50 |
| abstract_inverted_index.of | 12, 25, 54, 68, 92, 115, 124 |
| abstract_inverted_index.or | 72 |
| abstract_inverted_index.to | 8, 16, 56, 87, 119, 148, 154, 176, 179 |
| abstract_inverted_index.we | 166 |
| abstract_inverted_index.(1) | 120 |
| abstract_inverted_index.(2) | 133 |
| abstract_inverted_index.(3) | 143 |
| abstract_inverted_index.ROC | 47, 60, 75, 97, 128 |
| abstract_inverted_index.The | 112 |
| abstract_inverted_index.and | 99, 109, 137, 142, 187 |
| abstract_inverted_index.are | 101, 118 |
| abstract_inverted_index.for | 127, 136 |
| abstract_inverted_index.has | 81 |
| abstract_inverted_index.may | 51 |
| abstract_inverted_index.not | 102 |
| abstract_inverted_index.the | 10, 23, 42, 45, 58, 66, 69, 74, 106, 156 |
| abstract_inverted_index.way | 91 |
| abstract_inverted_index.also | 52 |
| abstract_inverted_index.area | 43 |
| abstract_inverted_index.been | 82 |
| abstract_inverted_index.code | 147 |
| abstract_inverted_index.data | 70, 168 |
| abstract_inverted_index.from | 169 |
| abstract_inverted_index.full | 59 |
| abstract_inverted_index.such | 40 |
| abstract_inverted_index.this | 116 |
| abstract_inverted_index.tool | 7 |
| abstract_inverted_index.with | 131 |
| abstract_inverted_index.(ROC) | 3 |
| abstract_inverted_index.about | 73 |
| abstract_inverted_index.curve | 61, 76, 129 |
| abstract_inverted_index.goals | 114 |
| abstract_inverted_index.guide | 149 |
| abstract_inverted_index.known | 104 |
| abstract_inverted_index.offer | 134 |
| abstract_inverted_index.often | 20 |
| abstract_inverted_index.order | 175 |
| abstract_inverted_index.organ | 184 |
| abstract_inverted_index.solid | 183 |
| abstract_inverted_index.study | 173 |
| abstract_inverted_index.there | 80 |
| abstract_inverted_index.under | 44 |
| abstract_inverted_index.while | 62 |
| abstract_inverted_index.across | 159 |
| abstract_inverted_index.cohort | 172 |
| abstract_inverted_index.curve. | 48 |
| abstract_inverted_index.nature | 67 |
| abstract_inverted_index.recent | 83, 171 |
| abstract_inverted_index.sample | 145 |
| abstract_inverted_index.single | 37 |
| abstract_inverted_index.supply | 144 |
| abstract_inverted_index.tests. | 27 |
| abstract_inverted_index.widely | 103 |
| abstract_inverted_index.Overall | 28 |
| abstract_inverted_index.ability | 30 |
| abstract_inverted_index.analyze | 167 |
| abstract_inverted_index.between | 18, 182 |
| abstract_inverted_index.broader | 107 |
| abstract_inverted_index.compare | 177 |
| abstract_inverted_index.conduct | 88 |
| abstract_inverted_index.crudely | 33 |
| abstract_inverted_index.groups, | 19 |
| abstract_inverted_index.healthy | 188 |
| abstract_inverted_index.measure | 15, 39 |
| abstract_inverted_index.methods | 86 |
| abstract_inverted_index.nuances | 95 |
| abstract_inverted_index.numeric | 14, 38 |
| abstract_inverted_index.provide | 121 |
| abstract_inverted_index.utilize | 152 |
| abstract_inverted_index.various | 160 |
| abstract_inverted_index.Although | 79 |
| abstract_inverted_index.However, | 49 |
| abstract_inverted_index.Receiver | 0 |
| abstract_inverted_index.analysis | 4 |
| abstract_inverted_index.capacity | 11 |
| abstract_inverted_index.directly | 77 |
| abstract_inverted_index.employed | 21 |
| abstract_inverted_index.estimate | 57 |
| abstract_inverted_index.evaluate | 9 |
| abstract_inverted_index.example, | 165 |
| abstract_inverted_index.existing | 125 |
| abstract_inverted_index.geometry | 98 |
| abstract_inverted_index.interest | 55, 84 |
| abstract_inverted_index.methods. | 161 |
| abstract_inverted_index.overview | 123 |
| abstract_inverted_index.controls. | 189 |
| abstract_inverted_index.empirical | 46 |
| abstract_inverted_index.examples, | 132 |
| abstract_inverted_index.intuition | 135 |
| abstract_inverted_index.operating | 1 |
| abstract_inverted_index.ordering, | 94 |
| abstract_inverted_index.regarding | 65, 139 |
| abstract_inverted_index.responses | 178 |
| abstract_inverted_index.sometimes | 32 |
| abstract_inverted_index.trade-off | 158 |
| abstract_inverted_index.SARS-CoV-2 | 180 |
| abstract_inverted_index.community. | 111 |
| abstract_inverted_index.diagnostic | 26 |
| abstract_inverted_index.estimation | 100, 130 |
| abstract_inverted_index.evaluation | 24 |
| abstract_inverted_index.frameworks | 126 |
| abstract_inverted_index.leveraging | 63 |
| abstract_inverted_index.manuscript | 117 |
| abstract_inverted_index.recipients | 186 |
| abstract_inverted_index.scientific | 108 |
| abstract_inverted_index.stochastic | 93 |
| abstract_inverted_index.summarized | 34 |
| abstract_inverted_index.transplant | 185 |
| abstract_inverted_index.assumptions | 64 |
| abstract_inverted_index.comparisons | 89 |
| abstract_inverted_index.demonstrate | 155 |
| abstract_inverted_index.distinguish | 17 |
| abstract_inverted_index.overarching | 113 |
| abstract_inverted_index.simulations | 153 |
| abstract_inverted_index.statistical | 110 |
| abstract_inverted_index.surrounding | 96 |
| abstract_inverted_index.trade-offs, | 141 |
| abstract_inverted_index.vaccination | 181 |
| abstract_inverted_index.(parametric) | 71 |
| abstract_inverted_index.illustrative | 164 |
| abstract_inverted_index.bias-variance | 157 |
| abstract_inverted_index.characteristic | 2 |
| abstract_inverted_index.classification | 29 |
| abstract_inverted_index.considerations | 138 |
| abstract_inverted_index.methodological | 140 |
| abstract_inverted_index.implementation. | 150 |
| abstract_inverted_index.(semiparametric). | 78 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 5 |
| citation_normalized_percentile |