Oralytics Reinforcement Learning Algorithm Article Swipe
Anna L. Trella
,
Kelly Zhang
,
Stephanie M. Carpenter
,
David Elashoff
,
Zara M. Greer
,
Inbal Nahum‐Shani
,
Dennis Ruenger
,
Vivek Shetty
,
Susan A. Murphy
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2406.13127
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2406.13127
Dental disease is still one of the most common chronic diseases in the United States. While dental disease is preventable through healthy oral self-care behaviors (OSCB), this basic behavior is not consistently practiced. We have developed Oralytics, an online, reinforcement learning (RL) algorithm that optimizes the delivery of personalized intervention prompts to improve OSCB. In this paper, we offer a full overview of algorithm design decisions made using prior data, domain expertise, and experiments in a simulation test bed. The finalized RL algorithm was deployed in the Oralytics clinical trial, conducted from fall 2023 to summer 2024.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2406.13127
- https://arxiv.org/pdf/2406.13127
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4399912403
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4399912403Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2406.13127Digital Object Identifier
- Title
-
Oralytics Reinforcement Learning AlgorithmWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-06-19Full publication date if available
- Authors
-
Anna L. Trella, Kelly Zhang, Stephanie M. Carpenter, David Elashoff, Zara M. Greer, Inbal Nahum‐Shani, Dennis Ruenger, Vivek Shetty, Susan A. MurphyList of authors in order
- Landing page
-
https://arxiv.org/abs/2406.13127Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2406.13127Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2406.13127Direct OA link when available
- Concepts
-
Reinforcement learning, Computer science, Reinforcement, Artificial intelligence, Algorithm, Psychology, Social psychologyTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4399912403 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2406.13127 |
| ids.doi | https://doi.org/10.48550/arxiv.2406.13127 |
| ids.openalex | https://openalex.org/W4399912403 |
| fwci | |
| type | preprint |
| title | Oralytics Reinforcement Learning Algorithm |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12707 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.4092000126838684 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2214 |
| topics[0].subfield.display_name | Media Technology |
| topics[0].display_name | Vehicle License Plate Recognition |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C97541855 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8051384687423706 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q830687 |
| concepts[0].display_name | Reinforcement learning |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.615589439868927 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C67203356 |
| concepts[2].level | 2 |
| concepts[2].score | 0.4626411497592926 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q1321905 |
| concepts[2].display_name | Reinforcement |
| concepts[3].id | https://openalex.org/C154945302 |
| concepts[3].level | 1 |
| concepts[3].score | 0.42526185512542725 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[3].display_name | Artificial intelligence |
| concepts[4].id | https://openalex.org/C11413529 |
| concepts[4].level | 1 |
| concepts[4].score | 0.39455583691596985 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q8366 |
| concepts[4].display_name | Algorithm |
| concepts[5].id | https://openalex.org/C15744967 |
| concepts[5].level | 0 |
| concepts[5].score | 0.14113765954971313 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[5].display_name | Psychology |
| concepts[6].id | https://openalex.org/C77805123 |
| concepts[6].level | 1 |
| concepts[6].score | 0.050308793783187866 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q161272 |
| concepts[6].display_name | Social psychology |
| keywords[0].id | https://openalex.org/keywords/reinforcement-learning |
| keywords[0].score | 0.8051384687423706 |
| keywords[0].display_name | Reinforcement learning |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.615589439868927 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/reinforcement |
| keywords[2].score | 0.4626411497592926 |
| keywords[2].display_name | Reinforcement |
| keywords[3].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[3].score | 0.42526185512542725 |
| keywords[3].display_name | Artificial intelligence |
| keywords[4].id | https://openalex.org/keywords/algorithm |
| keywords[4].score | 0.39455583691596985 |
| keywords[4].display_name | Algorithm |
| keywords[5].id | https://openalex.org/keywords/psychology |
| keywords[5].score | 0.14113765954971313 |
| keywords[5].display_name | Psychology |
| keywords[6].id | https://openalex.org/keywords/social-psychology |
| keywords[6].score | 0.050308793783187866 |
| keywords[6].display_name | Social psychology |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2406.13127 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2406.13127 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2406.13127 |
| locations[1].id | doi:10.48550/arxiv.2406.13127 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2406.13127 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5039583451 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-4779-9115 |
| authorships[0].author.display_name | Anna L. Trella |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Trella, Anna L. |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5101990414 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-0850-4978 |
| authorships[1].author.display_name | Kelly Zhang |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Zhang, Kelly W. |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5031734253 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-4523-7565 |
| authorships[2].author.display_name | Stephanie M. Carpenter |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Carpenter, Stephanie M. |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5070990818 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-5865-8580 |
| authorships[3].author.display_name | David Elashoff |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Elashoff, David |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A5093463872 |
| authorships[4].author.orcid | https://orcid.org/0009-0008-4985-4310 |
| authorships[4].author.display_name | Zara M. Greer |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Greer, Zara M. |
| authorships[4].is_corresponding | False |
| authorships[5].author.id | https://openalex.org/A5034549483 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-6138-9089 |
| authorships[5].author.display_name | Inbal Nahum‐Shani |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Nahum-Shani, Inbal |
| authorships[5].is_corresponding | False |
| authorships[6].author.id | https://openalex.org/A5099380957 |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | Dennis Ruenger |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Ruenger, Dennis |
| authorships[6].is_corresponding | False |
| authorships[7].author.id | https://openalex.org/A5047665844 |
| authorships[7].author.orcid | https://orcid.org/0000-0002-3167-3318 |
| authorships[7].author.display_name | Vivek Shetty |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Shetty, Vivek |
| authorships[7].is_corresponding | False |
| authorships[8].author.id | https://openalex.org/A5070589969 |
| authorships[8].author.orcid | https://orcid.org/0000-0002-2032-4286 |
| authorships[8].author.display_name | Susan A. Murphy |
| authorships[8].author_position | last |
| authorships[8].raw_author_name | Murphy, Susan A. |
| authorships[8].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2406.13127 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Oralytics Reinforcement Learning Algorithm |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12707 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.4092000126838684 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2214 |
| primary_topic.subfield.display_name | Media Technology |
| primary_topic.display_name | Vehicle License Plate Recognition |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2748952813, https://openalex.org/W2920061524, https://openalex.org/W4310083477, https://openalex.org/W2328553770, https://openalex.org/W2051487156, https://openalex.org/W1977959518, https://openalex.org/W2038908348, https://openalex.org/W2107890255, https://openalex.org/W2106552856 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2406.13127 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2406.13127 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2406.13127 |
| primary_location.id | pmh:oai:arXiv.org:2406.13127 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2406.13127 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2406.13127 |
| publication_date | 2024-06-19 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 59, 75 |
| abstract_inverted_index.In | 54 |
| abstract_inverted_index.RL | 81 |
| abstract_inverted_index.We | 33 |
| abstract_inverted_index.an | 37 |
| abstract_inverted_index.in | 11, 74, 85 |
| abstract_inverted_index.is | 2, 18, 29 |
| abstract_inverted_index.of | 5, 47, 62 |
| abstract_inverted_index.to | 51, 94 |
| abstract_inverted_index.we | 57 |
| abstract_inverted_index.The | 79 |
| abstract_inverted_index.and | 72 |
| abstract_inverted_index.not | 30 |
| abstract_inverted_index.one | 4 |
| abstract_inverted_index.the | 6, 12, 45, 86 |
| abstract_inverted_index.was | 83 |
| abstract_inverted_index.(RL) | 41 |
| abstract_inverted_index.2023 | 93 |
| abstract_inverted_index.bed. | 78 |
| abstract_inverted_index.fall | 92 |
| abstract_inverted_index.from | 91 |
| abstract_inverted_index.full | 60 |
| abstract_inverted_index.have | 34 |
| abstract_inverted_index.made | 66 |
| abstract_inverted_index.most | 7 |
| abstract_inverted_index.oral | 22 |
| abstract_inverted_index.test | 77 |
| abstract_inverted_index.that | 43 |
| abstract_inverted_index.this | 26, 55 |
| abstract_inverted_index.2024. | 96 |
| abstract_inverted_index.OSCB. | 53 |
| abstract_inverted_index.While | 15 |
| abstract_inverted_index.basic | 27 |
| abstract_inverted_index.data, | 69 |
| abstract_inverted_index.offer | 58 |
| abstract_inverted_index.prior | 68 |
| abstract_inverted_index.still | 3 |
| abstract_inverted_index.using | 67 |
| abstract_inverted_index.Dental | 0 |
| abstract_inverted_index.United | 13 |
| abstract_inverted_index.common | 8 |
| abstract_inverted_index.dental | 16 |
| abstract_inverted_index.design | 64 |
| abstract_inverted_index.domain | 70 |
| abstract_inverted_index.paper, | 56 |
| abstract_inverted_index.summer | 95 |
| abstract_inverted_index.trial, | 89 |
| abstract_inverted_index.(OSCB), | 25 |
| abstract_inverted_index.States. | 14 |
| abstract_inverted_index.chronic | 9 |
| abstract_inverted_index.disease | 1, 17 |
| abstract_inverted_index.healthy | 21 |
| abstract_inverted_index.improve | 52 |
| abstract_inverted_index.online, | 38 |
| abstract_inverted_index.prompts | 50 |
| abstract_inverted_index.through | 20 |
| abstract_inverted_index.behavior | 28 |
| abstract_inverted_index.clinical | 88 |
| abstract_inverted_index.delivery | 46 |
| abstract_inverted_index.deployed | 84 |
| abstract_inverted_index.diseases | 10 |
| abstract_inverted_index.learning | 40 |
| abstract_inverted_index.overview | 61 |
| abstract_inverted_index.Oralytics | 87 |
| abstract_inverted_index.algorithm | 42, 63, 82 |
| abstract_inverted_index.behaviors | 24 |
| abstract_inverted_index.conducted | 90 |
| abstract_inverted_index.decisions | 65 |
| abstract_inverted_index.developed | 35 |
| abstract_inverted_index.finalized | 80 |
| abstract_inverted_index.optimizes | 44 |
| abstract_inverted_index.self-care | 23 |
| abstract_inverted_index.Oralytics, | 36 |
| abstract_inverted_index.expertise, | 71 |
| abstract_inverted_index.practiced. | 32 |
| abstract_inverted_index.simulation | 76 |
| abstract_inverted_index.experiments | 73 |
| abstract_inverted_index.preventable | 19 |
| abstract_inverted_index.consistently | 31 |
| abstract_inverted_index.intervention | 49 |
| abstract_inverted_index.personalized | 48 |
| abstract_inverted_index.reinforcement | 39 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 9 |
| citation_normalized_percentile |