A Nutrition Multimodal Photoplethysmography Language Model Article Swipe
Verrier, Kyle
,
Nazaret, Achille
,
Futoma, Joseph
,
Miller, Andrew C.
,
Sapiro, Guillermo
·
YOU?
·
· 2025
· Open Access
·
YOU?
·
· 2025
· Open Access
·
Hunger and satiety dynamics shape dietary behaviors and metabolic health, yet remain difficult to capture in everyday settings. We present a Nutrition Photoplethysmography Language Model (NPLM), integrating continuous photoplethysmography (PPG) from wearables with meal descriptions. NPLM projects PPG into embeddings interpretable by language models, enabling joint reasoning over physiology and meal context. Trained on 19,340 participants and 1.1 million meal-PPG pairs, the model improved daily caloric intake prediction by 11% over text-only baselines, with accuracy maintained when 80% of meal text was removed. In an independent validation study (n=140) with controlled dining and detailed meal information, the model replicated these findings. These results demonstrate the value of integrating physiological measurements from consumer wearables with meal information for noninvasive dietary monitoring at scale.
Related Topics
Concepts
Metadata
- Type
- article
- Landing Page
- http://arxiv.org/abs/2511.19260
- https://arxiv.org/pdf/2511.19260
- OA Status
- green
- OpenAlex ID
- https://openalex.org/W7106783968
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W7106783968Canonical identifier for this work in OpenAlex
- Title
-
A Nutrition Multimodal Photoplethysmography Language ModelWork title
- Type
-
articleOpenAlex work type
- Publication year
-
2025Year of publication
- Publication date
-
2025-11-24Full publication date if available
- Authors
-
Verrier, Kyle, Nazaret, Achille, Futoma, Joseph, Miller, Andrew C., Sapiro, GuillermoList of authors in order
- Landing page
-
https://arxiv.org/abs/2511.19260Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2511.19260Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2511.19260Direct OA link when available
- Concepts
-
Photoplethysmogram, Wearable computer, Meal, Computer science, Caloric theory, Artificial intelligence, Human physiology, Smartphone application, Wearable technology, Machine learning, Physical activity, Psychology, Caloric intake, Medicine, Speech recognition, Physical medicine and rehabilitationTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
Full payload
| id | https://openalex.org/W7106783968 |
|---|---|
| doi | |
| ids.openalex | https://openalex.org/W7106783968 |
| fwci | 0.0 |
| type | article |
| title | A Nutrition Multimodal Photoplethysmography Language Model |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11196 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.4152039587497711 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2204 |
| topics[0].subfield.display_name | Biomedical Engineering |
| topics[0].display_name | Non-Invasive Vital Sign Monitoring |
| topics[1].id | https://openalex.org/T10866 |
| topics[1].field.id | https://openalex.org/fields/27 |
| topics[1].field.display_name | Medicine |
| topics[1].score | 0.1448802649974823 |
| topics[1].domain.id | https://openalex.org/domains/4 |
| topics[1].domain.display_name | Health Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2739 |
| topics[1].subfield.display_name | Public Health, Environmental and Occupational Health |
| topics[1].display_name | Nutritional Studies and Diet |
| topics[2].id | https://openalex.org/T11446 |
| topics[2].field.id | https://openalex.org/fields/36 |
| topics[2].field.display_name | Health Professions |
| topics[2].score | 0.09815511852502823 |
| topics[2].domain.id | https://openalex.org/domains/4 |
| topics[2].domain.display_name | Health Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/3600 |
| topics[2].subfield.display_name | General Health Professions |
| topics[2].display_name | Mobile Health and mHealth Applications |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C116390426 |
| concepts[0].level | 3 |
| concepts[0].score | 0.9575617909431458 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q7187885 |
| concepts[0].display_name | Photoplethysmogram |
| concepts[1].id | https://openalex.org/C150594956 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6398571133613586 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q1334829 |
| concepts[1].display_name | Wearable computer |
| concepts[2].id | https://openalex.org/C2778345441 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5860176086425781 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q6460735 |
| concepts[2].display_name | Meal |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.5439823865890503 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C190362976 |
| concepts[4].level | 2 |
| concepts[4].score | 0.39860647916793823 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q845261 |
| concepts[4].display_name | Caloric theory |
| concepts[5].id | https://openalex.org/C154945302 |
| concepts[5].level | 1 |
| concepts[5].score | 0.39161238074302673 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[5].display_name | Artificial intelligence |
| concepts[6].id | https://openalex.org/C2986265897 |
| concepts[6].level | 2 |
| concepts[6].score | 0.31352704763412476 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q23852 |
| concepts[6].display_name | Human physiology |
| concepts[7].id | https://openalex.org/C3020250448 |
| concepts[7].level | 2 |
| concepts[7].score | 0.30328044295310974 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q620615 |
| concepts[7].display_name | Smartphone application |
| concepts[8].id | https://openalex.org/C54290928 |
| concepts[8].level | 3 |
| concepts[8].score | 0.29991915822029114 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q4845080 |
| concepts[8].display_name | Wearable technology |
| concepts[9].id | https://openalex.org/C119857082 |
| concepts[9].level | 1 |
| concepts[9].score | 0.28880974650382996 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[9].display_name | Machine learning |
| concepts[10].id | https://openalex.org/C3020255362 |
| concepts[10].level | 2 |
| concepts[10].score | 0.2793295681476593 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q747883 |
| concepts[10].display_name | Physical activity |
| concepts[11].id | https://openalex.org/C15744967 |
| concepts[11].level | 0 |
| concepts[11].score | 0.2782019078731537 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[11].display_name | Psychology |
| concepts[12].id | https://openalex.org/C2994137971 |
| concepts[12].level | 3 |
| concepts[12].score | 0.2762373983860016 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q130964 |
| concepts[12].display_name | Caloric intake |
| concepts[13].id | https://openalex.org/C71924100 |
| concepts[13].level | 0 |
| concepts[13].score | 0.2678340971469879 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[13].display_name | Medicine |
| concepts[14].id | https://openalex.org/C28490314 |
| concepts[14].level | 1 |
| concepts[14].score | 0.264003187417984 |
| concepts[14].wikidata | https://www.wikidata.org/wiki/Q189436 |
| concepts[14].display_name | Speech recognition |
| concepts[15].id | https://openalex.org/C99508421 |
| concepts[15].level | 1 |
| concepts[15].score | 0.25785380601882935 |
| concepts[15].wikidata | https://www.wikidata.org/wiki/Q2678675 |
| concepts[15].display_name | Physical medicine and rehabilitation |
| keywords[0].id | https://openalex.org/keywords/photoplethysmogram |
| keywords[0].score | 0.9575617909431458 |
| keywords[0].display_name | Photoplethysmogram |
| keywords[1].id | https://openalex.org/keywords/wearable-computer |
| keywords[1].score | 0.6398571133613586 |
| keywords[1].display_name | Wearable computer |
| keywords[2].id | https://openalex.org/keywords/meal |
| keywords[2].score | 0.5860176086425781 |
| keywords[2].display_name | Meal |
| keywords[3].id | https://openalex.org/keywords/caloric-theory |
| keywords[3].score | 0.39860647916793823 |
| keywords[3].display_name | Caloric theory |
| keywords[4].id | https://openalex.org/keywords/human-physiology |
| keywords[4].score | 0.31352704763412476 |
| keywords[4].display_name | Human physiology |
| keywords[5].id | https://openalex.org/keywords/smartphone-application |
| keywords[5].score | 0.30328044295310974 |
| keywords[5].display_name | Smartphone application |
| language | |
| locations[0].id | pmh:oai:arXiv.org:2511.19260 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2511.19260 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2511.19260 |
| indexed_in | arxiv |
| authorships[0].author.id | |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Verrier, Kyle |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Verrier, Kyle |
| authorships[0].is_corresponding | True |
| authorships[1].author.id | https://openalex.org/A4298752189 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Nazaret, Achille |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Nazaret, Achille |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A4287412160 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Futoma, Joseph |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Futoma, Joseph |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A4227661436 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Miller, Andrew C. |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Miller, Andrew C. |
| authorships[3].is_corresponding | False |
| authorships[4].author.id | https://openalex.org/A2198588118 |
| authorships[4].author.orcid | |
| authorships[4].author.display_name | Sapiro, Guillermo |
| authorships[4].author_position | last |
| authorships[4].raw_author_name | Sapiro, Guillermo |
| authorships[4].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2511.19260 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-11-27T00:00:00 |
| display_name | A Nutrition Multimodal Photoplethysmography Language Model |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-27T01:16:37.896743 |
| primary_topic.id | https://openalex.org/T11196 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.4152039587497711 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2204 |
| primary_topic.subfield.display_name | Biomedical Engineering |
| primary_topic.display_name | Non-Invasive Vital Sign Monitoring |
| cited_by_count | 0 |
| locations_count | 1 |
| best_oa_location.id | pmh:oai:arXiv.org:2511.19260 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2511.19260 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2511.19260 |
| primary_location.id | pmh:oai:arXiv.org:2511.19260 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2511.19260 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2511.19260 |
| publication_date | 2025-11-24 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 20 |
| abstract_inverted_index.In | 83 |
| abstract_inverted_index.We | 18 |
| abstract_inverted_index.an | 84 |
| abstract_inverted_index.at | 120 |
| abstract_inverted_index.by | 41, 68 |
| abstract_inverted_index.in | 15 |
| abstract_inverted_index.of | 78, 106 |
| abstract_inverted_index.on | 53 |
| abstract_inverted_index.to | 13 |
| abstract_inverted_index.1.1 | 57 |
| abstract_inverted_index.11% | 69 |
| abstract_inverted_index.80% | 77 |
| abstract_inverted_index.PPG | 37 |
| abstract_inverted_index.and | 1, 7, 49, 56, 92 |
| abstract_inverted_index.for | 116 |
| abstract_inverted_index.the | 61, 96, 104 |
| abstract_inverted_index.was | 81 |
| abstract_inverted_index.yet | 10 |
| abstract_inverted_index.NPLM | 35 |
| abstract_inverted_index.from | 30, 110 |
| abstract_inverted_index.into | 38 |
| abstract_inverted_index.meal | 33, 50, 79, 94, 114 |
| abstract_inverted_index.over | 47, 70 |
| abstract_inverted_index.text | 80 |
| abstract_inverted_index.when | 76 |
| abstract_inverted_index.with | 32, 73, 89, 113 |
| abstract_inverted_index.(PPG) | 29 |
| abstract_inverted_index.Model | 24 |
| abstract_inverted_index.These | 101 |
| abstract_inverted_index.daily | 64 |
| abstract_inverted_index.joint | 45 |
| abstract_inverted_index.model | 62, 97 |
| abstract_inverted_index.shape | 4 |
| abstract_inverted_index.study | 87 |
| abstract_inverted_index.these | 99 |
| abstract_inverted_index.value | 105 |
| abstract_inverted_index.19,340 | 54 |
| abstract_inverted_index.Hunger | 0 |
| abstract_inverted_index.dining | 91 |
| abstract_inverted_index.intake | 66 |
| abstract_inverted_index.pairs, | 60 |
| abstract_inverted_index.remain | 11 |
| abstract_inverted_index.scale. | 121 |
| abstract_inverted_index.(NPLM), | 25 |
| abstract_inverted_index.(n=140) | 88 |
| abstract_inverted_index.Trained | 52 |
| abstract_inverted_index.caloric | 65 |
| abstract_inverted_index.capture | 14 |
| abstract_inverted_index.dietary | 5, 118 |
| abstract_inverted_index.health, | 9 |
| abstract_inverted_index.million | 58 |
| abstract_inverted_index.models, | 43 |
| abstract_inverted_index.present | 19 |
| abstract_inverted_index.results | 102 |
| abstract_inverted_index.satiety | 2 |
| abstract_inverted_index.Language | 23 |
| abstract_inverted_index.accuracy | 74 |
| abstract_inverted_index.consumer | 111 |
| abstract_inverted_index.context. | 51 |
| abstract_inverted_index.detailed | 93 |
| abstract_inverted_index.dynamics | 3 |
| abstract_inverted_index.enabling | 44 |
| abstract_inverted_index.everyday | 16 |
| abstract_inverted_index.improved | 63 |
| abstract_inverted_index.language | 42 |
| abstract_inverted_index.meal-PPG | 59 |
| abstract_inverted_index.projects | 36 |
| abstract_inverted_index.removed. | 82 |
| abstract_inverted_index.Nutrition | 21 |
| abstract_inverted_index.behaviors | 6 |
| abstract_inverted_index.difficult | 12 |
| abstract_inverted_index.findings. | 100 |
| abstract_inverted_index.metabolic | 8 |
| abstract_inverted_index.reasoning | 46 |
| abstract_inverted_index.settings. | 17 |
| abstract_inverted_index.text-only | 71 |
| abstract_inverted_index.wearables | 31, 112 |
| abstract_inverted_index.baselines, | 72 |
| abstract_inverted_index.continuous | 27 |
| abstract_inverted_index.controlled | 90 |
| abstract_inverted_index.embeddings | 39 |
| abstract_inverted_index.maintained | 75 |
| abstract_inverted_index.monitoring | 119 |
| abstract_inverted_index.physiology | 48 |
| abstract_inverted_index.prediction | 67 |
| abstract_inverted_index.replicated | 98 |
| abstract_inverted_index.validation | 86 |
| abstract_inverted_index.demonstrate | 103 |
| abstract_inverted_index.independent | 85 |
| abstract_inverted_index.information | 115 |
| abstract_inverted_index.integrating | 26, 107 |
| abstract_inverted_index.noninvasive | 117 |
| abstract_inverted_index.information, | 95 |
| abstract_inverted_index.measurements | 109 |
| abstract_inverted_index.participants | 55 |
| abstract_inverted_index.descriptions. | 34 |
| abstract_inverted_index.interpretable | 40 |
| abstract_inverted_index.physiological | 108 |
| abstract_inverted_index.Photoplethysmography | 22 |
| abstract_inverted_index.photoplethysmography | 28 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 5 |
| citation_normalized_percentile.value | 0.69792629 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |