Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulation Article Swipe
Nikolaos Smyrnakis
,
Tasos Karakostas
,
R. Cotton
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2402.12676
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2402.12676
Gait analysis from videos obtained from a smartphone would open up many clinical opportunities for detecting and quantifying gait impairments. However, existing approaches for estimating gait parameters from videos can produce physically implausible results. To overcome this, we train a policy using reinforcement learning to control a physics simulation of human movement to replicate the movement seen in video. This forces the inferred movements to be physically plausible, while improving the accuracy of the inferred step length and walking velocity.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2402.12676
- https://arxiv.org/pdf/2402.12676
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4392019925
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4392019925Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2402.12676Digital Object Identifier
- Title
-
Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based SimulationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-02-20Full publication date if available
- Authors
-
Nikolaos Smyrnakis, Tasos Karakostas, R. CottonList of authors in order
- Landing page
-
https://arxiv.org/abs/2402.12676Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2402.12676Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2402.12676Direct OA link when available
- Concepts
-
Imitation, Monocular, Motion (physics), Computer vision, Motion analysis, Gait, Gait analysis, Artificial intelligence, Computer science, Computer graphics (images), Physical medicine and rehabilitation, Psychology, Neuroscience, MedicineTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4392019925 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2402.12676 |
| ids.doi | https://doi.org/10.48550/arxiv.2402.12676 |
| ids.openalex | https://openalex.org/W4392019925 |
| fwci | |
| type | preprint |
| title | Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulation |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12740 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.9498000144958496 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2204 |
| topics[0].subfield.display_name | Biomedical Engineering |
| topics[0].display_name | Gait Recognition and Analysis |
| topics[1].id | https://openalex.org/T11398 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9013000130653381 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1709 |
| topics[1].subfield.display_name | Human-Computer Interaction |
| topics[1].display_name | Hand Gesture Recognition Systems |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C126388530 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7946337461471558 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q1131737 |
| concepts[0].display_name | Imitation |
| concepts[1].id | https://openalex.org/C65909025 |
| concepts[1].level | 2 |
| concepts[1].score | 0.5895192623138428 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q1945033 |
| concepts[1].display_name | Monocular |
| concepts[2].id | https://openalex.org/C104114177 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5782097578048706 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q79782 |
| concepts[2].display_name | Motion (physics) |
| concepts[3].id | https://openalex.org/C31972630 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5308151245117188 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q844240 |
| concepts[3].display_name | Computer vision |
| concepts[4].id | https://openalex.org/C2777036941 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5243123769760132 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q6917771 |
| concepts[4].display_name | Motion analysis |
| concepts[5].id | https://openalex.org/C151800584 |
| concepts[5].level | 2 |
| concepts[5].score | 0.5069392323493958 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2370000 |
| concepts[5].display_name | Gait |
| concepts[6].id | https://openalex.org/C173906292 |
| concepts[6].level | 3 |
| concepts[6].score | 0.5066831707954407 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1493441 |
| concepts[6].display_name | Gait analysis |
| concepts[7].id | https://openalex.org/C154945302 |
| concepts[7].level | 1 |
| concepts[7].score | 0.48599371314048767 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[7].display_name | Artificial intelligence |
| concepts[8].id | https://openalex.org/C41008148 |
| concepts[8].level | 0 |
| concepts[8].score | 0.4849817752838135 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[8].display_name | Computer science |
| concepts[9].id | https://openalex.org/C121684516 |
| concepts[9].level | 1 |
| concepts[9].score | 0.39993980526924133 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q7600677 |
| concepts[9].display_name | Computer graphics (images) |
| concepts[10].id | https://openalex.org/C99508421 |
| concepts[10].level | 1 |
| concepts[10].score | 0.27109864354133606 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q2678675 |
| concepts[10].display_name | Physical medicine and rehabilitation |
| concepts[11].id | https://openalex.org/C15744967 |
| concepts[11].level | 0 |
| concepts[11].score | 0.23644700646400452 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q9418 |
| concepts[11].display_name | Psychology |
| concepts[12].id | https://openalex.org/C169760540 |
| concepts[12].level | 1 |
| concepts[12].score | 0.13800394535064697 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q207011 |
| concepts[12].display_name | Neuroscience |
| concepts[13].id | https://openalex.org/C71924100 |
| concepts[13].level | 0 |
| concepts[13].score | 0.1242329478263855 |
| concepts[13].wikidata | https://www.wikidata.org/wiki/Q11190 |
| concepts[13].display_name | Medicine |
| keywords[0].id | https://openalex.org/keywords/imitation |
| keywords[0].score | 0.7946337461471558 |
| keywords[0].display_name | Imitation |
| keywords[1].id | https://openalex.org/keywords/monocular |
| keywords[1].score | 0.5895192623138428 |
| keywords[1].display_name | Monocular |
| keywords[2].id | https://openalex.org/keywords/motion |
| keywords[2].score | 0.5782097578048706 |
| keywords[2].display_name | Motion (physics) |
| keywords[3].id | https://openalex.org/keywords/computer-vision |
| keywords[3].score | 0.5308151245117188 |
| keywords[3].display_name | Computer vision |
| keywords[4].id | https://openalex.org/keywords/motion-analysis |
| keywords[4].score | 0.5243123769760132 |
| keywords[4].display_name | Motion analysis |
| keywords[5].id | https://openalex.org/keywords/gait |
| keywords[5].score | 0.5069392323493958 |
| keywords[5].display_name | Gait |
| keywords[6].id | https://openalex.org/keywords/gait-analysis |
| keywords[6].score | 0.5066831707954407 |
| keywords[6].display_name | Gait analysis |
| keywords[7].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[7].score | 0.48599371314048767 |
| keywords[7].display_name | Artificial intelligence |
| keywords[8].id | https://openalex.org/keywords/computer-science |
| keywords[8].score | 0.4849817752838135 |
| keywords[8].display_name | Computer science |
| keywords[9].id | https://openalex.org/keywords/computer-graphics |
| keywords[9].score | 0.39993980526924133 |
| keywords[9].display_name | Computer graphics (images) |
| keywords[10].id | https://openalex.org/keywords/physical-medicine-and-rehabilitation |
| keywords[10].score | 0.27109864354133606 |
| keywords[10].display_name | Physical medicine and rehabilitation |
| keywords[11].id | https://openalex.org/keywords/psychology |
| keywords[11].score | 0.23644700646400452 |
| keywords[11].display_name | Psychology |
| keywords[12].id | https://openalex.org/keywords/neuroscience |
| keywords[12].score | 0.13800394535064697 |
| keywords[12].display_name | Neuroscience |
| keywords[13].id | https://openalex.org/keywords/medicine |
| keywords[13].score | 0.1242329478263855 |
| keywords[13].display_name | Medicine |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2402.12676 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | cc-by-sa |
| locations[0].pdf_url | https://arxiv.org/pdf/2402.12676 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | https://openalex.org/licenses/cc-by-sa |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2402.12676 |
| locations[1].id | doi:10.48550/arxiv.2402.12676 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2402.12676 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5067492592 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Nikolaos Smyrnakis |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Smyrnakis, Nikolaos |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5015522581 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Tasos Karakostas |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Karakostas, Tasos |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5049159760 |
| authorships[2].author.orcid | https://orcid.org/0000-0001-5714-1400 |
| authorships[2].author.display_name | R. Cotton |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Cotton, R. James |
| authorships[2].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2402.12676 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-02-22T00:00:00 |
| display_name | Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulation |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12740 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.9498000144958496 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2204 |
| primary_topic.subfield.display_name | Biomedical Engineering |
| primary_topic.display_name | Gait Recognition and Analysis |
| related_works | https://openalex.org/W2133973503, https://openalex.org/W2471060339, https://openalex.org/W2111603423, https://openalex.org/W2148547327, https://openalex.org/W4226236273, https://openalex.org/W2125892956, https://openalex.org/W2790560349, https://openalex.org/W2130975749, https://openalex.org/W2493973380, https://openalex.org/W2394835211 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2402.12676 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | cc-by-sa |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2402.12676 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by-sa |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2402.12676 |
| primary_location.id | pmh:oai:arXiv.org:2402.12676 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | cc-by-sa |
| primary_location.pdf_url | https://arxiv.org/pdf/2402.12676 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | https://openalex.org/licenses/cc-by-sa |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2402.12676 |
| publication_date | 2024-02-20 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 6, 39, 46 |
| abstract_inverted_index.To | 34 |
| abstract_inverted_index.be | 65 |
| abstract_inverted_index.in | 57 |
| abstract_inverted_index.of | 49, 72 |
| abstract_inverted_index.to | 44, 52, 64 |
| abstract_inverted_index.up | 10 |
| abstract_inverted_index.we | 37 |
| abstract_inverted_index.and | 16, 77 |
| abstract_inverted_index.can | 29 |
| abstract_inverted_index.for | 14, 23 |
| abstract_inverted_index.the | 54, 61, 70, 73 |
| abstract_inverted_index.Gait | 0 |
| abstract_inverted_index.This | 59 |
| abstract_inverted_index.from | 2, 5, 27 |
| abstract_inverted_index.gait | 18, 25 |
| abstract_inverted_index.many | 11 |
| abstract_inverted_index.open | 9 |
| abstract_inverted_index.seen | 56 |
| abstract_inverted_index.step | 75 |
| abstract_inverted_index.human | 50 |
| abstract_inverted_index.this, | 36 |
| abstract_inverted_index.train | 38 |
| abstract_inverted_index.using | 41 |
| abstract_inverted_index.while | 68 |
| abstract_inverted_index.would | 8 |
| abstract_inverted_index.forces | 60 |
| abstract_inverted_index.length | 76 |
| abstract_inverted_index.policy | 40 |
| abstract_inverted_index.video. | 58 |
| abstract_inverted_index.videos | 3, 28 |
| abstract_inverted_index.control | 45 |
| abstract_inverted_index.physics | 47 |
| abstract_inverted_index.produce | 30 |
| abstract_inverted_index.walking | 78 |
| abstract_inverted_index.However, | 20 |
| abstract_inverted_index.accuracy | 71 |
| abstract_inverted_index.analysis | 1 |
| abstract_inverted_index.clinical | 12 |
| abstract_inverted_index.existing | 21 |
| abstract_inverted_index.inferred | 62, 74 |
| abstract_inverted_index.learning | 43 |
| abstract_inverted_index.movement | 51, 55 |
| abstract_inverted_index.obtained | 4 |
| abstract_inverted_index.overcome | 35 |
| abstract_inverted_index.results. | 33 |
| abstract_inverted_index.detecting | 15 |
| abstract_inverted_index.improving | 69 |
| abstract_inverted_index.movements | 63 |
| abstract_inverted_index.replicate | 53 |
| abstract_inverted_index.velocity. | 79 |
| abstract_inverted_index.approaches | 22 |
| abstract_inverted_index.estimating | 24 |
| abstract_inverted_index.parameters | 26 |
| abstract_inverted_index.physically | 31, 66 |
| abstract_inverted_index.plausible, | 67 |
| abstract_inverted_index.simulation | 48 |
| abstract_inverted_index.smartphone | 7 |
| abstract_inverted_index.implausible | 32 |
| abstract_inverted_index.quantifying | 17 |
| abstract_inverted_index.impairments. | 19 |
| abstract_inverted_index.opportunities | 13 |
| abstract_inverted_index.reinforcement | 42 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 3 |
| citation_normalized_percentile |