Real-time 3D Human Reconstruction and Rendering System from a Single RGB Camera Article Swipe
Yuanwang Yang
,
Qiao Feng
,
Yu‐Kun Lai
,
Kun Li
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1145/3681758.3697993
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1145/3681758.3697993
Transforming 2D human images into 3D appearance is essential for immersive communication. In this paper, we introduce a low-cost real-time 3D human reconstruction and rendering system with a single RGB camera at 28+ FPS, which guarantees both real-time computing speed and realistic rendering results. We use WebRTC to transmit captured images over the Internet for low-latency remote communication. In addition, we design a lighting-robust rendering approach to enhance the lighting perception and generalization ability of the model. Experimental results show that our system achieves high-quality real-time 3D human reconstruction and rendering for different persons wearing various clothes, even with challenging poses. Our system makes use of only a common USB webcam and a consumer-level GPU with real-time performance and high-fidelity results, which provides a consumer-accessible immersive telepresence solution.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1145/3681758.3697993
- https://dl.acm.org/doi/pdf/10.1145/3681758.3697993
- OA Status
- gold
- References
- 12
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4404520244
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4404520244Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1145/3681758.3697993Digital Object Identifier
- Title
-
Real-time 3D Human Reconstruction and Rendering System from a Single RGB CameraWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-11-19Full publication date if available
- Authors
-
Yuanwang Yang, Qiao Feng, Yu‐Kun Lai, Kun LiList of authors in order
- Landing page
-
https://doi.org/10.1145/3681758.3697993Publisher landing page
- PDF URL
-
https://dl.acm.org/doi/pdf/10.1145/3681758.3697993Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://dl.acm.org/doi/pdf/10.1145/3681758.3697993Direct OA link when available
- Concepts
-
Computer science, Computer graphics (images), Computer vision, Rendering (computer graphics), Artificial intelligence, Single camera, RGB color model, Real-time rendering, 3D reconstructionTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- References (count)
-
12Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4404520244 |
|---|---|
| doi | https://doi.org/10.1145/3681758.3697993 |
| ids.doi | https://doi.org/10.1145/3681758.3697993 |
| ids.openalex | https://openalex.org/W4404520244 |
| fwci | 0.0 |
| type | article |
| title | Real-time 3D Human Reconstruction and Rendering System from a Single RGB Camera |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | 4 |
| biblio.first_page | 1 |
| topics[0].id | https://openalex.org/T10719 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.9994999766349792 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2206 |
| topics[0].subfield.display_name | Computational Mechanics |
| topics[0].display_name | 3D Shape Modeling and Analysis |
| topics[1].id | https://openalex.org/T10481 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9933000206947327 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1704 |
| topics[1].subfield.display_name | Computer Graphics and Computer-Aided Design |
| topics[1].display_name | Computer Graphics and Visualization Techniques |
| topics[2].id | https://openalex.org/T10531 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9923999905586243 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1707 |
| topics[2].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[2].display_name | Advanced Vision and Imaging |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.6900972723960876 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C121684516 |
| concepts[1].level | 1 |
| concepts[1].score | 0.6789517402648926 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q7600677 |
| concepts[1].display_name | Computer graphics (images) |
| concepts[2].id | https://openalex.org/C31972630 |
| concepts[2].level | 1 |
| concepts[2].score | 0.6497346758842468 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q844240 |
| concepts[2].display_name | Computer vision |
| concepts[3].id | https://openalex.org/C205711294 |
| concepts[3].level | 2 |
| concepts[3].score | 0.6164296865463257 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q176953 |
| concepts[3].display_name | Rendering (computer graphics) |
| concepts[4].id | https://openalex.org/C154945302 |
| concepts[4].level | 1 |
| concepts[4].score | 0.5788490176200867 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[4].display_name | Artificial intelligence |
| concepts[5].id | https://openalex.org/C3018868555 |
| concepts[5].level | 2 |
| concepts[5].score | 0.5767167806625366 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2918907 |
| concepts[5].display_name | Single camera |
| concepts[6].id | https://openalex.org/C82990744 |
| concepts[6].level | 2 |
| concepts[6].score | 0.5638817548751831 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q166194 |
| concepts[6].display_name | RGB color model |
| concepts[7].id | https://openalex.org/C116921373 |
| concepts[7].level | 3 |
| concepts[7].score | 0.5456065535545349 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q2816483 |
| concepts[7].display_name | Real-time rendering |
| concepts[8].id | https://openalex.org/C109950114 |
| concepts[8].level | 2 |
| concepts[8].score | 0.4436799883842468 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q4464732 |
| concepts[8].display_name | 3D reconstruction |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.6900972723960876 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/computer-graphics |
| keywords[1].score | 0.6789517402648926 |
| keywords[1].display_name | Computer graphics (images) |
| keywords[2].id | https://openalex.org/keywords/computer-vision |
| keywords[2].score | 0.6497346758842468 |
| keywords[2].display_name | Computer vision |
| keywords[3].id | https://openalex.org/keywords/rendering |
| keywords[3].score | 0.6164296865463257 |
| keywords[3].display_name | Rendering (computer graphics) |
| keywords[4].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[4].score | 0.5788490176200867 |
| keywords[4].display_name | Artificial intelligence |
| keywords[5].id | https://openalex.org/keywords/single-camera |
| keywords[5].score | 0.5767167806625366 |
| keywords[5].display_name | Single camera |
| keywords[6].id | https://openalex.org/keywords/rgb-color-model |
| keywords[6].score | 0.5638817548751831 |
| keywords[6].display_name | RGB color model |
| keywords[7].id | https://openalex.org/keywords/real-time-rendering |
| keywords[7].score | 0.5456065535545349 |
| keywords[7].display_name | Real-time rendering |
| keywords[8].id | https://openalex.org/keywords/3d-reconstruction |
| keywords[8].score | 0.4436799883842468 |
| keywords[8].display_name | 3D reconstruction |
| language | en |
| locations[0].id | doi:10.1145/3681758.3697993 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | |
| locations[0].pdf_url | https://dl.acm.org/doi/pdf/10.1145/3681758.3697993 |
| locations[0].version | publishedVersion |
| locations[0].raw_type | proceedings-article |
| locations[0].license_id | |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | SIGGRAPH Asia 2024 Technical Communications |
| locations[0].landing_page_url | https://doi.org/10.1145/3681758.3697993 |
| locations[1].id | pmh:oai:https://orca.cardiff.ac.uk:174357 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306400871 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | Spectrum Research Repository (Concordia University) |
| locations[1].source.host_organization | https://openalex.org/I60158472 |
| locations[1].source.host_organization_name | Concordia University |
| locations[1].source.host_organization_lineage | https://openalex.org/I60158472 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | acceptedVersion |
| locations[1].raw_type | Conference or Workshop Item |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | False |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5100837840 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Yuanwang Yang |
| authorships[0].countries | CN |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I162868743 |
| authorships[0].affiliations[0].raw_affiliation_string | Tianjin University, Tianjin, China |
| authorships[0].institutions[0].id | https://openalex.org/I162868743 |
| authorships[0].institutions[0].ror | https://ror.org/012tb2g32 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I162868743 |
| authorships[0].institutions[0].country_code | CN |
| authorships[0].institutions[0].display_name | Tianjin University |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Yuanwang Yang |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Tianjin University, Tianjin, China |
| authorships[1].author.id | https://openalex.org/A5077253274 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-0625-651X |
| authorships[1].author.display_name | Qiao Feng |
| authorships[1].countries | CN |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I162868743 |
| authorships[1].affiliations[0].raw_affiliation_string | Tianjin University, Tianjin, China |
| authorships[1].institutions[0].id | https://openalex.org/I162868743 |
| authorships[1].institutions[0].ror | https://ror.org/012tb2g32 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I162868743 |
| authorships[1].institutions[0].country_code | CN |
| authorships[1].institutions[0].display_name | Tianjin University |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Qiao Feng |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Tianjin University, Tianjin, China |
| authorships[2].author.id | https://openalex.org/A5067850699 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-2094-5680 |
| authorships[2].author.display_name | Yu‐Kun Lai |
| authorships[2].countries | GB |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I79510175 |
| authorships[2].affiliations[0].raw_affiliation_string | Cardiff University, Cardiff, United Kingdom |
| authorships[2].institutions[0].id | https://openalex.org/I79510175 |
| authorships[2].institutions[0].ror | https://ror.org/03kk7td41 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I79510175 |
| authorships[2].institutions[0].country_code | GB |
| authorships[2].institutions[0].display_name | Cardiff University |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Yu-Kun Lai |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Cardiff University, Cardiff, United Kingdom |
| authorships[3].author.id | https://openalex.org/A5100377578 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-2326-0166 |
| authorships[3].author.display_name | Kun Li |
| authorships[3].countries | CN |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I162868743 |
| authorships[3].affiliations[0].raw_affiliation_string | Tianjin University, Tianjin, China |
| authorships[3].institutions[0].id | https://openalex.org/I162868743 |
| authorships[3].institutions[0].ror | https://ror.org/012tb2g32 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I162868743 |
| authorships[3].institutions[0].country_code | CN |
| authorships[3].institutions[0].display_name | Tianjin University |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Kun Li |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | Tianjin University, Tianjin, China |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://dl.acm.org/doi/pdf/10.1145/3681758.3697993 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Real-time 3D Human Reconstruction and Rendering System from a Single RGB Camera |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10719 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.9994999766349792 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2206 |
| primary_topic.subfield.display_name | Computational Mechanics |
| primary_topic.display_name | 3D Shape Modeling and Analysis |
| related_works | https://openalex.org/W2112265557, https://openalex.org/W2349695707, https://openalex.org/W2377937343, https://openalex.org/W2125636673, https://openalex.org/W2979719962, https://openalex.org/W2022688099, https://openalex.org/W2118643726, https://openalex.org/W2361687461, https://openalex.org/W1994086797, https://openalex.org/W2350100566 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | doi:10.1145/3681758.3697993 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://dl.acm.org/doi/pdf/10.1145/3681758.3697993 |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | proceedings-article |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | SIGGRAPH Asia 2024 Technical Communications |
| best_oa_location.landing_page_url | https://doi.org/10.1145/3681758.3697993 |
| primary_location.id | doi:10.1145/3681758.3697993 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | |
| primary_location.pdf_url | https://dl.acm.org/doi/pdf/10.1145/3681758.3697993 |
| primary_location.version | publishedVersion |
| primary_location.raw_type | proceedings-article |
| primary_location.license_id | |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | SIGGRAPH Asia 2024 Technical Communications |
| primary_location.landing_page_url | https://doi.org/10.1145/3681758.3697993 |
| publication_date | 2024-11-19 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W4390873675, https://openalex.org/W2963995996, https://openalex.org/W3193427204, https://openalex.org/W1967554269, https://openalex.org/W2981978060, https://openalex.org/W4311034204, https://openalex.org/W4233857083, https://openalex.org/W4406265772, https://openalex.org/W3174025609, https://openalex.org/W4402733571, https://openalex.org/W4389317685, https://openalex.org/W2394699868 |
| referenced_works_count | 12 |
| abstract_inverted_index.a | 17, 27, 62, 107, 112, 123 |
| abstract_inverted_index.2D | 1 |
| abstract_inverted_index.3D | 5, 20, 86 |
| abstract_inverted_index.In | 12, 58 |
| abstract_inverted_index.We | 44 |
| abstract_inverted_index.at | 31 |
| abstract_inverted_index.is | 7 |
| abstract_inverted_index.of | 74, 105 |
| abstract_inverted_index.to | 47, 66 |
| abstract_inverted_index.we | 15, 60 |
| abstract_inverted_index.28+ | 32 |
| abstract_inverted_index.GPU | 114 |
| abstract_inverted_index.Our | 101 |
| abstract_inverted_index.RGB | 29 |
| abstract_inverted_index.USB | 109 |
| abstract_inverted_index.and | 23, 40, 71, 89, 111, 118 |
| abstract_inverted_index.for | 9, 54, 91 |
| abstract_inverted_index.our | 81 |
| abstract_inverted_index.the | 52, 68, 75 |
| abstract_inverted_index.use | 45, 104 |
| abstract_inverted_index.FPS, | 33 |
| abstract_inverted_index.both | 36 |
| abstract_inverted_index.even | 97 |
| abstract_inverted_index.into | 4 |
| abstract_inverted_index.only | 106 |
| abstract_inverted_index.over | 51 |
| abstract_inverted_index.show | 79 |
| abstract_inverted_index.that | 80 |
| abstract_inverted_index.this | 13 |
| abstract_inverted_index.with | 26, 98, 115 |
| abstract_inverted_index.human | 2, 21, 87 |
| abstract_inverted_index.makes | 103 |
| abstract_inverted_index.speed | 39 |
| abstract_inverted_index.which | 34, 121 |
| abstract_inverted_index.WebRTC | 46 |
| abstract_inverted_index.camera | 30 |
| abstract_inverted_index.common | 108 |
| abstract_inverted_index.design | 61 |
| abstract_inverted_index.images | 3, 50 |
| abstract_inverted_index.model. | 76 |
| abstract_inverted_index.paper, | 14 |
| abstract_inverted_index.poses. | 100 |
| abstract_inverted_index.remote | 56 |
| abstract_inverted_index.single | 28 |
| abstract_inverted_index.system | 25, 82, 102 |
| abstract_inverted_index.webcam | 110 |
| abstract_inverted_index.ability | 73 |
| abstract_inverted_index.enhance | 67 |
| abstract_inverted_index.persons | 93 |
| abstract_inverted_index.results | 78 |
| abstract_inverted_index.various | 95 |
| abstract_inverted_index.wearing | 94 |
| abstract_inverted_index.Internet | 53 |
| abstract_inverted_index.achieves | 83 |
| abstract_inverted_index.approach | 65 |
| abstract_inverted_index.captured | 49 |
| abstract_inverted_index.clothes, | 96 |
| abstract_inverted_index.lighting | 69 |
| abstract_inverted_index.low-cost | 18 |
| abstract_inverted_index.provides | 122 |
| abstract_inverted_index.results, | 120 |
| abstract_inverted_index.results. | 43 |
| abstract_inverted_index.transmit | 48 |
| abstract_inverted_index.addition, | 59 |
| abstract_inverted_index.computing | 38 |
| abstract_inverted_index.different | 92 |
| abstract_inverted_index.essential | 8 |
| abstract_inverted_index.immersive | 10, 125 |
| abstract_inverted_index.introduce | 16 |
| abstract_inverted_index.real-time | 19, 37, 85, 116 |
| abstract_inverted_index.realistic | 41 |
| abstract_inverted_index.rendering | 24, 42, 64, 90 |
| abstract_inverted_index.solution. | 127 |
| abstract_inverted_index.appearance | 6 |
| abstract_inverted_index.guarantees | 35 |
| abstract_inverted_index.perception | 70 |
| abstract_inverted_index.challenging | 99 |
| abstract_inverted_index.low-latency | 55 |
| abstract_inverted_index.performance | 117 |
| abstract_inverted_index.Experimental | 77 |
| abstract_inverted_index.Transforming | 0 |
| abstract_inverted_index.high-quality | 84 |
| abstract_inverted_index.telepresence | 126 |
| abstract_inverted_index.high-fidelity | 119 |
| abstract_inverted_index.communication. | 11, 57 |
| abstract_inverted_index.consumer-level | 113 |
| abstract_inverted_index.generalization | 72 |
| abstract_inverted_index.reconstruction | 22, 88 |
| abstract_inverted_index.lighting-robust | 63 |
| abstract_inverted_index.consumer-accessible | 124 |
| cited_by_percentile_year | |
| countries_distinct_count | 2 |
| institutions_distinct_count | 4 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/11 |
| sustainable_development_goals[0].score | 0.7099999785423279 |
| sustainable_development_goals[0].display_name | Sustainable cities and communities |
| citation_normalized_percentile.value | 0.28685011 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |