Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle Article Swipe
YOU?
·
· 2023
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2312.03431
We introduce Gaussian-Flow, a novel point-based approach for fast dynamic scene reconstruction and real-time rendering from both multi-view and monocular videos. In contrast to the prevalent NeRF-based approaches hampered by slow training and rendering speeds, our approach harnesses recent advancements in point-based 3D Gaussian Splatting (3DGS). Specifically, a novel Dual-Domain Deformation Model (DDDM) is proposed to explicitly model attribute deformations of each Gaussian point, where the time-dependent residual of each attribute is captured by a polynomial fitting in the time domain, and a Fourier series fitting in the frequency domain. The proposed DDDM is capable of modeling complex scene deformations across long video footage, eliminating the need for training separate 3DGS for each frame or introducing an additional implicit neural field to model 3D dynamics. Moreover, the explicit deformation modeling for discretized Gaussian points ensures ultra-fast training and rendering of a 4D scene, which is comparable to the original 3DGS designed for static 3D reconstruction. Our proposed approach showcases a substantial efficiency improvement, achieving a $5\times$ faster training speed compared to the per-frame 3DGS modeling. In addition, quantitative results demonstrate that the proposed Gaussian-Flow significantly outperforms previous leading methods in novel view rendering quality. Project page: https://nju-3dv.github.io/projects/Gaussian-Flow
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2312.03431
- https://arxiv.org/pdf/2312.03431
- OA Status
- green
- Cited By
- 2
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4389471228
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4389471228Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2312.03431Digital Object Identifier
- Title
-
Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian ParticleWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2023Year of publication
- Publication date
-
2023-12-06Full publication date if available
- Authors
-
Youtian Lin, Zuozhuo Dai, Siyu Zhu, Yao YaoList of authors in order
- Landing page
-
https://arxiv.org/abs/2312.03431Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2312.03431Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2312.03431Direct OA link when available
- Concepts
-
Rendering (computer graphics), Computer science, Gaussian, Artificial intelligence, Computer vision, Discretization, Algorithm, Gaussian network model, Computer graphics (images), Mathematics, Mathematical analysis, Physics, Quantum mechanicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
2Total citation count in OpenAlex
- Citations by year (recent)
-
2024: 2Per-year citation counts (last 5 years)
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4389471228 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2312.03431 |
| ids.doi | https://doi.org/10.48550/arxiv.2312.03431 |
| ids.openalex | https://openalex.org/W4389471228 |
| fwci | |
| type | preprint |
| title | Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10531 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9998999834060669 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1707 |
| topics[0].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[0].display_name | Advanced Vision and Imaging |
| topics[1].id | https://openalex.org/T10481 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9987000226974487 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1704 |
| topics[1].subfield.display_name | Computer Graphics and Computer-Aided Design |
| topics[1].display_name | Computer Graphics and Visualization Techniques |
| topics[2].id | https://openalex.org/T10719 |
| topics[2].field.id | https://openalex.org/fields/22 |
| topics[2].field.display_name | Engineering |
| topics[2].score | 0.9973000288009644 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2206 |
| topics[2].subfield.display_name | Computational Mechanics |
| topics[2].display_name | 3D Shape Modeling and Analysis |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C205711294 |
| concepts[0].level | 2 |
| concepts[0].score | 0.7633498907089233 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q176953 |
| concepts[0].display_name | Rendering (computer graphics) |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.7625466585159302 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C163716315 |
| concepts[2].level | 2 |
| concepts[2].score | 0.7015429735183716 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q901177 |
| concepts[2].display_name | Gaussian |
| concepts[3].id | https://openalex.org/C154945302 |
| concepts[3].level | 1 |
| concepts[3].score | 0.5468948483467102 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[3].display_name | Artificial intelligence |
| concepts[4].id | https://openalex.org/C31972630 |
| concepts[4].level | 1 |
| concepts[4].score | 0.516249418258667 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q844240 |
| concepts[4].display_name | Computer vision |
| concepts[5].id | https://openalex.org/C73000952 |
| concepts[5].level | 2 |
| concepts[5].score | 0.48633748292922974 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q17007827 |
| concepts[5].display_name | Discretization |
| concepts[6].id | https://openalex.org/C11413529 |
| concepts[6].level | 1 |
| concepts[6].score | 0.4522942304611206 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q8366 |
| concepts[6].display_name | Algorithm |
| concepts[7].id | https://openalex.org/C166550679 |
| concepts[7].level | 3 |
| concepts[7].score | 0.4143680930137634 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q263400 |
| concepts[7].display_name | Gaussian network model |
| concepts[8].id | https://openalex.org/C121684516 |
| concepts[8].level | 1 |
| concepts[8].score | 0.3413239121437073 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q7600677 |
| concepts[8].display_name | Computer graphics (images) |
| concepts[9].id | https://openalex.org/C33923547 |
| concepts[9].level | 0 |
| concepts[9].score | 0.17292562127113342 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[9].display_name | Mathematics |
| concepts[10].id | https://openalex.org/C134306372 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q7754 |
| concepts[10].display_name | Mathematical analysis |
| concepts[11].id | https://openalex.org/C121332964 |
| concepts[11].level | 0 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[11].display_name | Physics |
| concepts[12].id | https://openalex.org/C62520636 |
| concepts[12].level | 1 |
| concepts[12].score | 0.0 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q944 |
| concepts[12].display_name | Quantum mechanics |
| keywords[0].id | https://openalex.org/keywords/rendering |
| keywords[0].score | 0.7633498907089233 |
| keywords[0].display_name | Rendering (computer graphics) |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.7625466585159302 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/gaussian |
| keywords[2].score | 0.7015429735183716 |
| keywords[2].display_name | Gaussian |
| keywords[3].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[3].score | 0.5468948483467102 |
| keywords[3].display_name | Artificial intelligence |
| keywords[4].id | https://openalex.org/keywords/computer-vision |
| keywords[4].score | 0.516249418258667 |
| keywords[4].display_name | Computer vision |
| keywords[5].id | https://openalex.org/keywords/discretization |
| keywords[5].score | 0.48633748292922974 |
| keywords[5].display_name | Discretization |
| keywords[6].id | https://openalex.org/keywords/algorithm |
| keywords[6].score | 0.4522942304611206 |
| keywords[6].display_name | Algorithm |
| keywords[7].id | https://openalex.org/keywords/gaussian-network-model |
| keywords[7].score | 0.4143680930137634 |
| keywords[7].display_name | Gaussian network model |
| keywords[8].id | https://openalex.org/keywords/computer-graphics |
| keywords[8].score | 0.3413239121437073 |
| keywords[8].display_name | Computer graphics (images) |
| keywords[9].id | https://openalex.org/keywords/mathematics |
| keywords[9].score | 0.17292562127113342 |
| keywords[9].display_name | Mathematics |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2312.03431 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2312.03431 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2312.03431 |
| locations[1].id | doi:10.48550/arxiv.2312.03431 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2312.03431 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5056639653 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Youtian Lin |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Lin, Youtian |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5060851814 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-9276-6772 |
| authorships[1].author.display_name | Zuozhuo Dai |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Dai, Zuozhuo |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5100780063 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Siyu Zhu |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Zhu, Siyu |
| authorships[2].is_corresponding | False |
| authorships[3].author.id | https://openalex.org/A5039566120 |
| authorships[3].author.orcid | |
| authorships[3].author.display_name | Yao Yao |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Yao, Yao |
| authorships[3].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2312.03431 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10531 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9998999834060669 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1707 |
| primary_topic.subfield.display_name | Computer Vision and Pattern Recognition |
| primary_topic.display_name | Advanced Vision and Imaging |
| related_works | https://openalex.org/W291250033, https://openalex.org/W2035757446, https://openalex.org/W2008385118, https://openalex.org/W880955280, https://openalex.org/W2106647072, https://openalex.org/W4246858109, https://openalex.org/W2172753644, https://openalex.org/W54172855, https://openalex.org/W2170209930, https://openalex.org/W2046782623 |
| cited_by_count | 2 |
| counts_by_year[0].year | 2024 |
| counts_by_year[0].cited_by_count | 2 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2312.03431 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2312.03431 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2312.03431 |
| primary_location.id | pmh:oai:arXiv.org:2312.03431 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2312.03431 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2312.03431 |
| publication_date | 2023-12-06 |
| publication_year | 2023 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 3, 47, 74, 82, 140, 159, 164 |
| abstract_inverted_index.3D | 42, 123, 153 |
| abstract_inverted_index.4D | 141 |
| abstract_inverted_index.In | 21, 175 |
| abstract_inverted_index.We | 0 |
| abstract_inverted_index.an | 116 |
| abstract_inverted_index.by | 29, 73 |
| abstract_inverted_index.in | 40, 77, 86, 189 |
| abstract_inverted_index.is | 53, 71, 93, 144 |
| abstract_inverted_index.of | 60, 68, 95, 139 |
| abstract_inverted_index.or | 114 |
| abstract_inverted_index.to | 23, 55, 121, 146, 170 |
| abstract_inverted_index.Our | 155 |
| abstract_inverted_index.The | 90 |
| abstract_inverted_index.and | 12, 18, 32, 81, 137 |
| abstract_inverted_index.for | 7, 107, 111, 130, 151 |
| abstract_inverted_index.our | 35 |
| abstract_inverted_index.the | 24, 65, 78, 87, 105, 126, 147, 171, 181 |
| abstract_inverted_index.3DGS | 110, 149, 173 |
| abstract_inverted_index.DDDM | 92 |
| abstract_inverted_index.both | 16 |
| abstract_inverted_index.each | 61, 69, 112 |
| abstract_inverted_index.fast | 8 |
| abstract_inverted_index.from | 15 |
| abstract_inverted_index.long | 101 |
| abstract_inverted_index.need | 106 |
| abstract_inverted_index.slow | 30 |
| abstract_inverted_index.that | 180 |
| abstract_inverted_index.time | 79 |
| abstract_inverted_index.view | 191 |
| abstract_inverted_index.Model | 51 |
| abstract_inverted_index.field | 120 |
| abstract_inverted_index.frame | 113 |
| abstract_inverted_index.model | 57, 122 |
| abstract_inverted_index.novel | 4, 48, 190 |
| abstract_inverted_index.page: | 195 |
| abstract_inverted_index.scene | 10, 98 |
| abstract_inverted_index.speed | 168 |
| abstract_inverted_index.video | 102 |
| abstract_inverted_index.where | 64 |
| abstract_inverted_index.which | 143 |
| abstract_inverted_index.(DDDM) | 52 |
| abstract_inverted_index.across | 100 |
| abstract_inverted_index.faster | 166 |
| abstract_inverted_index.neural | 119 |
| abstract_inverted_index.point, | 63 |
| abstract_inverted_index.points | 133 |
| abstract_inverted_index.recent | 38 |
| abstract_inverted_index.scene, | 142 |
| abstract_inverted_index.series | 84 |
| abstract_inverted_index.static | 152 |
| abstract_inverted_index.(3DGS). | 45 |
| abstract_inverted_index.Fourier | 83 |
| abstract_inverted_index.Project | 194 |
| abstract_inverted_index.capable | 94 |
| abstract_inverted_index.complex | 97 |
| abstract_inverted_index.domain, | 80 |
| abstract_inverted_index.domain. | 89 |
| abstract_inverted_index.dynamic | 9 |
| abstract_inverted_index.ensures | 134 |
| abstract_inverted_index.fitting | 76, 85 |
| abstract_inverted_index.leading | 187 |
| abstract_inverted_index.methods | 188 |
| abstract_inverted_index.results | 178 |
| abstract_inverted_index.speeds, | 34 |
| abstract_inverted_index.videos. | 20 |
| abstract_inverted_index.Gaussian | 43, 62, 132 |
| abstract_inverted_index.approach | 6, 36, 157 |
| abstract_inverted_index.captured | 72 |
| abstract_inverted_index.compared | 169 |
| abstract_inverted_index.contrast | 22 |
| abstract_inverted_index.designed | 150 |
| abstract_inverted_index.explicit | 127 |
| abstract_inverted_index.footage, | 103 |
| abstract_inverted_index.hampered | 28 |
| abstract_inverted_index.implicit | 118 |
| abstract_inverted_index.modeling | 96, 129 |
| abstract_inverted_index.original | 148 |
| abstract_inverted_index.previous | 186 |
| abstract_inverted_index.proposed | 54, 91, 156, 182 |
| abstract_inverted_index.quality. | 193 |
| abstract_inverted_index.residual | 67 |
| abstract_inverted_index.separate | 109 |
| abstract_inverted_index.training | 31, 108, 136, 167 |
| abstract_inverted_index.$5\times$ | 165 |
| abstract_inverted_index.Moreover, | 125 |
| abstract_inverted_index.Splatting | 44 |
| abstract_inverted_index.achieving | 163 |
| abstract_inverted_index.addition, | 176 |
| abstract_inverted_index.attribute | 58, 70 |
| abstract_inverted_index.dynamics. | 124 |
| abstract_inverted_index.frequency | 88 |
| abstract_inverted_index.harnesses | 37 |
| abstract_inverted_index.introduce | 1 |
| abstract_inverted_index.modeling. | 174 |
| abstract_inverted_index.monocular | 19 |
| abstract_inverted_index.per-frame | 172 |
| abstract_inverted_index.prevalent | 25 |
| abstract_inverted_index.real-time | 13 |
| abstract_inverted_index.rendering | 14, 33, 138, 192 |
| abstract_inverted_index.showcases | 158 |
| abstract_inverted_index.NeRF-based | 26 |
| abstract_inverted_index.additional | 117 |
| abstract_inverted_index.approaches | 27 |
| abstract_inverted_index.comparable | 145 |
| abstract_inverted_index.efficiency | 161 |
| abstract_inverted_index.explicitly | 56 |
| abstract_inverted_index.multi-view | 17 |
| abstract_inverted_index.polynomial | 75 |
| abstract_inverted_index.ultra-fast | 135 |
| abstract_inverted_index.Deformation | 50 |
| abstract_inverted_index.Dual-Domain | 49 |
| abstract_inverted_index.deformation | 128 |
| abstract_inverted_index.demonstrate | 179 |
| abstract_inverted_index.discretized | 131 |
| abstract_inverted_index.eliminating | 104 |
| abstract_inverted_index.introducing | 115 |
| abstract_inverted_index.outperforms | 185 |
| abstract_inverted_index.point-based | 5, 41 |
| abstract_inverted_index.substantial | 160 |
| abstract_inverted_index.advancements | 39 |
| abstract_inverted_index.deformations | 59, 99 |
| abstract_inverted_index.improvement, | 162 |
| abstract_inverted_index.quantitative | 177 |
| abstract_inverted_index.Gaussian-Flow | 183 |
| abstract_inverted_index.Specifically, | 46 |
| abstract_inverted_index.significantly | 184 |
| abstract_inverted_index.Gaussian-Flow, | 2 |
| abstract_inverted_index.reconstruction | 11 |
| abstract_inverted_index.time-dependent | 66 |
| abstract_inverted_index.reconstruction. | 154 |
| abstract_inverted_index.https://nju-3dv.github.io/projects/Gaussian-Flow | 196 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 4 |
| citation_normalized_percentile |