Look Gauss, No Pose: Novel View Synthesis using Gaussian Splatting without Accurate Pose Initialization Article Swipe
C. Max Schmidt
,
Jens Piekenbrinck
,
Bastian Leibe
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2410.08743
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2410.08743
3D Gaussian Splatting has recently emerged as a powerful tool for fast and accurate novel-view synthesis from a set of posed input images. However, like most novel-view synthesis approaches, it relies on accurate camera pose information, limiting its applicability in real-world scenarios where acquiring accurate camera poses can be challenging or even impossible. We propose an extension to the 3D Gaussian Splatting framework by optimizing the extrinsic camera parameters with respect to photometric residuals. We derive the analytical gradients and integrate their computation with the existing high-performance CUDA implementation. This enables downstream tasks such as 6-DoF camera pose estimation as well as joint reconstruction and camera refinement. In particular, we achieve rapid convergence and high accuracy for pose estimation on real-world scenes. Our method enables fast reconstruction of 3D scenes without requiring accurate pose information by jointly optimizing geometry and camera poses, while achieving state-of-the-art results in novel-view synthesis. Our approach is considerably faster to optimize than most competing methods, and several times faster in rendering. We show results on real-world scenes and complex trajectories through simulated environments, achieving state-of-the-art results on LLFF while reducing runtime by two to four times compared to the most efficient competing method. Source code will be available at https://github.com/Schmiddo/noposegs .
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2410.08743
- https://arxiv.org/pdf/2410.08743
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4403444509
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4403444509Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2410.08743Digital Object Identifier
- Title
-
Look Gauss, No Pose: Novel View Synthesis using Gaussian Splatting without Accurate Pose InitializationWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-10-11Full publication date if available
- Authors
-
C. Max Schmidt, Jens Piekenbrinck, Bastian LeibeList of authors in order
- Landing page
-
https://arxiv.org/abs/2410.08743Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2410.08743Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2410.08743Direct OA link when available
- Concepts
-
Initialization, Computer science, Artificial intelligence, Gauss, Gaussian, Computer vision, Pose, Physics, Programming language, Quantum mechanicsTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4403444509 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2410.08743 |
| ids.doi | https://doi.org/10.48550/arxiv.2410.08743 |
| ids.openalex | https://openalex.org/W4403444509 |
| fwci | |
| type | preprint |
| title | Look Gauss, No Pose: Novel View Synthesis using Gaussian Splatting without Accurate Pose Initialization |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10531 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9955000281333923 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1707 |
| topics[0].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[0].display_name | Advanced Vision and Imaging |
| topics[1].id | https://openalex.org/T10191 |
| topics[1].field.id | https://openalex.org/fields/22 |
| topics[1].field.display_name | Engineering |
| topics[1].score | 0.9916999936103821 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2202 |
| topics[1].subfield.display_name | Aerospace Engineering |
| topics[1].display_name | Robotics and Sensor-Based Localization |
| topics[2].id | https://openalex.org/T10888 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9839000105857849 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1707 |
| topics[2].subfield.display_name | Computer Vision and Pattern Recognition |
| topics[2].display_name | Augmented Reality Applications |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C114466953 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8216338157653809 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q6034165 |
| concepts[0].display_name | Initialization |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.7345230579376221 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C154945302 |
| concepts[2].level | 1 |
| concepts[2].score | 0.6038834452629089 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[2].display_name | Artificial intelligence |
| concepts[3].id | https://openalex.org/C161794534 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5918992161750793 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q177493 |
| concepts[3].display_name | Gauss |
| concepts[4].id | https://openalex.org/C163716315 |
| concepts[4].level | 2 |
| concepts[4].score | 0.5721251964569092 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q901177 |
| concepts[4].display_name | Gaussian |
| concepts[5].id | https://openalex.org/C31972630 |
| concepts[5].level | 1 |
| concepts[5].score | 0.5366816520690918 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q844240 |
| concepts[5].display_name | Computer vision |
| concepts[6].id | https://openalex.org/C52102323 |
| concepts[6].level | 2 |
| concepts[6].score | 0.48984548449516296 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q1671968 |
| concepts[6].display_name | Pose |
| concepts[7].id | https://openalex.org/C121332964 |
| concepts[7].level | 0 |
| concepts[7].score | 0.049784183502197266 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q413 |
| concepts[7].display_name | Physics |
| concepts[8].id | https://openalex.org/C199360897 |
| concepts[8].level | 1 |
| concepts[8].score | 0.03791353106498718 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q9143 |
| concepts[8].display_name | Programming language |
| concepts[9].id | https://openalex.org/C62520636 |
| concepts[9].level | 1 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q944 |
| concepts[9].display_name | Quantum mechanics |
| keywords[0].id | https://openalex.org/keywords/initialization |
| keywords[0].score | 0.8216338157653809 |
| keywords[0].display_name | Initialization |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.7345230579376221 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[2].score | 0.6038834452629089 |
| keywords[2].display_name | Artificial intelligence |
| keywords[3].id | https://openalex.org/keywords/gauss |
| keywords[3].score | 0.5918992161750793 |
| keywords[3].display_name | Gauss |
| keywords[4].id | https://openalex.org/keywords/gaussian |
| keywords[4].score | 0.5721251964569092 |
| keywords[4].display_name | Gaussian |
| keywords[5].id | https://openalex.org/keywords/computer-vision |
| keywords[5].score | 0.5366816520690918 |
| keywords[5].display_name | Computer vision |
| keywords[6].id | https://openalex.org/keywords/pose |
| keywords[6].score | 0.48984548449516296 |
| keywords[6].display_name | Pose |
| keywords[7].id | https://openalex.org/keywords/physics |
| keywords[7].score | 0.049784183502197266 |
| keywords[7].display_name | Physics |
| keywords[8].id | https://openalex.org/keywords/programming-language |
| keywords[8].score | 0.03791353106498718 |
| keywords[8].display_name | Programming language |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2410.08743 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://arxiv.org/pdf/2410.08743 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2410.08743 |
| locations[1].id | doi:10.48550/arxiv.2410.08743 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2410.08743 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5015843387 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-2447-2128 |
| authorships[0].author.display_name | C. Max Schmidt |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Schmidt, Christian |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5107516043 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Jens Piekenbrinck |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Piekenbrinck, Jens |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5071006649 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-4225-0051 |
| authorships[2].author.display_name | Bastian Leibe |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Leibe, Bastian |
| authorships[2].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2410.08743 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-10-16T00:00:00 |
| display_name | Look Gauss, No Pose: Novel View Synthesis using Gaussian Splatting without Accurate Pose Initialization |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10531 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9955000281333923 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1707 |
| primary_topic.subfield.display_name | Computer Vision and Pattern Recognition |
| primary_topic.display_name | Advanced Vision and Imaging |
| related_works | https://openalex.org/W3204184292, https://openalex.org/W3176564347, https://openalex.org/W1985458517, https://openalex.org/W2355833770, https://openalex.org/W3031039437, https://openalex.org/W183202219, https://openalex.org/W2088028039, https://openalex.org/W2736638679, https://openalex.org/W4313046826, https://openalex.org/W1968716783 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2410.08743 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2410.08743 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2410.08743 |
| primary_location.id | pmh:oai:arXiv.org:2410.08743 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://arxiv.org/pdf/2410.08743 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2410.08743 |
| publication_date | 2024-10-11 |
| publication_year | 2024 |
| referenced_works_count | 0 |
| abstract_inverted_index.. | 205 |
| abstract_inverted_index.a | 7, 17 |
| abstract_inverted_index.3D | 0, 59, 128 |
| abstract_inverted_index.In | 107 |
| abstract_inverted_index.We | 53, 74, 166 |
| abstract_inverted_index.an | 55 |
| abstract_inverted_index.as | 6, 94, 99, 101 |
| abstract_inverted_index.at | 203 |
| abstract_inverted_index.be | 48, 201 |
| abstract_inverted_index.by | 63, 135, 186 |
| abstract_inverted_index.in | 39, 146, 164 |
| abstract_inverted_index.is | 151 |
| abstract_inverted_index.it | 29 |
| abstract_inverted_index.of | 19, 127 |
| abstract_inverted_index.on | 31, 119, 169, 181 |
| abstract_inverted_index.or | 50 |
| abstract_inverted_index.to | 57, 71, 154, 188, 192 |
| abstract_inverted_index.we | 109 |
| abstract_inverted_index.Our | 122, 149 |
| abstract_inverted_index.and | 12, 79, 104, 113, 139, 160, 172 |
| abstract_inverted_index.can | 47 |
| abstract_inverted_index.for | 10, 116 |
| abstract_inverted_index.has | 3 |
| abstract_inverted_index.its | 37 |
| abstract_inverted_index.set | 18 |
| abstract_inverted_index.the | 58, 65, 76, 84, 193 |
| abstract_inverted_index.two | 187 |
| abstract_inverted_index.CUDA | 87 |
| abstract_inverted_index.LLFF | 182 |
| abstract_inverted_index.This | 89 |
| abstract_inverted_index.code | 199 |
| abstract_inverted_index.even | 51 |
| abstract_inverted_index.fast | 11, 125 |
| abstract_inverted_index.four | 189 |
| abstract_inverted_index.from | 16 |
| abstract_inverted_index.high | 114 |
| abstract_inverted_index.like | 24 |
| abstract_inverted_index.most | 25, 157, 194 |
| abstract_inverted_index.pose | 34, 97, 117, 133 |
| abstract_inverted_index.show | 167 |
| abstract_inverted_index.such | 93 |
| abstract_inverted_index.than | 156 |
| abstract_inverted_index.tool | 9 |
| abstract_inverted_index.well | 100 |
| abstract_inverted_index.will | 200 |
| abstract_inverted_index.with | 69, 83 |
| abstract_inverted_index.6-DoF | 95 |
| abstract_inverted_index.input | 21 |
| abstract_inverted_index.joint | 102 |
| abstract_inverted_index.posed | 20 |
| abstract_inverted_index.poses | 46 |
| abstract_inverted_index.rapid | 111 |
| abstract_inverted_index.tasks | 92 |
| abstract_inverted_index.their | 81 |
| abstract_inverted_index.times | 162, 190 |
| abstract_inverted_index.where | 42 |
| abstract_inverted_index.while | 142, 183 |
| abstract_inverted_index.Source | 198 |
| abstract_inverted_index.camera | 33, 45, 67, 96, 105, 140 |
| abstract_inverted_index.derive | 75 |
| abstract_inverted_index.faster | 153, 163 |
| abstract_inverted_index.method | 123 |
| abstract_inverted_index.poses, | 141 |
| abstract_inverted_index.relies | 30 |
| abstract_inverted_index.scenes | 129, 171 |
| abstract_inverted_index.achieve | 110 |
| abstract_inverted_index.complex | 173 |
| abstract_inverted_index.emerged | 5 |
| abstract_inverted_index.enables | 90, 124 |
| abstract_inverted_index.images. | 22 |
| abstract_inverted_index.jointly | 136 |
| abstract_inverted_index.method. | 197 |
| abstract_inverted_index.propose | 54 |
| abstract_inverted_index.respect | 70 |
| abstract_inverted_index.results | 145, 168, 180 |
| abstract_inverted_index.runtime | 185 |
| abstract_inverted_index.scenes. | 121 |
| abstract_inverted_index.several | 161 |
| abstract_inverted_index.through | 175 |
| abstract_inverted_index.without | 130 |
| abstract_inverted_index.Gaussian | 1, 60 |
| abstract_inverted_index.However, | 23 |
| abstract_inverted_index.accuracy | 115 |
| abstract_inverted_index.accurate | 13, 32, 44, 132 |
| abstract_inverted_index.approach | 150 |
| abstract_inverted_index.compared | 191 |
| abstract_inverted_index.existing | 85 |
| abstract_inverted_index.geometry | 138 |
| abstract_inverted_index.limiting | 36 |
| abstract_inverted_index.methods, | 159 |
| abstract_inverted_index.optimize | 155 |
| abstract_inverted_index.powerful | 8 |
| abstract_inverted_index.recently | 4 |
| abstract_inverted_index.reducing | 184 |
| abstract_inverted_index.Splatting | 2, 61 |
| abstract_inverted_index.achieving | 143, 178 |
| abstract_inverted_index.acquiring | 43 |
| abstract_inverted_index.available | 202 |
| abstract_inverted_index.competing | 158, 196 |
| abstract_inverted_index.efficient | 195 |
| abstract_inverted_index.extension | 56 |
| abstract_inverted_index.extrinsic | 66 |
| abstract_inverted_index.framework | 62 |
| abstract_inverted_index.gradients | 78 |
| abstract_inverted_index.integrate | 80 |
| abstract_inverted_index.requiring | 131 |
| abstract_inverted_index.scenarios | 41 |
| abstract_inverted_index.simulated | 176 |
| abstract_inverted_index.synthesis | 15, 27 |
| abstract_inverted_index.analytical | 77 |
| abstract_inverted_index.downstream | 91 |
| abstract_inverted_index.estimation | 98, 118 |
| abstract_inverted_index.novel-view | 14, 26, 147 |
| abstract_inverted_index.optimizing | 64, 137 |
| abstract_inverted_index.parameters | 68 |
| abstract_inverted_index.real-world | 40, 120, 170 |
| abstract_inverted_index.rendering. | 165 |
| abstract_inverted_index.residuals. | 73 |
| abstract_inverted_index.synthesis. | 148 |
| abstract_inverted_index.approaches, | 28 |
| abstract_inverted_index.challenging | 49 |
| abstract_inverted_index.computation | 82 |
| abstract_inverted_index.convergence | 112 |
| abstract_inverted_index.impossible. | 52 |
| abstract_inverted_index.information | 134 |
| abstract_inverted_index.particular, | 108 |
| abstract_inverted_index.photometric | 72 |
| abstract_inverted_index.refinement. | 106 |
| abstract_inverted_index.considerably | 152 |
| abstract_inverted_index.information, | 35 |
| abstract_inverted_index.trajectories | 174 |
| abstract_inverted_index.applicability | 38 |
| abstract_inverted_index.environments, | 177 |
| abstract_inverted_index.reconstruction | 103, 126 |
| abstract_inverted_index.implementation. | 88 |
| abstract_inverted_index.high-performance | 86 |
| abstract_inverted_index.state-of-the-art | 144, 179 |
| abstract_inverted_index.https://github.com/Schmiddo/noposegs | 204 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 3 |
| citation_normalized_percentile |