Multiview 2D/3D Rigid Registration via a Point-Of-Interest Network for Tracking and Triangulation ($\text{POINT}^2$) Article Swipe

MAKE IMPACT

Haofu Liao , Wei-An Lin , Jiarui Zhang , Jingdan Zhang , Jiebo Luo , Shoujun Zhou · YOU? · · 2019 · Open Access · · DOI: https://doi.org/10.48550/arxiv.1903.03896

We propose to tackle the problem of multiview 2D/3D rigid registration for intervention via a Point-Of-Interest Network for Tracking and Triangulation ($\text{POINT}^2$). $\text{POINT}^2$ learns to establish 2D point-to-point correspondences between the pre- and intra-intervention images by tracking a set of random POIs. The 3D pose of the pre-intervention volume is then estimated through a triangulation layer. In $\text{POINT}^2$, the unified framework of the POI tracker and the triangulation layer enables learning informative 2D features and estimating 3D pose jointly. In contrast to existing approaches, $\text{POINT}^2$ only requires a single forward-pass to achieve a reliable 2D/3D registration. As the POI tracker is shift-invariant, $\text{POINT}^2$ is more robust to the initial pose of the 3D pre-intervention image. Extensive experiments on a large-scale clinical cone-beam CT (CBCT) dataset show that the proposed $\text{POINT}^2$ method outperforms the existing learning-based method in terms of accuracy, robustness and running time. Furthermore, when used as an initial pose estimator, our method also improves the robustness and speed of the state-of-the-art optimization-based approaches by ten folds.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/1903.03896

PDF

https://arxiv.org/pdf/1903.03896

OA Status

green

References

26

Related Works

10

OpenAlex ID

https://openalex.org/W2921143210

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W2921143210

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.1903.03896

Digital Object Identifier

Title

Multiview 2D/3D Rigid Registration via a Point-Of-Interest Network for Tracking and Triangulation ($\text{POINT}^2$)

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2019

Year of publication

Publication date

2019-03-10

Full publication date if available

Authors

Haofu Liao, Wei-An Lin, Jiarui Zhang, Jingdan Zhang, Jiebo Luo, Shoujun Zhou

List of authors in order

Landing page

https://arxiv.org/abs/1903.03896

Publisher landing page

PDF URL

https://arxiv.org/pdf/1903.03896

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/1903.03896

Direct OA link when available

Concepts

Triangulation, Point (geometry), Tracking (education), Computer vision, Artificial intelligence, Computer science, Point of interest, Mathematics, Geometry, Psychology, Pedagogy

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

References (count)

26

Number of works referenced by this work

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload