D-S Augmentation: Density-Semantics Augmentation for 3-D Object Detection Article Swipe

MAKE IMPACT

Zhiqiang Liu , Peicheng Shi , Heng Qi , Aixi Yang · YOU? · · 2023 · Open Access · · DOI: https://doi.org/10.1109/jsen.2022.3231882

Cameras and light detection and ranging (LiDAR) sensors are commonly used together in autonomous vehicles to provide rich color and texture information and information on the location of objects, respectively. However, fusing image and point-cloud information remains a key challenge. In this article, we propose D-S augmentation as a 3-D object detection method based on point-cloud density and semantic augmentation. Our proposed approach first performs 2-D bounding box detection and instance segmentation on an image. Then, a LiDAR point cloud is projected onto an instance segmentation mask, and a fixed number of random points are generated. Finally, a global -nearest neighbor clustering is used to associate random and projected points to give depth to virtual points and complete point-cloud density augmentation (P-DA). Then, point-cloud semantic augmentation (P-SA) is performed, in which the instance segmentation mask of an object is used to associate it with the point cloud. The instance-segmented class labels and segmentation scores are assigned to the projected cloud, and the projection points added with 1-D features are inversely mapped to the point-cloud space to obtain a semantically augmented point cloud. We conducted extensive experiments on the nuScenes (Caesar et al., 2020) and KITTI (Geiger et al., 2012) datasets. The results demonstrate the effectiveness and efficiency of our proposed method. Notably, D-S augmentation outperformed a LiDAR-only baseline detector by +7.9% in terms of mean average precision (mAP) and +5.1% in terms of nuScenes detection score (NDS) and outperformed the state-of-the-art multimodal fusion-based methods. We also present the results of ablation studies to show that the fusion module improved the performance of a baseline detector.

Type

article

Language

en

Landing Page

https://doi.org/10.1109/jsen.2022.3231882

OA Status

hybrid

Cited By

4

References

58

Related Works

10

OpenAlex ID

https://openalex.org/W4313591774

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4313591774

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.1109/jsen.2022.3231882

Digital Object Identifier

Title

D-S Augmentation: Density-Semantics Augmentation for 3-D Object Detection

Work title

Type

article

OpenAlex work type

Language

en

Primary language

Publication year

2023

Year of publication

Publication date

2023-01-03

Full publication date if available

Authors

Zhiqiang Liu, Peicheng Shi, Heng Qi, Aixi Yang

List of authors in order

Landing page

https://doi.org/10.1109/jsen.2022.3231882

Publisher landing page

Open access

Yes

Whether a free full text is available

OA status

hybrid

Open access status per OpenAlex

OA URL

https://doi.org/10.1109/jsen.2022.3231882

Direct OA link when available

Concepts

Point cloud, Lidar, Segmentation, Artificial intelligence, Computer science, Computer vision, Object detection, Point (geometry), Cluster analysis, Projection (relational algebra), Object (grammar), Mathematics, Algorithm, Remote sensing, Geometry, Geography

Top concepts (fields/topics) attached by OpenAlex

Cited by

4

Total citation count in OpenAlex

Citations by year (recent)

2024: 3, 2023: 1

Per-year citation counts (last 5 years)

References (count)

58

Number of works referenced by this work

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload