Semantic Segmentation of Foggy Scenes Based on Progressive Domain Gap Decoupling Article Swipe

MAKE IMPACT

Ziquan Wang , Yongsheng Zhang , XianZheng Ma , Ying Yu , Zhenchao Zhang , Zhipeng Jiang , Binbin Cheng · YOU? · · 2023 · Open Access · · DOI: https://doi.org/10.36227/techrxiv.22682161

Robust Semantic Foggy Scene Segmentation (SFSS) is crucial for the security of autonomous driving. However, the blurring of images caused by fog increases the difficulty of recognition and makes annotation of foggy scene images more expensive, resulting poor performance when recognizing entities in the fog. Currently, many methods use domain adaptation to transfer segmentation knowledge from clear scenes to foggy ones. But these method are often ineffective due to the large domain gap between different cities' styles and the quality degradation of images caused by fog. The latest research has attempted to introduce an intermediate domain to decouple the domain gap and gradually complete the semantic segmentation of foggy scenes, but the exploration of the intermediate domain information is often insufficient. To solve these problems, we first analyze the self-training in domain adaptation and propose the concept of "label reference value". We prove that the higher the total label reference value, the easier the self-training performance gets improved. With this precondition, we can reasonably split the original problem into two-stage domain adaptation. In each stage, the "label reference value" can be controlled and maximized. Specifically, the first stage only process the style gap between source domain and the intermediate domain, and the second stage process the fog gap. The fog gap includes: (1) real fog gap between the intermediate domain and target domain; (2) the synthetic fog gap between clear source domain and synthetic foggy source domain. This allows the model to make full use of "label reference value" and gradually develop good semantic segmentation skills for foggy scenes. Our approach significantly outperforms the baseline algorithm on all the mainstream SFSS benchmarks, with good generalization ability demonstrated in other adverse scenes such as rain and snow. We also compare our method with latest large segmentation models, which shows that our method has more robust performance in the foggy scenes.

Type

preprint

Language

en

Landing Page

https://doi.org/10.36227/techrxiv.22682161

OA Status

gold

Cited By

2

References

44

Related Works

10

OpenAlex ID

https://openalex.org/W4367672173

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4367672173

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.36227/techrxiv.22682161

Digital Object Identifier

Title

Semantic Segmentation of Foggy Scenes Based on Progressive Domain Gap Decoupling

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2023

Year of publication

Publication date

2023-05-02

Full publication date if available

Authors

Ziquan Wang, Yongsheng Zhang, XianZheng Ma, Ying Yu, Zhenchao Zhang, Zhipeng Jiang, Binbin Cheng

List of authors in order

Landing page

https://doi.org/10.36227/techrxiv.22682161

Publisher landing page

Open access

Yes

Whether a free full text is available

OA status

gold

Open access status per OpenAlex

OA URL

https://doi.org/10.36227/techrxiv.22682161

Direct OA link when available

Concepts

Computer science, Segmentation, Domain (mathematical analysis), Artificial intelligence, Semantic gap, Computer vision, Decoupling (probability), Process (computing), Image (mathematics), Image retrieval, Mathematics, Control engineering, Engineering, Mathematical analysis, Operating system

Top concepts (fields/topics) attached by OpenAlex

Cited by

2

Total citation count in OpenAlex

Citations by year (recent)

2024: 2

Per-year citation counts (last 5 years)

References (count)

44

Number of works referenced by this work

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload