VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributes Article Swipe

MAKE IMPACT

Simon C.H. Yu , Philip L. H. Yu , Hongbo Zheng , Huajie Shao , Han Zhao , Lui Sha · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2510.26833

We present VISAT, a novel open dataset and benchmarking suite for evaluating model robustness in the task of traffic sign recognition with the presence of visual attributes. Built upon the Mapillary Traffic Sign Dataset (MTSD), our dataset introduces two benchmarks that respectively emphasize robustness against adversarial attacks and distribution shifts. For our adversarial attack benchmark, we employ the state-of-the-art Projected Gradient Descent (PGD) method to generate adversarial inputs and evaluate their impact on popular models. Additionally, we investigate the effect of adversarial attacks on attribute-specific multi-task learning (MTL) networks, revealing spurious correlations among MTL tasks. The MTL networks leverage visual attributes (color, shape, symbol, and text) that we have created for each traffic sign in our dataset. For our distribution shift benchmark, we utilize ImageNet-C's realistic data corruption and natural variation techniques to perform evaluations on the robustness of both base and MTL models. Moreover, we further explore spurious correlations among MTL tasks through synthetic alterations of traffic sign colors using color quantization techniques. Our experiments focus on two major backbones, ResNet-152 and ViT-B/32, and compare the performance between base and MTL models. The VISAT dataset and benchmarking framework contribute to the understanding of model robustness for traffic sign recognition, shedding light on the challenges posed by adversarial attacks and distribution shifts. We believe this work will facilitate advancements in developing more robust models for real-world applications in autonomous driving and cyber-physical systems.

Type

preprint

Landing Page

http://arxiv.org/abs/2510.26833

PDF

https://arxiv.org/pdf/2510.26833

OA Status

green

OpenAlex ID

https://openalex.org/W4415910178

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4415910178

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2510.26833

Digital Object Identifier

Title

VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributes

Work title

Type

preprint

OpenAlex work type

Publication year

2025

Year of publication

Publication date

2025-10-29

Full publication date if available

Authors

Simon C.H. Yu, Philip L. H. Yu, Hongbo Zheng, Huajie Shao, Han Zhao, Lui Sha

List of authors in order

Landing page

https://arxiv.org/abs/2510.26833

Publisher landing page

PDF URL

https://arxiv.org/pdf/2510.26833

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2510.26833

Direct OA link when available

Cited by

0

Total citation count in OpenAlex

Full payload