MTP: Exploring Multimodal Urban Traffic Profiling with Modality Augmentation and Spectrum Fusion Article Swipe

MAKE IMPACT

Haolong Xiang , Xiaolong Xu , Xuyun Zhang , Quan Z. Sheng , Amin Beheshti , Wei Fan · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2511.10218

With rapid urbanization in the modern era, traffic signals from various sensors have been playing a significant role in monitoring the states of cities, which provides a strong foundation in ensuring safe travel, reducing traffic congestion and optimizing urban mobility. Most existing methods for traffic signal modeling often rely on the original data modality, i.e., numerical direct readings from the sensors in cities. However, this unimodal approach overlooks the semantic information existing in multimodal heterogeneous urban data in different perspectives, which hinders a comprehensive understanding of traffic signals and limits the accurate prediction of complex traffic dynamics. To address this problem, we propose a novel Multimodal framework, MTP, for urban Traffic Profiling, which learns multimodal features through numeric, visual, and textual perspectives. The three branches drive for a multimodal perspective of urban traffic signal learning in the frequency domain, while the frequency learning strategies delicately refine the information for extraction. Specifically, we first conduct the visual augmentation for the traffic signals, which transforms the original modality into frequency images and periodicity images for visual learning. Also, we augment descriptive texts for the traffic signals based on the specific topic, background information and item description for textual learning. To complement the numeric information, we utilize frequency multilayer perceptrons for learning on the original modality. We design a hierarchical contrastive learning on the three branches to fuse the spectrum of three modalities. Finally, extensive experiments on six real-world datasets demonstrate superior performance compared with the state-of-the-art approaches.

Type

preprint

Landing Page

http://arxiv.org/abs/2511.10218

PDF

https://arxiv.org/pdf/2511.10218

OA Status

green

OpenAlex ID

https://openalex.org/W4416358455

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4416358455

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2511.10218

Digital Object Identifier

Title

MTP: Exploring Multimodal Urban Traffic Profiling with Modality Augmentation and Spectrum Fusion

Work title

Type

preprint

OpenAlex work type

Publication year

2025

Year of publication

Publication date

2025-11-13

Full publication date if available

Authors

Haolong Xiang, Xiaolong Xu, Xuyun Zhang, Quan Z. Sheng, Amin Beheshti, Wei Fan

List of authors in order

Landing page

https://arxiv.org/abs/2511.10218

Publisher landing page

PDF URL

https://arxiv.org/pdf/2511.10218

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2511.10218

Direct OA link when available

Cited by

0

Total citation count in OpenAlex

Full payload