AITtrack: Attention-Based Image-Text Alignment for Visual Tracking Article Swipe

MAKE IMPACT

Basit Alawode , Sajid Javed · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.1109/access.2025.3555816

Vision-Language Models (VLMs) have recently advanced the Visual Object Tracking (VOT) performance. In VLMs, a vision encoder is employed to obtain visual representation, and a text encoder is employed to estimate the textual embeddings using natural language descriptions. By aligning the visual and textual representations, the VLMs achieve robust performance in complex and diverse tracking scenarios, efficiently handling dynamic target appearances such as motion blur, occlusion, fast motion, and similar object distractors. However, the input textual description in many existing VLM-based trackers incorporates class and semantics details without any contextual information. This is addressed in some recent VLM-based State Of The Art (SOTA) trackers by implicitly predicting some important attributes of the target object and encoding them as textual descriptions within the tracking paradigm. However, the SOTA methods neglect the contextual relationship among the predicted attributes. In this work, we propose an Attention-based Image-Text alignment Tracker (AITrack) for robust VOT tasks. AITrack simplifies the process of VLM-based tracking using attention-based visual and textual alignment modules. AITrack utilizes a region-of-interest (ROI) text-guided encoder that leverages existing pre-trained language models to implicitly extract and encode textual features and a simple image encoder to encode visual features. A simple alignment module is implemented to combine both encoded visual and textual features, thereby inherently exposing the semantic relationship between the template and search frames with their surroundings, providing rich encodings for improved tracking performance. We employ a simple decoder that takes past predictions as spatiotemporal clues to effectively model the target appearance changes without the need for complex customized post-processings and prediction heads. Extensive experiments are performed on six publicly available VOT benchmark datasets demonstrating the strong capabilities of our AITtrack by gaining an average success rate of 2.0%. Our code will be publicly available on: https://github.com/BasitAlawode/AITrack.

Type

article

Language

en

Landing Page

https://doi.org/10.1109/access.2025.3555816

OA Status

gold

Cited By

1

References

107

Related Works

10

OpenAlex ID

https://openalex.org/W4408941374

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4408941374

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.1109/access.2025.3555816

Digital Object Identifier

Title

AITtrack: Attention-Based Image-Text Alignment for Visual Tracking

Work title

Type

article

OpenAlex work type

Language

en

Primary language

Publication year

2025

Year of publication

Publication date

2025-01-01

Full publication date if available

Authors

Basit Alawode, Sajid Javed

List of authors in order

Landing page

https://doi.org/10.1109/access.2025.3555816

Publisher landing page

Open access

Yes

Whether a free full text is available

OA status

gold

Open access status per OpenAlex

OA URL

https://doi.org/10.1109/access.2025.3555816

Direct OA link when available

Concepts

Computer science, Computer vision, Artificial intelligence, Eye tracking, Tracking (education), Image (mathematics), Pedagogy, Psychology

Top concepts (fields/topics) attached by OpenAlex

Cited by

1

Total citation count in OpenAlex

Citations by year (recent)

2025: 1

Per-year citation counts (last 5 years)

References (count)

107

Number of works referenced by this work

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload