MaxViT-UNet: Multi-Axis Attention for Medical Image Segmentation Article Swipe

MAKE IMPACT

Abdul Rehman , Asifullah Khan · YOU? · · 2023 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2305.08396

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range interactions in CNNs. Recently, Transformers have gained popularity in the computer vision community and also in medical image segmentation due to their ability to process global features effectively. The scalability issues of the self-attention mechanism and lack of the CNN-like inductive bias may have limited their adoption. Therefore, hybrid Vision transformers (CNN-Transformer), exploiting the advantages of both Convolution and Self-attention Mechanisms, have gained importance. In this work, we present MaxViT-UNet, a new Encoder-Decoder based UNet type hybrid vision transformer (CNN-Transformer) for medical image segmentation. The proposed Hybrid Decoder is designed to harness the power of both the convolution and self-attention mechanisms at each decoding stage with a nominal memory and computational burden. The inclusion of multi-axis self-attention, within each decoder stage, significantly enhances the discriminating capacity between the object and background regions, thereby helping in improving the segmentation efficiency. In the Hybrid Decoder, a new block is also proposed. The fusion process commences by integrating the upsampled lower-level decoder features, obtained through transpose convolution, with the skip-connection features derived from the hybrid encoder. Subsequently, the fused features undergo refinement through the utilization of a multi-axis attention mechanism. The proposed decoder block is repeated multiple times to segment the nuclei regions progressively. Experimental results on MoNuSeg18 and MoNuSAC20 datasets demonstrate the effectiveness of the proposed technique.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2305.08396

PDF

https://arxiv.org/pdf/2305.08396

OA Status

green

Cited By

8

Related Works

10

OpenAlex ID

https://openalex.org/W4376653885

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4376653885

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2305.08396

Digital Object Identifier

Title

MaxViT-UNet: Multi-Axis Attention for Medical Image Segmentation

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2023

Year of publication

Publication date

2023-05-15

Full publication date if available

Authors

Abdul Rehman, Asifullah Khan

List of authors in order

Landing page

https://arxiv.org/abs/2305.08396

Publisher landing page

PDF URL

https://arxiv.org/pdf/2305.08396

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2305.08396

Direct OA link when available

Concepts

Computer science, Artificial intelligence, Segmentation, Convolutional neural network, Encoder, Image segmentation, Computer vision, Transformer, Pattern recognition (psychology), Voltage, Quantum mechanics, Operating system, Physics

Top concepts (fields/topics) attached by OpenAlex

Cited by

8

Total citation count in OpenAlex

Citations by year (recent)

2025: 2, 2024: 3, 2023: 3

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload