Channel Boosted CNN-Transformer-based Multi-Level and Multi-Scale Nuclei Segmentation Article Swipe

MAKE IMPACT

Zunaira Rauf , Abdul Rehman Khan , Asifullah Khan · YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2407.19186

Accurate nuclei segmentation is an essential foundation for various applications in computational pathology, including cancer diagnosis and treatment planning. Even slight variations in nuclei representations can significantly impact these downstream tasks. However, achieving accurate segmentation remains challenging due to factors like clustered nuclei, high intra-class variability in size and shape, resemblance to other cells, and color or contrast variations between nuclei and background. Despite the extensive utilization of Convolutional Neural Networks (CNNs) in medical image segmentation, they may have trouble capturing long-range dependencies crucial for accurate nuclei delineation. Transformers address this limitation but might miss essential low-level features. To overcome these limitations, we utilized CNN-Transformer-based techniques for nuclei segmentation in H&E stained histology images. In this work, we proposed two CNN-Transformer architectures, Nuclei Hybrid Vision Transformer (NucleiHVT) and Channel Boosted Nuclei Hybrid Vision Transformer (CB-NucleiHVT), that leverage the strengths of both CNNs and Transformers to effectively learn nuclei boundaries in multi-organ histology images. The first architecture, NucleiHVT is inspired by the UNet architecture and incorporates the dual attention mechanism to capture both multi-level and multi-scale context effectively. The CB-NucleiHVT network, on the other hand, utilizes the concept of channel boosting to learn diverse feature spaces, enhancing the model's ability to distinguish subtle variations in nuclei characteristics. Detailed evaluation of two medical image segmentation datasets shows that the proposed architectures outperform existing CNN-based, Transformer-based, and hybrid methods. The proposed networks demonstrated effective results both in terms of quantitative metrics, and qualitative visual assessment.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2407.19186

PDF

https://arxiv.org/pdf/2407.19186

OA Status

green

Related Works

10

OpenAlex ID

https://openalex.org/W4401201474

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4401201474

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2407.19186

Digital Object Identifier

Title

Channel Boosted CNN-Transformer-based Multi-Level and Multi-Scale Nuclei Segmentation

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2024

Year of publication

Publication date

2024-07-27

Full publication date if available

Authors

Zunaira Rauf, Abdul Rehman Khan, Asifullah Khan

List of authors in order

Landing page

https://arxiv.org/abs/2407.19186

Publisher landing page

PDF URL

https://arxiv.org/pdf/2407.19186

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2407.19186

Direct OA link when available

Concepts

Segmentation, Transformer, Computer science, Scale (ratio), Artificial intelligence, Pattern recognition (psychology), Electrical engineering, Engineering, Cartography, Geography, Voltage

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload