From Histopathology Images to Cell Clouds: Learning Slide Representations with Hierarchical Cell Transformer Article Swipe

MAKE IMPACT

Zijiang Yang , Zhongwei Qiu , Tiancheng Lin , Hanqing Chao , Wanxing Chang , Yelin Yang , Yunshuo Zhang , Wenpei Jiao , Yixuan Shen , Wenbin Liu , Dongmei Fu , Dakai Jin , Ke Yan , Le Lü , Hui Jiang , Yun Bian · YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2412.16715

It is clinically crucial and potentially very beneficial to be able to analyze and model directly the spatial distributions of cells in histopathology whole slide images (WSI). However, most existing WSI datasets lack cell-level annotations, owing to the extremely high cost over giga-pixel images. Thus, it remains an open question whether deep learning models can directly and effectively analyze WSIs from the semantic aspect of cell distributions. In this work, we construct a large-scale WSI dataset with more than 5 billion cell-level annotations, termed WSI-Cell5B, and a novel hierarchical Cell Cloud Transformer (CCFormer) to tackle these challenges. WSI-Cell5B is based on 6,998 WSIs of 11 cancers from The Cancer Genome Atlas Program, and all WSIs are annotated per cell by coordinates and types. To the best of our knowledge, WSI-Cell5B is the first WSI-level large-scale dataset integrating cell-level annotations. On the other hand, CCFormer formulates the collection of cells in each WSI as a cell cloud and models cell spatial distribution. Specifically, Neighboring Information Embedding (NIE) is proposed to characterize the distribution of cells within the neighborhood of each cell, and a novel Hierarchical Spatial Perception (HSP) module is proposed to learn the spatial relationship among cells in a bottom-up manner. The clinical analysis indicates that WSI-Cell5B can be used to design clinical evaluation metrics based on counting cells that effectively assess the survival risk of patients. Extensive experiments on survival prediction and cancer staging show that learning from cell spatial distribution alone can already achieve state-of-the-art (SOTA) performance, i.e., CCFormer strongly outperforms other competing methods.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2412.16715

PDF

https://arxiv.org/pdf/2412.16715

OA Status

green

Related Works

10

OpenAlex ID

https://openalex.org/W4405766380

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4405766380

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2412.16715

Digital Object Identifier

Title

From Histopathology Images to Cell Clouds: Learning Slide Representations with Hierarchical Cell Transformer

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2024

Year of publication

Publication date

2024-12-21

Full publication date if available

Authors

Zijiang Yang, Zhongwei Qiu, Tiancheng Lin, Hanqing Chao, Wanxing Chang, Yelin Yang, Yunshuo Zhang, Wenpei Jiao, Yixuan Shen, Wenbin Liu, Dongmei Fu, Dakai Jin, Ke Yan, Le Lü, Hui Jiang, Yun Bian

List of authors in order

Landing page

https://arxiv.org/abs/2412.16715

Publisher landing page

PDF URL

https://arxiv.org/pdf/2412.16715

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2412.16715

Direct OA link when available

Concepts

Histopathology, Transformer, Computer science, Artificial intelligence, Engineering, Pathology, Medicine, Electrical engineering, Voltage

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload