Learning Identifiable Structures Helps Avoid Bias in DNN-based Supervised Causal Learning Article Swipe

MAKE IMPACT

Jiaru Zhang , Rui Ding , Qiang Fu , Huang Bojun , Zizhen Deng , Hua Yang , Haibing Guan , Shi Han , Dongmei Zhang · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2502.10883

Causal discovery is a structured prediction task that aims to predict causal relations among variables based on their data samples. Supervised Causal Learning (SCL) is an emerging paradigm in this field. Existing Deep Neural Network (DNN)-based methods commonly adopt the "Node-Edge approach", in which the model first computes an embedding vector for each variable-node, then uses these variable-wise representations to concurrently and independently predict for each directed causal-edge. In this paper, we first show that this architecture has some systematic bias that cannot be mitigated regardless of model size and data size. We then propose SiCL, a DNN-based SCL method that predicts a skeleton matrix together with a v-tensor (a third-order tensor representing the v-structures). According to the Markov Equivalence Class (MEC) theory, both the skeleton and the v-structures are identifiable causal structures under the canonical MEC setting, so predictions about skeleton and v-structures do not suffer from the identifiability limit in causal discovery, thus SiCL can avoid the systematic bias in Node-Edge architecture, and enable consistent estimators for causal discovery. Moreover, SiCL is also equipped with a specially designed pairwise encoder module with a unidirectional attention layer to model both internal and external relationships of pairs of nodes. Experimental results on both synthetic and real-world benchmarks show that SiCL significantly outperforms other DNN-based SCL approaches.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2502.10883

PDF

https://arxiv.org/pdf/2502.10883

OA Status

green

Related Works

10

OpenAlex ID

https://openalex.org/W4407686259

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4407686259

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2502.10883

Digital Object Identifier

Title

Learning Identifiable Structures Helps Avoid Bias in DNN-based Supervised Causal Learning

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2025

Year of publication

Publication date

2025-02-15

Full publication date if available

Authors

Jiaru Zhang, Rui Ding, Qiang Fu, Huang Bojun, Zizhen Deng, Hua Yang, Haibing Guan, Shi Han, Dongmei Zhang

List of authors in order

Landing page

https://arxiv.org/abs/2502.10883

Publisher landing page

PDF URL

https://arxiv.org/pdf/2502.10883

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2502.10883

Direct OA link when available

Concepts

Computer science, Artificial intelligence, Cognitive psychology, Machine learning, Psychology

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload