Overcoming Dimensional Factorization Limits in Discrete Diffusion Models through Quantum Joint Distribution Learning Article Swipe

MAKE IMPACT

Chuangtao Chen , Qinglin Zhao , MengChu Zhou , Dusit Niyato , Zhimin He , Haozhen Situ · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2505.05151

Discrete diffusion models represent a significant advance in generative modeling, demonstrating remarkable success in synthesizing complex, high-quality discrete data. However, to avoid exponential computational costs, they typically rely on calculating per-dimension transition probabilities when learning high-dimensional distributions. In this study, we rigorously prove that this approach leads to a worst-case linear scaling of Kullback-Leibler (KL) divergence with data dimension. To address this, we propose a Quantum Discrete Denoising Diffusion Probabilistic Model (QD3PM), which enables joint probability learning through diffusion and denoising in exponentially large Hilbert spaces, offering a theoretical pathway to faithfully capture the true joint distribution. By deriving posterior states through quantum Bayes' theorem, similar to the crucial role of posterior probabilities in classical diffusion models, and by learning the joint probability, we establish a solid theoretical foundation for quantum-enhanced diffusion models. For denoising, we design a quantum circuit that utilizes temporal information for parameter sharing and incorporates learnable classical-data-controlled rotations for encoding. Exploiting joint distribution learning, our approach enables single-step sampling from pure noise, eliminating iterative requirements of existing models. Simulations demonstrate the proposed model's superior accuracy in modeling complex distributions compared to factorization methods. Hence, this paper establishes a new theoretical paradigm in generative models by leveraging the quantum advantage in joint distribution learning.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2505.05151

PDF

https://arxiv.org/pdf/2505.05151

OA Status

green

OpenAlex ID

https://openalex.org/W4416098311

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4416098311

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2505.05151

Digital Object Identifier

Title

Overcoming Dimensional Factorization Limits in Discrete Diffusion Models through Quantum Joint Distribution Learning

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2025

Year of publication

Publication date

2025-05-08

Full publication date if available

Authors

Chuangtao Chen, Qinglin Zhao, MengChu Zhou, Dusit Niyato, Zhimin He, Haozhen Situ

List of authors in order

Landing page

https://arxiv.org/abs/2505.05151

Publisher landing page

PDF URL

https://arxiv.org/pdf/2505.05151

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2505.05151

Direct OA link when available

Cited by

0

Total citation count in OpenAlex

Full payload