arXiv (Cornell University)
Mitigate Replication and Copying in Diffusion Models with Generalized Caption and Dual Fusion Enhancement
September 2023 • Chenghao Li, Dake Chen, Yuke Zhang, Peter A. Beerel
While diffusion models demonstrate a remarkable capability for generating high-quality images, their tendency to `replicate' training data raises privacy concerns. Although recent research suggests that this replication may stem from the insufficient generalization of training data captions and duplication of training images, effective mitigation strategies remain elusive. To address this gap, our paper first introduces a generality score that measures the caption generality and employ large language model (LLM) t…