Preprints.org
Residual Connection Learning by Contextual Modulation Training in Modern Deep Neural Networks
June 2025 • Yingtao Zhang, Wanyi Gu, Wen-Long Hu, Jianguo Li, Carlo Vittorio Cannistraci
Residual connections are a cornerstone of modern deep neural networks, facilitating stable gradient propagation and maintaining representational expressiveness. Conventional residual formulations typically combine identity mappings and functional transformations with equal weight, without considering the input-dependent importance of each component. This uniformity restricts the model’s capability to adaptively regulate information flow. We propose a novel Contextual Modulation Training (CoMT) framework that intro…