Exploring foci of:
Applied Sciences • Vol 11 • No 7
Efficient Attention Mechanism for Dynamic Convolution in Lightweight Neural Network
March 2021 • Enjie Ding, Yuhao Cheng, Chengcheng Xiao, Zhongyu Liu, Wanli Yu
Light-weight convolutional neural networks (CNNs) suffer limited feature representation capabilities due to low computational budgets, resulting in degradation in performance. To make CNNs more efficient, dynamic neural networks (DyNet) have been proposed to increase the complexity of the model by using the Squeeze-and-Excitation (SE) module to adaptively obtain the importance of each convolution kernel through the attention mechanism. However, the attention mechanism in the SE network (SENet) selects all channel …
Computer Science
Convolutional Neural Network
Redundancy (Engineering)
Artificial Intelligence
Data Mining
Algorithm
Mathematics
Combinatorics
Geometry
Philosophy