Keywords
InterpretabilityComputer scienceMechanism (biology)Artificial intelligenceDeep learningRepresentation (politics)Focus (optics)Field (mathematics)Machine learningFeature (linguistics)Deep neural networksCognitive sciencePsychology
Affiliated Institutions
Related Publications
Representation Learning: A Review and New Perspectives
The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more...
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so. We study whether...
Object Detection With Deep Learning: A Review
Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection ...
Going deeper with convolutions
We propose a deep convolutional neural network architecture codenamed Inception that achieves the new state of the art for classification and detection in the ImageNet Large-Sca...
Coordinate Attention for Efficient Mobile Network Design
Recent studies on mobile network design have demonstrated the remarkable effectiveness of channel attention (e.g., the Squeeze-and-Excitation attention) for lifting model perfor...
Publication Info
- Year
- 2021
- Type
- review
- Volume
- 452
- Pages
- 48-62
- Citations
- 2816
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
2816
OpenAlex
Cite This
Zhaoyang Niu,
Guoqiang Zhong,
Hui Yu
(2021).
A review on the attention mechanism of deep learning.
Neurocomputing
, 452
, 48-62.
https://doi.org/10.1016/j.neucom.2021.03.091
Identifiers
- DOI
- 10.1016/j.neucom.2021.03.091