Keywords
Training (meteorology)Computer scienceArtificial neural networkGradient descentInefficiencyLine (geometry)Convergence (economics)Artificial intelligenceMachine learningBackpropagationAlgorithmMathematics
Affiliated Institutions
Related Publications
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Training Deep Neural Networks is complicated by the fact that the distribution of each layer's inputs changes during training, as the parameters of the previous layers change. T...
Highway Networks
There is plenty of theoretical and empirical evidence that depth of neural networks is a crucial ingredient for their success. However, network training becomes more difficult w...
Training Very Deep Networks
Theoretical and empirical evidence indicates that the depth of neural networks is crucial for their success. However, training becomes more difficult as depth increases, and tra...
Generalization of Back propagation to Recurrent and Higher Order Neural Networks
A general method for deriving backpropagation algorithms for networks with recurrent and higher order networks is introduced. The propagation of activation in these networks is ...
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so. We study whether...
Publication Info
- Year
- 2003
- Type
- article
- Volume
- 16
- Issue
- 10
- Pages
- 1429-1451
- Citations
- 413
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
413
OpenAlex
Cite This
D.R. Wilson,
Tony Martinez
(2003).
The general inefficiency of batch training for gradient descent learning.
Neural Networks
, 16
(10)
, 1429-1451.
https://doi.org/10.1016/s0893-6080(03)00138-2
Identifiers
- DOI
- 10.1016/s0893-6080(03)00138-2