A review on the long short-term memory model

Keywords

Computer scienceRecurrent neural networkLong short term memoryArtificial intelligenceTerm (time)Code (set theory)Artificial neural networkDeep learningMachine learningDeep neural networksProgramming language

Affiliated Institutions

Related Publications

A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures

Yong Yu , Xiaosheng Si , Changhua Hu +1 more

Recurrent neural networks (RNNs) have been widely adopted in research areas concerned with sequential data, such as text, audio, and video. However, RNNs consisting of sigma cel...

2019 Neural Computation 4793 citations

Training Very Deep Networks

Rupesh K. Srivastava , Klaus Greff , Jürgen Schmidhuber

Theoretical and empirical evidence indicates that the depth of neural networks is crucial for their success. However, training becomes more difficult as depth increases, and tra...

2015 arXiv (Cornell University) 1100 citations

Long Short-Term Memory

Sepp Hochreiter , Jürgen Schmidhuber

Learning to store information over extended time intervals by recurrent backpropagation takes a very long time, mostly because of insufficient, decaying error backflow. We brief...

1997 Neural Computation 90535 citations

ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations

Zhenzhong Lan , Mingda Chen , Sebastian Goodman +3 more

Increasing model size when pretraining natural language representations often\nresults in improved performance on downstream tasks. However, at some point\nfurther model increas...

2019 arXiv (Cornell University) 4051 citations

Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting

Haoyi Zhou , Shanghang Zhang , Jieqi Peng +4 more

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands ...

2021 Proceedings of the AAAI Conference on... 4749 citations

Publication Info

Year: 2020
Type: review
Volume: 53
Issue: 8
Pages: 5929-5955
Citations: 1654
Access: Closed

External Links

Download PDF (Free) View on DOI.org Semantic Scholar

Social Impact

Altmetric

A review on the long short-term memory model

PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

1654

OpenAlex

Influential

Cite This

APA Style

                            
                                    Greg Van Houdt, 
                                
                                    Carlos Mosquera, 
                                
                                    Gonzalo Nápoles
                                
                            (2020). 
                            A review on the long short-term memory model. 
                            Artificial Intelligence Review
                            , 53
                            (8)
                            , 5929-5955.
                            https://doi.org/10.1007/s10462-020-09838-1

Identifiers

DOI: 10.1007/s10462-020-09838-1

Data Quality

Data completeness: 68%