Journal of Jishou University(Natural Sciences Edition) ›› 2021, Vol. 42 ›› Issue (1): 41-48.DOI: 10.13438/j.cnki.jdzk.2021.01.007

• Computer and Electronics • Previous Articles     Next Articles

Research Review of Recurrent Neural Networks

WANG Yuyan, LIAO Bolin, PENG Chen, LI Jun, YIN Yumin   

  1. (1. College of Mathematics and Statistics, Jishou University, Jishou 416000, Hunan China; 2. College of Information Science and Engineering, Jishou University, Jishou 416000, Hunan China)
  • Online:2021-01-25 Published:2021-02-05

Abstract: Recurrent neural network (RNN) is a kind of neural network with feedback connection in each layer. Because of its storage characteristics, it can process the sequence data which is related before and after input, and can be widely used in the field of text audio, video and so on. But when the input gap is large, RNN has a short-term memory problem, which can not process long input sequences, while long short-term memory (LSTM) can deal with the long-term dependence problem well. Almost all the exciting results based on RNNs have been realized by LSTM since LSTM was proposed, so LSTM has become the focus of deep learning. This review firstly introduces the basic working principle and characteristics of RNN, and then it introduces the principle and characteristics of LSTM and its variants, as well as  the application of RNN and LSTM in various fields. Finally, the future research direction of RNN is proposed.

Key words: recurrent neural network, long short-term memory, sequential data, natural language processing

WeChat e-book chaoxing Mobile QQ