Recurrent Neural Networks #
- Raw Text into Sequence Data
- Recurrent connection
- Recurrent Neural Networks with Hidden States
- Backpropagation Through Time
- RNNs for NLP tasks
- Encoder–Decoder Architecture
- Teacher Forcing
- Loss Function with Masking
- Training and Prediction
Reference #
- Dive into deep learning. Cambridge University Press.. (T1 – Ch 9)
- R4 – Ch 9
- R3 – Ch 2.2.10