Lecture 6 - Recurrent Neural Networks for NLP

Teacher: Eleni Metheniti (ANITI)

Contents

• What is a Neural Network?
• Recurrent Neural Networks
• Introduction to RNNs
  • RNNs & NLP
  • Long Short-Term Memory NNs
• Encoder-Decoder architecture
• Attention Mechanism
• Practical session: RNNs & LSTMs for text generation

Slides

Download the slides here

Notebook

Access the Colab notebook here

Prerequisites:

Knowledge about neural networks principles; knowledge of several NN layer types; gradient descent & backpropagation; basics of NLP

Further reading:

See Slide 107

---

(Back to Main Page)