Recurrent Neural Networks (RNN) or Sequence Models

Abstract

In this chapter, we will explore and discuss the basic architecture of sequence models (Recurrent Neural Networks). In particular, we will

• Build and train sequence models, and a commonly used variant known as Long Short-Term Memory Models (LSTMs).

• Apply sequence models to Natural Language Processing (NLP) problems, including text synthesis.

This is the last chapter of the book and, the reader is expected to have a very good understanding of neural networks, including convolutional networks.

Machine intelligence is the last invention that humanity will ever need to make.

Nick Bostrom