
Describe lstm variants where gates use the current input, previous memory, and previous outputs to update the cell state, including a coupled forget-input approach that uses the opposite gate value.
Process the dataset by parsing each line into a dictionary of fields: line id, character id, movie id, character, and text, and build a line dictionary keyed by line id.
Prepare preprocessed sentences by converting them to word indices via the vocabulary, pad to a maximum length of 10 with zeros, include end-of-sentence tokens, and transpose for batched processing.
Define a binary matrix converting token indices from vocabulary into a ones and zeros matrix, marking the back token as zero, then prepare input tensors, masks, and lengths with torch.
In this course, you'll learn the following:
RNNs and LSTMs
Sequence Modeling
PyTorch
Building a Chatbot in PyTorch
We will first cover the theoretical concepts you need to know for building a Chatbot, which include RNNs, LSTMS and Sequence Models with Attention.
Then we will introduce you to PyTorch, a very powerful and advanced deep learning Library. We will show you how to install it and how to work with it and with PyTorch Tensors.
Then we will build our Chatbot in PyTorch!
Please Note an important thing: If you don't have prior knowledge on Neural Networks and how they work, you won't be able to cope well with this course. Please note that this is not a Deep Learning course, it's an Application of Deep Learning, as the course names implies (Applied Deep Learning: Build a Chatbot). The course level is Intermediate, and not Beginner. So please familiarize yourself with Neural Networks and it's concepts before taking this course. If you are already familiar, then your ready to start this journey!