Back To Course Home

Natural Language Processing with TensorFlow

0% completed

Introduction to Natural Language Processing

Introduction: Natural Language Processing What Is Natural Language Processing?Tasks of Natural Language Processing The Traditional Approach to Natural Language Processing The Deep Learning Approach to Natural Language Processing Summary: Introduction to Natural Language Processing

Understanding TensorFlow 2

Introduction: Understanding TensorFlow 2 What Is TensorFlow 2?TensorFlow 2 Architecture: Building and Executing Graphs Café Le TensorFlow 2: Understanding TensorFlow 2 with an Analogy Flashback: TensorFlow 1 Defining Inputs in TensorFlow Building a Data Pipeline Using the tf.data API Defining Variables and Output in TensorFlow Defining Operations in TensorFlow Neural Network-Related Operations Keras: TensorFlow's Model-Building API Implementing Our First Neural Network Summary: Understanding TensorFlow 2 Quiz: Understanding TensorFlow 2

Word2vec: Learning Word Embeddings

Introduction of Word2vec: Learning Word Embeddings Classical Approaches to Learning Word Representations An Intuitive Understanding of Word2vec The Skip-Gram Algorithm Data Generators in the Skip-Gram Algorithm with TensorFlow Implementing the Skip-Gram Architecture with TensorFlow Training and Evaluating the Skip-Gram Model The Continuous Bag-of-Words Algorithm Summary of Word2vec: Learning Word Embeddings Quiz of Word2vec: Learning Word Embeddings

Advanced Word Vector Algorithms

Introduction: Advanced Word Vector Algorithms GloVe: Global Vectors Representation Implementing GloVe Generating Data for GloVe Training and Evaluating GloVe ELMo: Taking Ambiguities Out of Word Vectors Preparing Inputs for ELMo Generating Embeddings with ELMo Dataset in Document Classification with ELMo Generating Document Embeddings Classifying Documents with Document Embeddings Summary: Advanced Word Vector Algorithms Quiz: Advanced Word Vector Algorithms

Sentence Classification with Convolutional Neural Networks

Introduction: Sentence Classification with CNNs

Introducing CNNs

Understanding CNNs: Convolution Operations

Understanding CNNs: Pooling Operations

Understanding CNNs: Fully Connected Layers

Exercise: Image Classification on Fashion-MNIST with CNN

CNNs for Sentence Classification: Transformation of Data

CNNs for Sentence Classification: Downloading and Preparing Data

CNNs for Sentence Classification: Building a Tokenizer

The Sentence Classification CNN Model

Sentence Classification with CNNs

Summary: Sentence Classification with CNNs

Quiz: Sentence Classification with CNNs

Recurrent Neural Networks

Introduction: Recurrent Neural Networks Understanding RNNs Backpropagation through Time Applications of RNNs Named Entity Recognition with RNNs: Preparing Data Named Entity Recognition with RNNs: Defining the Model Named Entity Recognition with RNNs: Training and Evaluation NER with Character and Token Embeddings Summary: Recurrent Neural Networks Quiz: Recurrent Neural Networks

Understanding Long Short-Term Memory Networks

Introduction: Understanding Long Short-Term Memory Networks Understanding Long Short-Term Memory Networks How LSTMs Solve the Vanishing Gradient Problem Improving LSTMs Other Variants of LSTMs Summary: Understanding Long Short-Term Memory Networks Quiz: Understanding Long Short-Term Memory Networks

Applications of LSTM: Generating Text

Introduction: Applications of LSTMs—Generating Text Understanding the Data Implementing the Language Model Generating New Text with the Model Comparing LSTMs to LSTMs with Peephole Connections and GRUs Improving Sequential Models: Beam Search Improving LSTMs: Generating Text with Words Instead of N-grams Summary: Applications of LSTMs—Generating Text Quiz: Applications of LSTMs—Generating Text

Sequence-to-Sequence Learning: Neural Machine Translation

Introduction: Sequence-to-Sequence Learning—NMT Machine Translation Understanding Neural Machine Translation Preparing Data for the NMT System Defining the NMT Model Attention: Analyzing, Computing, and Implementing Training the NMT The BLEU Score: Evaluating Machine Translation Systems Visualizing Attention Patterns Inference with NMT Other Applications of Seq2Seq Models: Chatbots Summary: Sequence-to-Sequence Learning—NMT Quiz: Sequence-to-Sequence Learning—NMT

Transformers

Introduction: Transformers Transformer Architecture: Encoder, Decoder, and Computing Output Transformer Architecture: Embedding Layers Transformer Architecture: Residuals and Normalization Understanding BERT Use Case: Using BERT to Answer Questions Use Case: Implementing BERT Training and Evaluating Model and Answering Questions with BERT Summary: Transformers Quiz: Transformers

Image Captioning with Transformers

Introduction: Image Captioning with Transformers Getting to Know the Data Processing and Tokenizing Data Defining a tf.data.Dataset The Machine Learning Pipeline for Image Caption Generation Implementing and Training the Model with TensorFlow Evaluating the Results Quantitatively Evaluating the Model and Generating Captions from It Summary: Image Captioning with Transformers Quiz: Image Captioning with Transformers

Final Remarks

Appendix: Mathematical Foundations and Advanced TensorFlow

Introduction to the Technical Tools Basic Data Structures Special Types of Matrices Probability Visualizing Word Embeddings with TensorBoard Summary: Appendix

Summary: Sentence Classification with CNNs

Review what we've learned in this chapter.

We'll cover the following

CNNs and their applications
CNN with NLP tasks

CNNs and their applications

In this chapter, we discussed CNNs and their various applications. First, we went through a detailed explanation of what CNNs are and their ability to excel at machine learning tasks. Next, we decomposed the CNN into several components, such as convolution and pooling layers, and discussed in detail how these operators work. Furthermore, we discussed several hyperparameters that are related to these operators, such as filter size, stride, and padding.

Get hands-on with 1200+ tech skills courses.