0% completed

All LessonsFree Lessons (4)

Introduction to Natural Language Processing

Introduction: Natural Language Processing What Is Natural Language Processing?Tasks of Natural Language Processing The Traditional Approach to Natural Language Processing The Deep Learning Approach to Natural Language Processing Summary: Introduction to Natural Language Processing

Understanding TensorFlow 2

Introduction: Understanding TensorFlow 2 What Is TensorFlow 2?TensorFlow 2 Architecture: Building and Executing Graphs Café Le TensorFlow 2: Understanding TensorFlow 2 with an Analogy Flashback: TensorFlow 1 Defining Inputs in TensorFlow Building a Data Pipeline Using the tf.data API Defining Variables and Output in TensorFlow Defining Operations in TensorFlow Neural Network-Related Operations Keras: TensorFlow's Model-Building API Implementing Our First Neural Network Summary: Understanding TensorFlow 2 Quiz: Understanding TensorFlow 2

Word2vec: Learning Word Embeddings

Introduction of Word2vec: Learning Word Embeddings Classical Approaches to Learning Word Representations An Intuitive Understanding of Word2vec The Skip-Gram Algorithm Data Generators in the Skip-Gram Algorithm with TensorFlow Implementing the Skip-Gram Architecture with TensorFlow Training and Evaluating the Skip-Gram Model The Continuous Bag-of-Words Algorithm Summary of Word2vec: Learning Word Embeddings Quiz of Word2vec: Learning Word Embeddings

Advanced Word Vector Algorithms

Introduction: Advanced Word Vector Algorithms GloVe: Global Vectors Representation Implementing GloVe Generating Data for GloVe Training and Evaluating GloVe ELMo: Taking Ambiguities Out of Word Vectors Preparing Inputs for ELMo Generating Embeddings with ELMo Dataset in Document Classification with ELMo Generating Document Embeddings Classifying Documents with Document Embeddings Summary: Advanced Word Vector Algorithms Quiz: Advanced Word Vector Algorithms

Sentence Classification with Convolutional Neural Networks

Introduction: Sentence Classification with CNNs Introducing CNNs Understanding CNNs: Convolution Operations Understanding CNNs: Pooling Operations Understanding CNNs: Fully Connected Layers Exercise: Image Classification on Fashion-MNIST with CNN CNNs for Sentence Classification: Transformation of Data CNNs for Sentence Classification: Downloading and Preparing Data CNNs for Sentence Classification: Building a Tokenizer The Sentence Classification CNN Model Sentence Classification with CNNs Summary: Sentence Classification with CNNs Quiz: Sentence Classification with CNNs

Recurrent Neural Networks

Introduction: Recurrent Neural Networks Understanding RNNs Backpropagation through Time Applications of RNNs Named Entity Recognition with RNNs: Preparing Data Named Entity Recognition with RNNs: Defining the Model Named Entity Recognition with RNNs: Training and Evaluation NER with Character and Token Embeddings Summary: Recurrent Neural Networks Quiz: Recurrent Neural Networks

Understanding Long Short-Term Memory Networks

Introduction: Understanding Long Short-Term Memory Networks Understanding Long Short-Term Memory Networks How LSTMs Solve the Vanishing Gradient Problem Improving LSTMs Other Variants of LSTMs Summary: Understanding Long Short-Term Memory Networks Quiz: Understanding Long Short-Term Memory Networks

Applications of LSTM: Generating Text

Introduction: Applications of LSTMs—Generating Text Understanding the Data Implementing the Language Model Generating New Text with the Model Comparing LSTMs to LSTMs with Peephole Connections and GRUs Improving Sequential Models: Beam Search Improving LSTMs: Generating Text with Words Instead of N-grams Summary: Applications of LSTMs—Generating Text Quiz: Applications of LSTMs—Generating Text

Sequence-to-Sequence Learning: Neural Machine Translation

Introduction: Sequence-to-Sequence Learning—NMT Machine Translation Understanding Neural Machine Translation Preparing Data for the NMT System Defining the NMT Model Attention: Analyzing, Computing, and Implementing Training the NMT The BLEU Score: Evaluating Machine Translation Systems Visualizing Attention Patterns Inference with NMT Other Applications of Seq2Seq Models: Chatbots Summary: Sequence-to-Sequence Learning—NMT Quiz: Sequence-to-Sequence Learning—NMT

Transformers

Introduction: Transformers

Transformer Architecture: Encoder, Decoder, and Computing Output

Transformer Architecture: Embedding Layers

Transformer Architecture: Residuals and Normalization

Understanding BERT

Use Case: Using BERT to Answer Questions

Use Case: Implementing BERT

Training and Evaluating Model and Answering Questions with BERT

Summary: Transformers

Quiz: Transformers

Project

Sarcasm Classification Using BERT

Image Captioning with Transformers

Introduction: Image Captioning with Transformers Getting to Know the Data Processing and Tokenizing Data Defining a tf.data.Dataset The Machine Learning Pipeline for Image Caption Generation Implementing and Training the Model with TensorFlow Evaluating the Results Quantitatively Evaluating the Model and Generating Captions from It Summary: Image Captioning with Transformers Quiz: Image Captioning with Transformers

Project

Caption Generation Using PyTorch

Final Remarks

Appendix: Mathematical Foundations and Advanced TensorFlow

Introduction to the Technical Tools Basic Data Structures Special Types of Matrices Probability Visualizing Word Embeddings with TensorBoard Summary: Appendix

Natural Language Processing with TensorFlow/

...

/

Introduction: Transformers

Introduction: Transformers

Get an overview of the transformers model.

We'll cover the following...

Chapter overview

Transformer models changed the playing field for most machine learning problems that involve sequential data. They have advanced the state of the art by a significant margin compared to the previous leaders, RNN-based models. One of the primary reasons ...