Fine-Tuning BERT for Downstream Tasks

Learn about fine-tuning the pre-trained BERT model for down streaming tasks and how it differs from the pre-trained BERT model.

We'll cover the following

Let's learn how to fine-tune the pre-trained BERT model for downstream tasks. Note that fine-tuning implies that we are not training BERT from scratch; instead, we are using the pre-trained BERT and updating its weights according to our task.

Downstream tasks

We will learn how to fine-tune the pre-trained BERT model for the following downstream tasks:

  • Text classification

  • Natural language inference (NLI)

  • Named entity recognition (NER)

  • Question-answering

Get hands-on with 1400+ tech skills courses.