Next Sentence Prediction
Learn how to pre-train the BERT model for the next sentence prediction task.
What is NSP task?
Next sentence prediction (NSP) is another interesting strategy used for training the BERT model. NSP is a binary classification task. In the NSP task, we feed two sentences to BERT and it has to predict whether the second sentence is the follow-up (next sentence) of the first sentence. Let's understand the NSP task with the help of an example.
The isNext
label
Consider the following two sentences:
Get hands-on with 1400+ tech skills courses.