Summary: BERT Variants—Based on Knowledge Distillation
Let’s summarize what we have learned so far.
We'll cover the following...
Key highlights
Summarized below are the main highlights of what we've learned in this chapter.
We started off by learning ...