...

/

Embedding Layer: Word Representation

Embedding Layer: Word Representation

In this lesson, we are going to learn about embedding layers.

Problem with previous word representations

We already saw that one simple way to create a numeric representation of the text is to create a vocabulary of our dataset and assign a number to each word. However, this has one major problem: there will be too many sparse vectors. This means that, after padding, we could have many vectors that will contain almost more than half of the values as 0s.

Therefore, we will ...