Positional Encoding
Understand the working of transformers by adding a positional encoding value to the input embedding.
We'll cover the following
The designers of the transformer came up with yet another innovative feature: positional encoding. Let's see how it works.
Structure
We enter this positional encoding function of the transformer with no idea of the position of a word in a sequence:
Get hands-on with 1200+ tech skills courses.