Understanding the Encoder of the Transformer

Learn about the high-level structure and components of the encoder of the transformer.

We'll cover the following

The transformer consists of a stack of NN number of encoders. The output of one encoder is sent as input to the encoder above it. As shown in the following figure, we have a stack of NN number of encoders. Each encoder sends its output to the encoder above it. The final encoder returns the representation of the given source sentence as output. We feed the source sentence as input to the encoder and get the representation of the source sentence as output:

Get hands-on with 1400+ tech skills courses.