Exercise: A Primer on Transformers

Complete this hands-on exercise to test your knowledge of the components of the encoders.

We'll cover the following

Task

Say we have a transformer with 2 encoders. Assuming that we are expanding the components of encoder 2, rearrange the cards to generate the encoder representation of the input sentence:

Get hands-on with 1400+ tech skills courses.