Shortcut
Understand how shortcuts can improve performance in large models.
Chapter Goals:
- Learn about mapping functions and identity mapping
- Understand the purpose of a shortcut for residual learning
- Implement a wrapper for the pre-activation function that also returns the shortcut
Get hands-on with 1400+ tech skills courses.