Shortcut

Understand how shortcuts can improve performance in large models.

Chapter Goals:

  • Learn about mapping functions and identity mapping
  • Understand the purpose of a shortcut for residual learning
  • Implement a wrapper for the pre-activation function that also returns the shortcut

Get hands-on with 1400+ tech skills courses.