Pre-activation

Learn why batch normalization and pre-activation are important in ResNet.

Chapter Goals:

  • Learn about internal covariate shift and batch normalization
  • Understand the difference between pre-activation and post-activation
  • Implement the pre-activation function

Get hands-on with 1400+ tech skills courses.