Playground (Keeping it simple)

Apply regularization techniques to improve neural network performance.

We'll cover the following...

Revision

Before we move on, let’s practice the code for a little while. That’s optional, but it’s a good way to revise these concepts.

Go through all the codes which we have covered in this chapter by launching the below app:

Please login to launch live app!

Hands on

In this chapter, we applied L1 regularization to reduce overfitting on our four-layers neural network. Now it’s up to us to try a few other regularization techniques.

  • How does early stopping work on this network?
  • What about removing a few nodes from each layer?

Try out those techniques, and keep an eye on the accuracy of the validation set. Maybe we’ll find a more accurate result than we did in this chapter. Do not worry if we do not! The point of this exercise is experimenting with regularization, not necessarily exceeding that 92% score. ...