Change the Network Shape

Structure of the neural network

One thing we haven’t yet tried, and perhaps we should have earlier, is to change the shape of the neural network. Let’s try changing the number of middle hidden layer nodes. We’ve had them set to $100$ for far too long!

Before we jump in and run experiments with different numbers of hidden nodes, let’s think about what might happen. The hidden layer is the layer where the learning happens. Remember, the input nodes simply bring in the input signals, and the output nodes simply push out the network’s answer. It’s the hidden layer (or layers), that has to turn the input into the answer. It’s where the learning happens. Actually, it’s the link weights before and after the hidden nodes ...