Weights: The Heart of the Network

Weights

Let’s create the network of nodes and links. The most important part of the network is the link weights. They’re used to calculate the signal being fed forward, the error as it’s propagated backward, and the link weights themselves are refined in an attempt to improve the network.

The weights can be concisely expressed as a matrix. So, we can create:

• A matrix for the weights for links between the input and hidden layers: $W_\text{input\_hidden}$, of size $(\text{hidden\_nodes} \times \text{input\_nodes})$.

• A matrix for the links between the hidden and output layers: $W_\text{hidden\_output}$ ...