Neurons and the Threshold Perceptron

In this chapter, we discuss the basic operation of an artificial neural network which is the major paradigm of deep learning. The name is derived using an analogy to a biological brain. We start this introduction by outlining the basic operations of neurons in the brain and how these operations are abstracted by simple neuron models. We then build networks of artificial neurons that constitute much of the recent success of AI. We will concentrate in this chapter on using such techniques and will later come back to discussing their theoretical embedding.