Mathematical Formulation of the Basic Learning Problem

Much of what is currently associated with the success of machine learning is supervised learning, sometimes also called predictive learning. The basic task of supervised learning is that of taking a collection of input data $\bold{x}$ and predicting an output value $\bold{y}$.