Examples of Probability (Density) Functions
Learn about some examples of the probability density function.
There is an infinite number of possible PDFs. However, some specific forms have been very useful for describing some specific processes and have been given names. The following is a small list of examples with some discrete and several continuous distributions. The list is intended to give an overview of distributions that are often mentioned in scientific work, and some of them will be discussed again in later chapters.
Most examples are discussed as 1-dimensional distributions, except the last example, which is a higher-dimensional distribution. Again, we need to keep in mind that machine learning is mostly concerned with high-dimensional cases, so these distributions only act as a starting point for illustrating some ideas.
Bernoulli distribution
A Bernoulli random variable is a variable from an experiment that has two possible outcomes:
- A success with probability
- A failure with probability (1 − )
Probability function:
mean:
variance:
Multinomial distribution
This is the distribution of outcomes in trials that have possible outcomes. The probability of each outcome is therefore .
Probability function:
mean:
variance:
Binomial distribution
An important example is a binomial distribution , which describes the number of successes in Bernoulli trials with probability of success . Note that the binomial coefficient is defined as follows:
Get hands-on with 1200+ tech skills courses.