Generative Models

Explore autoregressive models, variational autoencoders (VAEs), and reversible flow models for generative tasks.

We will look into the various approaches of generative models.

Autoregressive models

An autoregressive model estimates the conditional distribution of some data yy, given some other values of yy. For example, in image synthesis, it estimates the conditional distribution of pixels given surrounding or previous pixels; in audio synthesis, it estimates the conditional distribution of audio samples given previous audio samples and spectrograms.

In its simplest linear form, with dependency on the previous time-step only and time-invariant bias term, an autoregressive model can be defined with the following equation:

Get hands-on with 1200+ tech skills courses.