GAN Model Architectures

The following section will discuss alternative GAN model architectures for the discriminator and generator.

ResNet GAN

In its simplest form, a ResNet network is a network with residual layers. A residual layer is a layer in which the layer input is added to the layer output. This connection from the layer input to the layer output is called a residual connection, as illustrated in the following diagramMultiple variations of the a ResNet layer. Copied from Identity Mappings in Deep Residual Networks (https://arxiv.org/abs/1603.05027):