Qualitative Methods
Get familiar with qualitative evaluation methods for GANs, like k-nearest neighbors, mode analysis, and participant experiments.
We'll cover the following
The evaluation of GANs with qualitative methods focuses on exploratory data analysis. In such methods, the researcher evaluates the fake samples by visual inspection. This can be done independently from other samples or with respect to real samples. Qualitative methods are useful as they can quickly provide information about issues with your current GAN experiment related to image quality, image variety, and the violation of specifications.
In GAN literature, the visual inspection of samples is a very common practice, and authors use it to quickly confirm that they have not observed mode collapse or that their framework is robust enough to avoid mode collapse if some criteria are met (Arjovsky et al., 2017; Gulrajaniet al., 2017; Mao et al., 2016; and Radford et al., 2015).
Qualitative methods for evaluation are very useful to quickly detect problems with fake data. This allows us to quickly modify our experiment to achieve better results. This qualitative evaluation, however, comes at the price of being superficial and not systematic. For a deeper and more systematic evaluation of fake samples, it is necessary to devise a systematic, quantitative evaluation.
In the following sections, we provide some qualitative measures for GAN evaluation, as elaborated by Ali Borji in his paper, “Pros and Cons of GAN Evaluation Measures.”
-nearest neighbors
Generally speaking, the
Mathematically speaking,
Get hands-on with 1200+ tech skills courses.