Sparse Labels

Understand sparse representation of labels.

Chapter Goals:

  • Learn how to apply a sparse softmax cross entropy

A. Sparse representation

As mentioned in the Initialization chapter, the CIFAR-10 labels are sparsely represented. This means ...