Training Sampler

Create a Training Sampler object for training the decoder.

Chapter Goals:

  • Learn about the decoding process during training
  • Create a TrainingSampler object to use for decoding

A. Decoding during training

During training, we have access to both the input and output sequences of a training pair. This means that we can use the output sequence's ground truth tokens as input for the decoder. ...