To achieve this goal, we borrow the idea from Scheduled Sampling.
during training when decoding, there is a possibility that we feed our model with an estimateŷ t−1 coming from the model itself rather than true previous token y t−1 .