Although the multi-task approach aims to smooth the target distribution, the training process is still driven by the imperfect target text.
at each time step t the algorithm feeds the previous word w t−1 of the target text and evaluates the prediction against the target w t .