The motivation is to maintain good token-level accuracy while optimizing on the sequence-level.
a sample is processed with the sequence loss if the token loss under the current model is at least as good as the token loss of a baseline model L b TokLS .