A backward LM is similar to a forward LM except that it is provided with the reversed input of a sequence.
this model predicts the previous token t k considering the future sequence (t k+1 , ..., t N ).