In Japanese, substituting words surrounding a complex word together with the complex word is sometimes necessary.
this model predicts the previous token t k considering the future sequence (t k+1 , ..., t N ).