In this situation, only the previously predicted words are known and the probability of current sequence is approximated by dropping the posterior context.
we construct a sequence generation LM using sequence-to-sequence neural network f .