A forward directional LSTM starts from the beginning of a sentence and goes from left to right sequentially until the sentence ends, and vice versa.
our approach is general and can be applied with other types of language models.