Since LSTM only considers the context from the previous, we utilize a bidirectional LSTM (Bi-LSTM) preserving both history and future information.
at each position t of the sequence, we can obtain two representations − → h t and ← − h t .