In language related problems, the structural knowledge can be extracted out by processing sequences both forward and backward so that the complementary information from the past and the future can be integrated for inference.
bidirectional LSTM (B-LSTM) containing two hidden layers were proposed (Schuster and Paliwal, 1997).