To exploit contextual information in both input directions, we process input sentences using a bidirectional LSTM, that reads an input sequence in both normal and reverse order.
for an input sequence x of length T, we compute the hidden state at time t, h t ∈ R 2m via Here, the two LSTMs process x in a forward and a backward order, respectively.