We use long short-term memory (LSTM) based model (Hochreiter and Schmidhuber, 1997), which uses memory and gated mechanism to compute the hidden state.
we use a bidirectional LSTM model (Bi-LSTM) similar to the ones used in (Graves, 2013;Huang et al., 2015).