Due to the need for our model to treat each word equally, Bi-LSTM is introduced to the Text Encoding module.
at each position , we concatenate the output ⃗⃗⃗⃗ , ⃖⃗⃗⃗⃗ ∈ ℝ of the two inverted LSTMs as the output of the current word as follows: each output contains not only the current word information but also the contextual information.