The encoder representation is thus given by the hidden units at the last state: In this paper, RNN-based encoders have four variants, namely, RNN, GRU, LSTM, and BiL-STM.
as BiLSTM has two opposite directions, its context representation takes the concatenation of the last states from both directions, which come from two ends of a given context.