It outputs a new sequence of contextualized sentence encoding vectors, which are enriched with the contextual information from surrounding sentences.
the sequence of individual sentence encoding vectors is input into a bi-LSTM layer, which produces a sequence of hidden state vectors h 1:n (h ∈ R d hd ) with each corresponding to a sentence.