We then concatenate the outputs of the forward and backward LSTMs in the second layer as the word representations for coreference prediction.
a word representation model cannot learn an informative embedding of a pronoun without considering cross-sentence dependency in this case.