1 In this paper, we propose a cross-sentence context-aware NMT model, which considers the influence of previous source sentences in the same document.
2 we employ a hierarchy of Recurrent Neural Networks (RNNs) to summarize the cross-sentence context from source-side previous sentences, which deploys an additional documentlevel RNN on top of the sentence-level RNN encoder (Sordoni et al., 2015).