In the future, we would like to more faithfully capture the semantics of documents by explicitly modeling entities and their linking.
we obtain alignment weights via multi-attention: where β align km = P (a k = m|h y k , [h x 0 : h xm ]), i.e., the probabilistic distribution over alignments from sentences to the kth prediction in the decoder, where a k = m denotes the kth prediction aligned to the mth sentence.