On the other hand, generating words from a decoder state is based on timeconsuming calculations of a softmax distribution, given that the vocabulary size is relatively large.
we would like to try abandoning decoder word generation, while just directly copying words from the input document instead.