MQAN also includes pointer-generator networks (See et al., 2017), which allow it to copy tokens from the input text depending on the attention distribution of an earlier layer.
if not otherwise noted, we use the same number of training instances as in the original training splits with duplicates.