TriviaQA), storing the evidence sentences that precede span words may be useful as they may provide useful context.
using only discrete policy gradient method, we cannot preserve such context instances.