In this section, we describe a model for the agent and a training algorithm based on DQN .
we introduce a tree-sampling strategy, which addresses the exploration challenge stemming from the bias towards answers early in the document.