To overcome this we artificially increase the softmax probabilities (dashed edges in Figure 3) so that they reflect the DFS path decoded up until that point.
we override the predicted word according to the previous index, and backtrack "up" the corresponding edge.