In other words, we cannot merely use the information of the sentence being processed as the state.
we add the information from the early states into the representation of the current state, in which way to model our task as a MDP problem (Fang et al., 2017).