However, the goal of this paper is not to achieve state-of-the-art performance on this task, but rather we are trying to understand the mechanisms of LSTMs.
we choose a relatively simple model (see Figure 1) !