The model maintains two sets of vectors stored in a hidden state tape used to interact with the environment (e.g., computing attention), and a memory tape used to represent what is actually stored in memory.
a dropout rate of 0.5 was applied to the neural network classifier.