We also consider a few variations of our model.
the following models are implemented and tested in our experiments: • Word-by-word attention (d = 150): This is our implementation of the word-by-word attention model by Rocktäschel et al.