We investigate whether our model can benefit from state of the art text comprehension models, for which this task was designed.
we experiment with an LSTM-based (Hochreiter and Schmidhuber, 1997) recurrent neural network language model (RNNLM; Mikolov et al., 2010).