These results provide evidence that, if the Narrative Cloze task is defined to evaluate prediction of held-out text from a document, then sentencelevel RNN language models provide superior performance to RNN models operating at the event level.
linguistic pre-processing does not obviously benefit encoder-decoder models trained to predict succeeding text.