However, where perplexity measures how good the model is at predicting a script event given the previous events in the script, narrative cloze measures how good the model is at predicting what is missing between events in the script.
narrative cloze is somewhat more appropriate to our task, and at the same time simplifies comparisons to prior work.