Annotation artifacts in the Story Cloze Test, for example, allow models to achieve high performance while only looking at the proposed endings and ignoring the stories (Schwartz et al., 2017;Cai et al., 2017).
the development of benchmarks for common sense remains a difficult challenge.