The novelty of this pilot task is that questions are originally developed for assessing human English ability, rather than specifically developed for NLP system evaluation.
it is expected that various aspects of human natural language understanding appear in solving such questions.