Evaluation metrics: Evaluation is performed in the setting that a system can choose NOT to answer all problems in the test set.
one has the flexibility of generating answers only when she knows how to solve it or she is confident about her answer.