Given a set of questions Q, MRR is computed as follows: where rank i represents the rank position of the first correct candidate answer for the i th question.
mRR is the average of the reciprocal ranks of results for the questions in set Q. mAP is calculated as follows: where q j ∈ Q is a question whose candidate answers are a 1 , ..., a m j and π jk is the rank associated with those candidate answers.