Thus, we assess the contribution of ITG ranking by computing standard uninterpolated average precision scores used to evaluate the effectiveness of ranking methods.
in this case, this is the expected value of precision over the rank positions of the correctly identified truly parallel bi-sentences: where T is the set of correctly identified bi-sentences.