The reported MAP values are very low -this is due to many rare Word-Net hyponyms not occurring in the candidate set, for which all systems are automatically penalised.
this allows us to evaluate recall, making the results comparable between different systems and background datasets.