On closer look, however, we find that the current F1-based results may be somewhat misleading.
several papers report F1 scores in the higher 60% level on balanced datasets-on such datasets a baseline that predicts each pair to be in the hypernym relation already achieves 66% F1.