Yet, there is still a substantial room for improvement in the ranking quality of this model, as measured by av-erage precision, and it is possible that a smart combination with a high-quality contextual model would yield better performance.
we would expect that a good contextual model will identify the cases in which for potentially good synonyms pair, the source word appears in a sense that is not substitutable with the target, such as in examples 1, 4 and 5 in Table 1.