The impact of lexical memorization is illustrated by Table 16, using a sample of concept pairs containing "prototypical hypernyms" (Roller and Erk 2016) such as animal: The regression models assign high scores even to clear negatives such as (plant, animal).
the effect of lexical memorization also partially explains the improved performance of all regression models over UNSUPERVISED baselines for a random split, as many (X t , animal) pairs are indeed assigned high scores in the test set.