As compared to Experiment 1 where models achieved similar performance, differences are more pronounced in the zero-shot setup, as shown in Table 4.
we find that the SIM-WAP model which induces individual predictors for words that have not been observed in the training data is clearly more successful than TRANS-FER or WAC that project predictions into the distributional space.