The plots show that, for similar words, the learned weights for the corresponding lexical features are only slightly similar; but after the lexical features are reduced to low-dimensional embedding features, the learned weights for the corresponding features are more strongly correlated.
weights for embedding features encourage similar behaviors between similar words, due to a much lower di-  mensionality.