4 For relatedness-specific embeddings, the effect is less clear: joint learning performs comparatively much better.
with retrofitting the model first acquires good representations for frequent words from the raw text, after which it can better understand, and learn from, the information in the thesaurus.