Our method assumes that the local topology among nearest neighbors will be consistent between two NLP tasks (here, language modeling and the target task).
synonyms will have a similar role across NLP tasks.