Additionally, embeddings have been customized to distinguish functional similarity from relatedness (Levy and Goldberg, 2014;Kiela et al., 2015).
levy and Goldberg train their embeddings by replacing the standard linear context of the target word with context derived from the syntactic dependency graph of the sentence.