This can be evaluated by analogy tasks.
we use the Google analogy test dataset (Mikolov et al., 2013a), which contains 19,544 questions -8,869 semantic and 10,675 syntactic questions -in 14 relation types, such as capital-world pairs and opposite relationships.