We can see that ALIGN, SPME and MPME, achieve higher performance in dealing with semantic questions, because relations among entities (e.g., country-capital relation for entity France and Paris) enhance the semantics in word embeddings through jointly training.
their performance for syntactic questions is weakened because more accurate semantics yields a bias to predict semantic relations even though given a syntactic query.