For the POS induction task, we specifically need embeddings that capture syntactic similarities.
we experiment with two types of embeddings that are known for such properties: • Skip-gram embeddings (Mikolov et al., 2013) are based on a log bilinear model that predicts an unordered set of context words given a target word.