Although distributional word vector dimensions cannot, in general, be identified with linguistic properties, it has been shown that some vector construction strategies yield dimensions that are relatively more interpretable (Murphy et al., 2012;Fyshe et al., 2014;Fyshe et al., 2015;Faruqui et al., 2015b).
we thank Nathan Schneider for giving comments on an earlier draft of this paper and the anonymous reviewers for their feedback.