For the linguistic representations we use the continuous vector representations from the log-linear skip-gram model of .
we trained 300-dimensional vector representations trained on a dump of the English Wikipedia plus newswire (8 billion words in total).