Each node in the tree then requires both a bag vector, n b , to handle the bag context, and 2k sequence vectors, n s i , to handle the sequence context vectors, with probabilities given by: A second source of information which might be used to differentiate semantic from syntactic representations is morphology.
the semantic task correlates predicted semantic similarities with the noun-verb similarity ratings gathered by Mitchell (2013), and the remaining task clusters the syntactic representations and evaluates these clusters in relation to the POS classes found in the Penn treebank.