Each node in the tree then requires both a bag vector, n b , to handle the bag context, and 2k sequence vectors, n s i , to handle the sequence context vectors, with probabilities given by: A second source of information which might be used to differentiate semantic from syntactic representations is morphology.
english has the useful characteristic that the written words themselves can often be broken into a semantic stem on the left and a syntactic ending on the right.