These models typically view a sentence either as a bag of words (Foltz et al., 1998) or as a bag of entities associated with various syntactic roles .
a mention of an entity contains more information than just its head and syntactic role.