We investigate the use of distributional representations, which model the probability distribution of a word's context, as techniques for finding smoothed representations of word sequences.
we use the distributional representations to share information across unannotated examples of the same word type.