These methods are useful in capturing semantic information carried by high-level units (such as phrases and beyond) and usually do not rely on word alignments.
they suffer from reduced accuracy for representing rare tokens, whose semantic information may not be well generalized.