Context representation in conventional models are limited: First, phrases cannot be used as features directly because of the data sparseness problem.
phrases are backed off to low-order representation such as bigrams and trigrams.