One major limitation is that it is not designed to learn from dependencies which lie in the surrounding but not quite immediate neighborhood.
the feature vectors have to be explicitly modeled to include the surrounding contextual information.