More importantly, this approach inevitably leaves out some nonlocal information which could be useful.
though such a model can exploit similarities between words and other embedded categories, and learn interactions among those atomic features, it cannot exploit any other details of the text.