Neural language models have achieved stateof-the-art performances on many NLP tasks, and recently have been shown to learn a number of hierarchically-sensitive syntactic dependencies between individual words.
equally important for language processing is the ability to combine words into phrasal constituents, and use constituent-level features to drive downstream expectations.