The dominant approach for many NLP tasks are recurrent neural networks, in particular LSTMs, and convolutional neural networks.
these architectures are rather shallow in comparison to the deep convolutional networks which have pushed the state-of-the-art in computer vision.