(2015) proposed to combine deep learning and structured learning for language parsing which can be learned by structured perceptron.
they also separate neural network training with structured prediction.