Deep learning (Goodfellow et al., 2016) has seen a surge of interest in recent years, transforming all application domains of machine learning.
neural network (NN) architectures currently dominate the development of models and applications in NLP, including syntactic parsing (Chen and Manning, 2014;Durrett and Klein, 2015), sequence labeling (Grave, 2008), information extraction dos Santos et al., 2015), text classification (Lai et al., 2015;Zhang et al., 2015) and sentiment analysis (Dos Santos and Gatti, 2014;Dong et al., 2014).