Boosted by early successes in language modelling for speech recognition (Schwenk, 2007;Le et al., 2011), NNs have since been successufully applied to many other tasks (Socher et al., 2013;Huang et al., 2012;Yang et al., 2013).
these techniques have been applied to Statistical Machine Translation (SMT), first to estimate continuous-space translation models (CTMs) Le et al., 2012;Devlin et al., 2014), and more recently to implement end-to-end translation systems (Cho et al., 2014;Sutskever et al., 2014).