Deep learning representations have seen their share of successes in Natural Language Processing (NLP) tasks Zheng et al., 2013;Gao et al., 2014;Glorot et al., 2011;.
rNN models have been successfully applied in several scenarios where temporal dependencies provide relevant information (Ian Goodfellow and Courville, 2016;LeCun et al., 2015).