Instantiations of this framework include the widely-used attention-based sequenceto-sequence model (Bahdanau et al., 2015), in which f enc and f dec are implemented by an RNN architecture using LSTM (Hochreiter and Schmidhuber, 1997) or GRU (Chung et al., 2014) units.
the prevalent approach to training such a model is to update all the model parameters using all the examples in the training data (over multiple epochs).