The parameters Θ are learned by training a sequence-to-sequence neural model on a corpus of parallel sentences.
the learning objective is to maximize the following conditional log-likelihood: The models typically use gated recurrent units (GRUs) (Cho et al., 2014) or LSTMs (Hochreiter and Schmidhuber, 1997).