For training we use a minibatch size of 128, hidden state size of 1000, a target vocabulary size of 15K, and a source vocabulary size of 30K.
we explore transfer learning for the child model with parent models that only use the English side of the French-English corpus.