The models are trained using Adagrad (Duchi et al., 2011), reshuffling the training corpora for each epoch.
it is interesting to see what is the reason behind the very low performance of the generic NMT system compared to the generic PBMT.