The beam size for decoding is 12, and the cost function is optimized by Adadelta with hyper-parameters suggested by Zeiler (2012).
for TFA-NMT, the foresight embedding is also 620, and the hyper-parameter λ is 1.