The past several years have witnessed the rapid progress of end-to-end Neural Machine Translation (NMT).
there exists discrepancy between training and inference in NMT when decoding, which may lead to serious problems since the model might be in a part of the state space it has never seen during training.