As far as we know, we are the first to do a large-scale study on actively training Transformer (Vaswani et al., 2017) for NMT.
with a human translation budget of only 20% of the original parallel corpus, we manage to surpass Transformer trained on the entire parallel corpus in three language pairs.