We also compare with Transformer (Vaswani et al., 2017) and OpenNMT (Klein et al., 2017), trained on the same dataset and with the same set of hyperparameters as our systems.
we compare with Transformer-tf, one popular implementation 7 of Transformer based on TensorFlow, and we choose OpenNMT-tf, an official release 8 of OpenNMT implemented with TensorFlow.