Among them, attentive mechanism (Row 5) obtains the best performance in terms of BLEU score, while maintains the training and decoding speeds.
we used the attentive mechanism to implement the function GLOBAL(•) as the default setting in the following experiments.