We address this by distributing computational paths according to different translation pairs over multiple GPUs, following (Ding et al., 2014).
since this attention mechanism was introduced to the encoder-decoder network for machine translation, neural machine translation, which is purely based on neural networks to perform full end-to-end translation, has become competitive with the existing phrase-based statistical machine translation in many language pairs Gulcehre et al., 2015;Luong et al., 2015b).