We find that while the attention identifies the 10-th source word "kuadaxiyang" (cross-atlantic) to be most relevant, the relevance vector of the target word R y 9 finds that multiple source and target words should contribute to the generation of the next target word.
for element-wise multiplication such as We use the following method to calculate its weight ratio: for maximization such as v = max{u 1 , u 2 }, we calculate its weight ratio as follows: the general local redistribution rule for LRP is given by Algorithm 1 gives the layer-wise relevance propagation algorithm for neural machine translation.