For matrix multiplication such as v = Wu, its basic form that is calculated at the neuron level is given by Figure 4: Visualizing source hidden states for a source content word "nian" (years).
for element-wise multiplication such as We use the following method to calculate its weight ratio: for maximization such as v = max{u 1 , u 2 }, we calculate its weight ratio as follows: the general local redistribution rule for LRP is given by Algorithm 1 gives the layer-wise relevance propagation algorithm for neural machine translation.