Applying softmax to the attention scores indicated that the receiving neural network must focus on a certain part of the input.
this assumption might not hold in the GRA framework as phrase information is not always needed at each timestep of RNN training.