For instance, in softmax, each input is simply weighted by its contribution to the sum.
when compared to LSTM and CNN/LSTM models, GRA with alignment produces a consistently larger union of correct cases (typically by 5-10%) than GRA without alignment.