The original attention mechanism outputs the alignment weights from an extra full connection layer while we think the inner dot can represent the semantic relatedness adequately.
we consider the i-th row of M as the similarity between the i-th position of S and each position in T and normalize it as follows:  For T counterpart, the alignment representation is .