Besides, we think that the original representation and the aligned representation via attention can reflect the content semantics in different granularities.
we also apply a particular fusion function after each attention function, so that different levels of semantics can be better incorporated towards a better understanding.