When c t is aligned to a target word y t (we assume that the aligns are always correct and align error problem is beyond the focus of this work), we expect that a certain portion of c t and the embedding of y t are semantically equivalent (that is how the information of the source side is transformed to the target side).
there should be always a certain relation among attention vectors, which are aligned to the same target word.