Let us use a k to denote such an attention vector for word x t k in the hypothesis.
a k is defined as follows 1 : where α kj is an attention weight that encodes the degree to which x t k in the hypothesis is aligned with x s j in the premise.