To do so, we must consider every possible path through which the model could assign attention to a given encoder state.
we can compute the attention distribution induced by MILk by The first summation reflects the fact that h j can influence c i as long as k ≥ j, and the term inside the summation reflects the attention probability associated with some monotonic probability α i,k and the soft attention distribution.