However, alignments are contextsensitive: the decision to align source word i to target word j may affect the probability of aligning the neighbors of i and j.
before applying the sigmoid function to the matrix A we convolve it with a shared weight matrix, yielding a matrix A , which encodes the relationships between alignments; this is given by A = W conv * A, where * is the convolution operator.