convolution which is left padded) ensures that the pair-embeddings are aligned so that the prediction targets correspond to the later word in the pair.
the pair can be thought of as representing the 'current' and 'previous' words together.