For every parallel sentence pair, we randomly sample k negative sentences {N i |i = 1 .
we later realized that the cross lingual sentence similarity objective is at odds with what we want the attention layer to learn.