Similar to (dos Santos et al., 2014), our model is trained by contrasting positive and negative parallel sentences.
to compile our training set, given each source sentence, we generated a positive parallel pair by taking its correct target sentence and a negative parallel pair by taking a randomly chosen sentence from target sentences.