Furthermore, it is trained from sentence pairs without word alignments in an unsupervised fashion.
: • We approximate the exact conditional log-likelihood objective inspired by contrastive estimation (Smith and Eisner, 2005) as the optimization of the exact objective is very expensive.