We obtain a slightly better BLEU score with stochastic gradient descent, but this is likely to be just noise from tuning the translation system with MERT.
noise contrastive training reduces training time by a factor of 7.