This plot exhibits a known issue with MERT training: because new k-best lists are generated at each iteration, the objective function can change drastically between iterations.
coBLEU converges  Table 1: Performance measured by BLEU using a consensus decoding method over translation forests shows an improvement over MERT when using coBLEU training.