Again, using a beam size of 8, we computed the cost for all generated translations and plotted their histogram in Figure 1.
training with BLEU has some limitations: it doesn't assign partial credit, it has a limited range of output values, and it can penalize semantically correct hypotheses if they differ lexically from the reference.