For this data set, we also see an improvement when using a part-of-speech language model -the BLEU score increases from 18.19% to 19.05% -consistent with the results reported in the previous section.
moving from a surface word translation mapping to a lemma/morphology mapping leads to a deterioration of performance to a BLEU score of 14.46%.