is proportional (with a factor of N) to the expected sentence BLEU score over the entire training set, i.e., after some algebra, In a phrase-based SMT system, the total number of parameters of phrase and lexicon translation models, which we aim to learn discriminatively, is very large (see Table 1).
regularization is critical to prevent over-fitting.