Successful phrase-based systems typically employ language models of order higher than two.
our models so far have the following important "Markovian" property: the cost of a path is additive relative to the costs of transitions.