Instead, "on" and "to", have different frequencies and this information is reflected in the conditional probability P (word i |state).
we do not deny the limitations of finite-state models, but argue that our results show that their usefulness has been underestimated.