Only a small corpus is typically available to estimate P (l m |l m−1 m−k max +1 ), where k max is the longest k-gram in the language sequence to be considered.
the transition probability is estimated on-line, making use of language that will be corrected interactively by the user.