Indeed, the corresponding automaton may have Òì transitions.
even if the vocabulary size is just 1,000, the representation of a classical trigram model may require in the worst case up to one billion transitions.