3 In many sequence models where the vocabulary size is large, exact inference by finding the true shortest path in the graph discussed in Section 3.2 is intractable.
approximate inference techniques such as beam search are often used, or the size of the search space is reduced, for example, by using a Markov assumption.