In addition to the exact calculation, we also experimented with establishing exact probabilities via p(w|h, s) only at the end of each token in x, and assuming that the probabilities of the intervening characters vary linearly between these points.
of this assumption, 1 |h, s) is constant for all k between the end of one word and the next, and therefore can be factored out of the sum in equation 2between these points.