In the experiments, we use n-grams of size up to 4, excluding n-grams appearing less than 200 times (1000 times on text8) to limit the size of the vocabulary.
segmentations which contain out-of-vocabulary n-grams have a probability equal to zero.