However, some sequences have multiple possible segmentations, and a model considering a single one might underestimate the true probability of the sequence.
it is important to marginalize over the set of segmentations to obtain the true probability of a sequence (van Merriënboer et al., 2017;Buckman and Neubig, 2018).