Any other solution will match the empirical distribution of the data less well.
a solution with additional word boundaries must have 1 − p $ > 0, which means it wastes probability mass modeling unseen data (which can now be generated by concatenating observed utterances together).