There is, however, a drawback of BPE in its deterministic nature: it splits words into unique subword sequences, which means that for each word a model observes only one segmentation.
a model is likely not to reach its full potential in exploiting morphology, learning the compositionality of words and being robust to segmentation errors.