Currently, neural machine translation systems widely use subword segmentation as de facto.
common practice is to uniformly sample from all possible prefixes within minimal length constraint in characters (or words) real distribution of the prefix length may differ to the uniform distribution.