For both language pairs, this accurately reflects the empirical distribution of token length, as can be seen in Figure 2.
experiments where P (s) was directly optimized performed better, indicating that this parameter should be optimized within the context of a complete system.