Thus there is a potential danger that models trained with BPEdropout may tend to use more fine-grained segmentation in inference and hence to slow inference down.
in practice this is not the case: distributions of lengths of generated translations for models trained with BPE and with BPEdropout are close (Figure 4 (b)).