To speed up training, we employ bucketed batching, sorting all sentences by their length and grouping similar length sentences into each batch.
to ensure that most sentences do not get grouped within the same batch, we fuzz the lengths of each sentence by a maximum of 10% of its true length when grouping sentences together.