Since our method only results in P (shifted) repetitions of the dataset, each epoch using the augmented dataset would take ∼ P times longer than an epoch over the original dataset.
a first contribution in this work is a mechanism to en-sure that all token sequences are taken into account, i.e.