These techniques can help us obtain x' and x'' more efficiently
at the pre-training stage, they are trained on a huge amount of unlabeled data in an unsupervised manner, e.g., T5 is pre-trained on 745 GB text.