Mask Similar to the task of predicting missing word, the Mask task is to predict the masked sentence from a candidate pool.
we first mask some sentences within a document with the probability P m and put these masked sentences ( into a candidate pool T m .