Replace The Replace task is to randomly replace some sentences (with probability P r ) in the document with sentences from other documents, and then predict if a sentence is replaced.
we use sentences from 10, 000 randomly chosen documents to form a candidate pool T r .