Recently, Ye et al. (2019) propose to mask one entity mention in a sentence, and then formulate a multiple-choice QA task (Talmor et al., 2019) for representation learning, by treating the masked sentence as the question, and the masked entity plus its negative samples as answer candidates.
this model does not quite match the MLM since the model is pre-trained by multiple-choice QA and only one entity can be masked in a sentence.