This work is in line with Baidu-ERNIE (Sun et al., 2019a) and SpanBERT  which replace word-level mask (Devlin et al., 2019) with span-level one for knowledge information and longterm dependency.
baidu-ERNIE uses uniformly random masking for phrases and entities, whereas SpanbERT directly masks out token spans sampled under geometric distribution.