It explores implicit relational information underlying raw text by the guidance of a KG, and is shown to mask more informative entities compared to the previous random approaches.
the scheme is designed to avoid or reduce masking two types of entities: trivial and undeducible.