• Refill Candidate into Query As a characteristic of the cloze-style problem, each candidate can be refilled into the blank of the query to form a complete sentence.
most of the previous works are only relying on query-to-document attention, that is, only calculate one document-level attention when considering the whole query.