We use the pre-extracted general knowledge to construct the enhanced context embeddings.
for each word w, whose context embedding is c w , to construct its enhanced context embedding c * w , first recall that we have extracted a set E w , which includes the positions of the passage words that w is semantically connected to, thus by gathering the columns in C P whose indexes are given by E w , we obtain the matching context embeddings Z ∈ R d×|Ew| .