We feed the sequence C i into the context encoder and as usual take the last hidden state as the context embedding h e i .
given C i and e ∈ E, the probability of e being the correct missing entity is: where again σ is the sigmoid function, W and b are model parameters.