Similar to the nearest neighbor matching model, we can feed the hidden vector of BERT in the last layer, h L i , into an affine transformation followed by softmax.
h i in Equation 7 is instan-tiated by h L i .