Entity Based Attention Second, we explore a more fine-grained way of using the GPT model outputs.
we use bilinear attention between g e and the transformer output for the process tokens X to get a contextual representation c e,t for a given entity.