Given an instance s with T tokens 2 , a common input representation of NRE models is x denotes the embedding of token i and d x is the token embedding size.
x i is the concatenation of the word embedding, , to be aware of both semantics and entity positions, where Given the relation type r, NRE models perform different types of tensor manipulations on x and obtain the predicting probability of r given the instance s as P φ (r|x), where φ denotes model parameters except for the input embedding tables.