(2011a) proposed models where N i for the ith tuple (e 1 , e 2 ) is defined as: {r j | r j (e 1 , e k ) ∈ D, e k = e 2 , r j / ∈ P i }, which is a subset of L \ P i .
entity e 2 is considered a negative example for relation r j (in the context of entity e 1 ) only if r j exists in the training data with a different value.