In other words, the knowledge regularization will smoothly penalize constraint depending on whether this constraint can be applied for interpreting relevant relation in a particular context.
we use cosine similarity 8 to measure the similarity of two vectors, so the score function for triplet (h, r, t) has the following form: where h r is the relation-specific vector which will be updated as parameters during model training.