As a basic step of our PMSN model, we first embed a context pattern of an entity as a single embedding vector.
we use the average word embeddings, from the pre-trained GloVe (Pennington et al., 2014) embeddings, of a pattern surface text as the pattern embeddings.