We define the word-level representation (WLR) as the average of the embeddings of the words that the entity name is the embedding of the i th word of an entity name of length n. We opt for simple averaging since entity names often consist of a small number of words with clear semantics.
averaging is a promising way of combining the information that each word contributes.