In addition, considering that the context words with closer distance to an aspect may have higher influence to the aspect, we utilize the position encoding mechanism to simulate the observation.
formally, the weight for a context word w j , which has l word-level distance from the aspect (here we treat the aspect phrase as a single unit), is defined as follows: we treat the weights of words within the aspect as 0 in order to focus on the context words in the sentence.