For the j th word in a sentence, Word-Position Embedding generates a vector representation w j as concatenated three components w w j , w p1 j , w p2 j .
w w j is the word embedding of the word and w p1 j and w p2 j are two position embeddings.