We propose a recurrent positional embedding approach based on part of word embedding instead of numerical indices of words to capture order dependencies between words in a sentence.
the embedding of each word x j is divided into two parts x p j and x r j , and their dimensions are respectively.