(1): where j is the word's position index in the sentence and i is the number of dimensions of the position index.
there is a sequence of positional embeddings: Each pe j is then added to the corresponding word embedding x j as an combined embedding v j : Finally, a sequence of embeddings is the initialized sentence representation H 0 .