Thus, we introduce position embeddings when modelling the sentence and further generate the positionaware representations.
the position information is considered as a kind of features and embedded into position embeddings.