To allow the Transformer to utilize the order information of source code tokens, we train an embedding matrix W Pe that learns to encode tokens' absolute positions into vectors of dimension dmodel .
we show that capturing the order of code tokens is not helpful to learn source code representations and leads to poor summarization performance (§ 3.2).