The LM was trained by randomly removing a word in a sentence, inserting other words within window 10 (±5) of the removed word as an input, and using the removed word as an output.
positional encoding in the LM treats the index of the removed word as the current word index b = 5 in (14), and its 10 indexes of input are 0, … ,4,6, … ,10.