Notice that, both E s⌧ and E s ⌧ +1 are associated with the same positional encoding U 1:L .
the model has no information to distinguish the positional difference between x ⌧,j and x ⌧ +1,j for any j = 1, .