The reason may be that adding RPEs into variant heads can encode order dependencies based word vectors from variant vector sub-spaces, which is one of the advantages of the multi-head mechanism.
+MPRHead (base/big) is slightly better than Transformer (base/big)+BiARN.