The reason may be that adding RPEs into variant heads can encode order dependencies based word vectors from variant vector sub-spaces, which is one of the advantages of the multi-head mechanism.
for the other setting not mentioned, we followed the setting in Vaswani et al.