This is also consistent with the finding in (Tu et al., 2016), which indicates that neural networks can model linguistic information in their own way.
to attended positions, it seems that the multi-head attention prefer to encoding the differences among multiple heads in the learned representations.