Transformers (Vaswani et al., 2017) already make extensive use of linear maps in multi-headed attention and appear to be justified in doing so.
there is no evidence that models exclusively represent relationships in this manner.