3: Moreover, self-attention can be further refined as multi-head self-attention to jointly attend to the information from different representation subspaces at different positions.
q, K, and V are linearly projected H times with different, learned linear projections to d k and d v dimensions, respectively.