In the standard MH-SA, it jointly attends to information from different representation subspaces at different positions.
mH-SA transform input layer H = h 1 , ..., h n ∈ R n×d into h-th subspace with different linear projections: where are respectively the query, key, and value representations of the h-  Finally, the output states are concatenated to produce the final state.