Formally, multi-head attention first obtains h different representations of (Q i , K i , V i ).
for each attention head i, we project the hidden-state matrix into distinct query, key, and value representations i , respectively.