, α H ) ∈ {0, 1} H to control H different heads and aggregate them as a n × D output matrix G = H i=1 α i G i .
the j-th row of G, denoted as C j ∈ R D , can be understood as the output corresponding to the j-th input token y j in the response.