Each of these matrices is of size vocab_size � hidden_size, and thus each token in the vocabulary has its corresponding q, k, and v vectors.
we replace all utterances of "important" words with it's T L dictionary translation.