The element-wise product ⊗ is applied between the token embedding Q tq and the last dimension of kernel weights U.
we create F convolutional kernels for each query token, where each kernel is "injected" with the embedding of that query token via element-wise product.