For simplicity, we use the same architecture for the attention source (just introduced) and for the attention focus, t y (i.e., for the attention focus: f mgran (H y ) = H y mgran ; see Figure 4(b)).
the focus of attention will participate in the matching process as well as be reweighted to form an attentive context vector.