These representation learning based methods do not rely on any linguistic tools and can be applied to different languages or domains (Feng et al., 2015).
by encoding the word position j into the query representation, we get the probe representation of the query q as follows: where l j is the j-th column vector of the position encoding matrix l according to the query q.