LEAM greatly improves the performance by considering nonlinear interaction between phrase and labels.
we note that the text embedding in PTE is similar with a very special case of LEAM, when our window size r = 1 and attention score β is uniform.