A simple way to measure the compatibility of label-word pairs is via the cosine similarity whereĜ is the normalization matrix of size K×L, with each element obtained as the multiplication of 2 norms of the c-th label embedding and l-th word embedding: To further capture the relative spatial information among consecutive words (i.e., phrases 1 ) and introduce non-linearity in the compatibility measure, we consider a generalization of (2).
a key intermediate step is the text representation.