Moreover, g ij is also used as the higher-level feature vector for r ij for predicting the relation label.
the objective for the auxiliary task in Equation (4) becomes: where Here R 1 is the reconstruction loss with W dec being the decoding matrix, R 2 follows Equation (4) withŷ R ij = softmax (W R g ij + b R ), and R 3 is the regularization term on the correlations among latent groups with I being the identity matrix andḠ being a normalized group embedding matrix that consists of normalized g k s as column vectors.