Weighted Decomposition (WD): Based on ideas from the literature on word embedding algorithms, we also consider weighting different elements of the tensors differently in order to reduce the effect of the large dynamic range of the tensor values.
we employ the GloVe objective function to our tensor model and minimize the objective function (2): where b U i is the scalar bias for the word i in the matrix U .