The expectation of c i,j can then be written as: The GloVe objective is defined in the following form (Pennington et al., 2014): where β(•) represent a 'weighting function'.
β(•) satisfies the relations 0 ≤ β(x) < ∞, and β(x) = 0 if x = 0.