For instance, if one uses our PMI objective, then the weighted average of the termwise error in (2.5) is 17%, and the expression in (4.1) above contains six inner products.
in principle the approximation error could lead to a failure of the method and the emergence of linear relationship, but it does not.