This is mainly caused by the phenomenon that any word profile P i,• becomes dependent of all other word profiles after an iteration.
we adopt a simpler method, gradient descent, in which P is updated by taking a small step in the direction of the negative gradient of (P P − I) 2 .