An iterative two-step procedure is also implemented in order to avoid the need of starting with a large seed dictionary (e.g., in the original paper it was tested with a very small bilingual dictionary of just 25 pairs).
simply dropping the orthogonality constraints leads to overfitting, and is thus not effective in practice.