This is because aligned entities tend to have some relations in common, and similar relations should have similar categories of head and tail entities.
we first pre-train the entity alignment model (Section 4.2) until its entity alignment performance has converged to be stable.