Suitable initialization will help increase the embedding quality which works like training with multi-epochs.
as there are two matrix M and M in our network structure, the initialization of both of them are more sensible.