The EM algorithm is guaranteed to continuously increase the likelihood on the training set until convergence to a local maximum.
the likelihood on unseen data will start decreasing after a number of iterations, due to overfitting.