This is because once the lower bound is reached, the errors introduced due to the violation of equality constraint are removed.
one needs to think of embedding algorithm's capability to capture these differences effectively, which is governed by its hyperparameters.