It is only required that the loss for a specific inputoutput pair is fixed throughout training.
the above analysis covers the case where some training instances use an extrinsic loss and others an intrinsic parsing loss.