The first two values depend on the current model, so the saved values must be cleared between iterations of training.
furthermore, the costs provide our system a measure of the severity of a mistake, which we argue is very beneficial for the coreference task.