Average and ensemble techniques on checkpoints can lead to further performance improvement.
as these methods do not affect the training process, the system performance is restricted to the checkpoints generated in the original training procedure.