First, we used the averaged percetron at inference time (Collins 2002).
instead of using the latest Θ Θ Θ after training, we averaged all parameter vectors produced during training, and used the averaged vector, Θ Θ Θ avg , for inference.