Instead, a weighted average of the actual output and the desired output is used: where DES is the desired output, DES = ( D 1 ; D 2 ; 1 11 ; D ); 12whose bits are dened as and w OPT and w DES are respectively dened as and w DES = 1 0 w OPT ; (15) where E OBJ and E ACT are the objective and actual errors.
at the beginning of training, the weighting of the desired output is large.