−BLEU(ỹ), over all input and output structures: In the case of full-information learning where reference outputs are available, we could evaluate all possible outputs against the reference to obtain an exact estimation of the loss function.
this is not feasible in our setting since we only receive partial feedback for a single output structure per input.