Nonetheless, we try to use a reasonable estimate so that the reported KL divergence is interpretable in an absolute sense.
we take z(x) = log y∈Yp (y | x) ≤ log Z, where Y is the full set of distinct particles y that we ever drew for input x, including samples from the beam search models, while constructing the experimental results graph.