Specifically, we take z(x) = log y∈Yp (y | x) ≤ log Z, where Y is the full set of distinct particles y that we ever drew for input x, including samples from the beam search models, while constructing the experimental results graph.
16 the offset KL divergence is a "best effort" lower bound on the true exclusive KL divergence KL(p||p).