In the case of reranking whole target sequences y, this becomes the marginal P (y), which corresponds to the same diversitypromoting objective used in (Li et al., 2015).
we found that our approximation works better in terms of N-choose-1 accuracy (see Section 5.2), which suggests that its value may be closer to the true conditional probability.