Discriminative re-ranking: The above model is a locally-normalized model that provides a distribution for every decoded token, and thus might suffer from the label bias problem (Andor et al., 2016;Lafferty et al., 2001).
we add a globally-normalized re-ranker p ψ (z | x) that scores all |B| programs in the final beam produced by p θ (z | x).