Given a suitable oracle, the proposed methodology can be easily extended to other psycho-linguistic preferences such as politeness.
we observe a reasonable difference in the formality scores among hypotheses with similar generation probabilities.