As would be expected, the sensibility judgements for MFC and model 5 (Tables 1 and 2, Section 3.5) are perfectly anti-correlated (correlation coefficient −1) with the perplexity for these systems in each data set.
in the absence thereof, we resort to several complementary measures, as well as performing an annotation task.