While its performance (0.679) suggests that simple binary feedback is a substantial signal, the difference from the full model indicates value in using soft probabilities.
in a sensitivity study, we found the performance of the approach to be robust to small changes in the probability values of quantifiers.