In the case of the diabetes task, we again observe a pattern of low JSD for positive examples (where evidence is present) and high JSD for negative examples.
for this task, if one perturbs the attention weights when it is inferred that the patient is diabetic, this does change the output, which is intuitively agreeable.