Roughly, we expect that if θ h f h (x i , y) is much higher for y = y i than for other values of y, then the annotator's r i is correspondingly more likely to indicate in some way that feature f h strongly influenced annotation y i .
at any given moment, such a tool should allow the annotator to highlight, view, and edit only the several rationales for the "current" annotated entity (the one most recently annotated or re-selected).