First, for our supervised baseline, given (q l , q, a) as before, we ignore q and compute how often is q l annotated as essential in the entire dataset.
the score for q l is the proportion of times it was marked as essential in the annotated dataset.